劉峻利 (ED422, x 54232) (ringo.cl.liu@gmail.com) Recitation 助教複習: Friday 6:30-8:30pm, ED220

• Math Symbols in English
• Mean & Variance
• Gaussian
• Poisson&exponential
• Bivariate Normal

DEE 1316 (2011 Spring)

10:00pm-12:00noon Monday; 1:30pm-3:30pm Wednesday (ED609)
Please make an appointment in advance (請儘可能事先預約時段)

李兆軒 (ED422, x 54232) (pig19870210@hotmail.com)
羅偵源 (ED422, x 54232) (jrwinds@hotmail.com)
林振揚 (ED529, x 54228) (talent31022@gmail.com) Recitation 助教複習: Friday 6:30-8:30pm, ED220

• The Final Scores of this course are attached below. Please contact me before June 30, if you have any question about your final scores. Otherwise, the scores are NOT changed after June 30. Your final examine answer sheet is not returned to you. If you like to look at it, please contact me before June 30.本課程學期成績如下檔，如有問題，務必與老師在6月30日前連絡上，逾期不能更動分數。期末考卷不發還，想看考卷請在6月30日前與老師連繫。 Course grades
  

• Syllabus
• Introduction

(1) Prob Basics (I)
(2) Prob Basics (II)
(3) Discrete Random Variables (I)
(4) Discrete Random Variables (II)
(5) Multimple Discrete RVs
(6) Continuous RVs
(7) Multiple Continuous RVs
(8) Derived Distributions

• Review (Chaps 1-3)

(9) Conditional Expectation
(10) Transform
(11) Limit Theorems
(12) Fundamentals of Statistics (updated: 6/04)

• Review (Chaps 4,5,8)

(1) HW1 (Due: 3/14)
(1S) HW1 solutions
(2) HW2 (Due: 3/30)
(2S) HW2 solutions
(3) HW3 (Due:4/20)
(3S) HW3 solutions
(4) HW4 (Due: May 16)
(4S) HW4 solutions (updated 5.25)
(5) HW5 (Due: May 25)
(5S) HW5 solutions
(6) HW6 (Due: June 8)
(6S) HW6 solutions
(7) HW7 (Due: June 20)
(7S) HW7 solutions \\

李兆軒 (ED422, x 54232) (pig19870210@hotmail.com) \\

林振揚 (ED529, x 54228) (talent31022@gmail.com) Recitation 助教複習: Friday 6:30-8:30pm, ED220\\

• The Final Examine is to be held at 10:10am on June 22 (Wednesday) (110 mins, closed-book; Chaps 1-5 [exclude 5.3 & 5.5], Secs. 8.1 & 8.2) 期末考將在6月22日(週三)上午10:10舉行 (不可看書，110分鐘，範圍: Chaps 1-5, Secs. 8.1 & 8.2; 但5.3及5.5除外)
  * The recorded grades of HW sets 1 to 6, Quizzes 1 & 2 and Midterm are attached below. Please contact TA or me before the final examine, if you find something incorrect. 目前課程記錄同學成績(6次作業，小考2，期中考)如下，如有問題請在期末考前與助教或我連繫更正。 Course grades (updated: 6/19)
  * HW Score calculation: We will pick up the best 5 HW scores for calculating your HW final scores. In other words, if you miss one or two HW assignments, it may not have an impact on your final scores. 作業分數計算: 在7次作業中挑選最高成績的5次，計算最後作業成績。

(7S) HW7 solutions \\

(12) Fundamentals of Statistics (updated: 6/04)

• Review (Chaps 4,5,8)

(7) HW7 (Due: June 20) \\

• The recorded grades of HW sets 1 to 4, Quiz 1 and Midterm are attached below. Please contact TA or me before the final examine, if you find something incorrect. 目前課程記錄同學成績(4次作業，小考1，期中考)如下，如有問題請在期末考前與助教或我連繫更正。 Course grades (updated: 6/02) \\

• The Final Examine is to be held at 10:10am on June 22 (Wednesday) (110 mins, closed-book; Chaps 1-5, Secs. 8.1 & 8.2) 期末考將在6月22日(週三)上午10:10舉行 (不可看書，110分鐘，範圍: Chaps 1-5, Secs. 8.1 & 8.2) \\

(7) HW7 (Due: June 15) \\

• The Final Examine is to be held at 10:10am on June 22 (Wednesday) (110 mins, closed-book; Chaps 1-5, Secs. 8.1 & 8.2) 期末考將在6月22日(週三)上午10:10舉行 (不可看書，，110分鐘，範圍: Chaps 1-5, Secs. 8.1 & 8.2) \\

(6) HW7 (Due: June 15) \\

• The Final Examine is to be held at 10:10am on June 22 (Wednesday) \\

(6) HW6 (Due: June 8) \\

(12) Fundamentals of Statistics \\

• The recorded grades of HW sets 1 to 4, Quiz 1 and Midterm are attached below. Please contact TA or me before the final examine, if you find something incorrect. 目前課程記錄同學成績(4次作業，小考1，期中考)如下，如有問題請在期末考前與助教或我連繫更正。 Course grades \\

• The Final Examine is to be held at 10:10am on June 22 (Wednesday)
• The recorded grades of HW sets 1 to 4, Quiz 1 and Midterm are attached below. Please contact TA or me before the final examine, if you find something incorrect

目前課程記錄同學成績(4次作業，小考1，期中考)如下，如有問題請在期末考前與助教或我連繫更正。

  Course grades \\

• Quiz 2 is to be held at 9:am on May 30 (Monday) (50 mins, closed-book; Chap 4 = (Lecs. 8 to 10)) 第2次小考在5月30日上午9:00 (不可看書，50分鐘，範圍: 課本Chap 4)舉行。 Please let me know if you cannot take Quiz 2 on May 30.

(11) Limit Theorems
6. Fundamentals of Statistics

(4S) HW4 solutions (updated 5.25) \\

(5S) HW5 solutions \\

(4S) HW4 solutions (updated 5.25)
(5) HW5 (Due: May 25)
(5S) HW5 solutions \\

(4S) HW4 solutions
(5) HW5 (Due: May 25)

(10) Transform
5. Limit Theorems \\

(4) HW4 (Due: May 16)

• Quiz 2 is to be held at 9:am on May 30 (Monday) (50 mins, closed-book; Chap 4 = (Lecs. 8 to 10)) 第2次小考在5月30日上午9:00 (不可看書，50分鐘，範圍: 課本Chap 4)舉行。 Please let me know if you cannot take the Quiz 2 on May 30.

• Quiz 2 is to be held at 9:am on May 30 (Monday) (50 mins, closed-book; Chap 4 = (Lecs. 8 to 10)) 第2次小考在5月30日上午9:00 (不可看書，50分鐘，範圍: 課本Chap 4)舉行

Please let me know if you cannot take the Quiz 2 on May 30.

Quiz 2 is to be held at 9:am on May 30 (Monday) (50 mins, closed-book; Chap 4 = (Lecs. 8 to 10)) 第2次小考在5月30日上午9:00 (不可看書，50分鐘，範圍: 課本Chap 4)舉行

(1) HW1 \\

(2) HW2 \\

(3) HW3 \\

(4) HW4 (Due: May 16)

MIT Open Course Ware

(9) Conditional Expectation
4. Joint Distribution and Function of Random Variables \\

• Review (Chaps 1-3) \\

 *  The Midterm Examine is to be held at 10:10am on April 27 (Wednesday) (110 mins, closed-book; no calculator; Chaps 1 - 3 = (Lecs 1 to 7)) 期中考擬在4月27日上午10:10舉行 (不可看書，不可攜帶計算器，110分鐘，範圍: 課本Chaps 1- 3.) 

• Review (Chaps 1-3) \\

(3S) HW3 solutions \\

(8) Derived Distributions

• Review (Chaps 1-3) \\

(8) Derived Distributions \\

 *  The Midterm Examine is to be held at 10:10am on April 27 (Wednesday) (110 mins, closed-book;no calculator; Chaps 1 - 3 = (Lecs 1 to 7)) 期中考擬在4月27日上午10:10舉行 (不可看書，不可攜帶計算器，110分鐘，範圍: 課本Chaps 1- 3.) 

 *  The Midterm Examine is to be held at 10:10am on April 27 (Wednesday) (110 mins, closed-book; Chaps 1 - 3 = (Lecs 1 to 7)) 期中考擬在4月27日上午10:10舉行 (不可看書，110分鐘，範圍: 課本Chaps 1- 3.) 

(6) Continuous RVs \\ (7) Multiple Continuous RVs \\ (8) Derived Distributions \\

 (1)  Prob Basics (I) 
 (2)  Prob Basics (II) 
 (3)  Discrete Random Variables (I) 
 (4)  Discrete Random Variables (II) 
 (5)  Multimple Discrete RVs 
 (6)  Continuous RVs \\ 
 (7)  Multiple Continuous RVs \\  
 (8)  Derived Distributions \\ 

 (1)   HW1 
 (1S)   HW1 solutions 
 (2)  HW2 
 (2S)   HW2 solutions 
 (3)   HW3 
 (3S)    HW3 solutions \\

(1) Prob Basics (I)
(2) Prob Basics (II)
(3) Discrete Random Variables (I)
(4) Discrete Random Variables (II)
(5) Multimple Discrete RVs
(6) Continuous RVs \\ (7) Multiple Continuous RVs \\ (8) Derived Distributions \\

(1) HW1
(1S) HW1 solutions
(2) HW2
(2S) HW2 solutions
(3) HW3
(3S) HW3 solutions \\

• (1) Prob Basics (I)
• (2) Prob Basics (II)
• (3) Discrete Random Variables (I)
• (4) Discrete Random Variables (II)
• (5) Multimple Discrete RVs
• (6) Continuous RVs
• (7) Multiple Continuous RVs
• (8) Derived Distributions

(1) HW1 (1S) HW1 solutions (2) HW2 (2S) HW2 solutions (3) HW3 (3S) HW3 solutions

• Syllabus Δ
• Introduction
• (1) Prob Basics (I)
• (2) Prob Basics (II)
• (3) Discrete Random Variables (I)
• (4) Discrete Random Variables (II)
• (5) Multimple Discrete RVs
• (6) Continuous RVs
• (7) Multiple Continuous RVs
• (8) Derived Distributions

• (1) HW1
• (1S) HW1 solutions
• (2) HW2
• (2S) HW2 solutions
• (3) HW3
• (3S) HW3 solutions

• Syllabus

• Syllabus
• Introduction
• (1) Prob Basics (I)
• (2) Prob Basics (II)
• (3) Discrete Random Variables (I)
• (4) Discrete Random Variables (II) Mean, Var
• (5) Multimple Discrete RVs
• (6) Continuous RVs
• (7) Multiple Continuous RVs
• (8) Derived Distributions

• (7) Multiple Continuous RVs

 *  The Midterm Examine is to be held at 10:10am on April 20 (Wednesday) (110 mins, closed-book; Chaps 1 - 3 = (Lecs 1 to 7)) 期中考擬在4月20日上午10:10舉行 (不可看書，110分鐘，範圍: 課本Chaps 1- 3.) 

 *  The 3/09 (Wed) class is cancelled. 3月9日(週三)因老師出國課程取消。The make-up classes are 8:10-9:AM on 3/14 (Monday) and 3/21 (Monday) (Room ED 301). 補課時間為3月14日與3月21日上午8:10-9:AM (Room ED 301)。
 *  Quiz 1 is to be held at 11:10am on March 30 (Wednesday) (50 mins, closed-book; Chaps 1 & 2 = (Lecs 1 to 5)) 第一次小考在3月30日上午11:10 (不可看書，50分鐘，範圍:課本 Chap 1 & Chap 2.) 

• (6) Continuous RVs

 (2) HW2 (Due date: March 30) 

• (5) Multimple Discrete RVs

3. Continuous Random Variables \\

公告(Announcement):

 *  The 3/09 (Wed) class is cancelled. 3月9日(週三)因老師出國課程取消。The make-up classes are 8:10-9:AM on 3/14 (Monday) and 3/21 (Monday) (Room ED 301). 補課時間為3月14日與3月21日上午8:10-9:AM (Room ED 301)。

 *  The 3/09 (Wed) class is cancelled. 3月9日(週三)因老師出國課程取消。The make-up classes are 8:10-9:AM on 3/14 (Monday) and 3/21 (Monday) (Room ED 301). 補課時間為3月14日與3月21日上午8:10-9:AM (Room ED 301)。

 *  The 3/09 (Wed) class is cancelled. 3月9日(週三)因老師出國課程取消。The make-up classes are 8:10-9:AM on 3/14 (Monday) and 3/21 (Monday) (Room ED 301). 補課時間為3月14日與3月21日上午8:10-9:AM (Room ED 301)。

• Prob Basics (I)
• Prob Basics (II)
• Discrete Random Variables (I)
• Discrete Random Variables (II) Mean, Var
• Multimple Discrete RVs

• Continuous Random Variables (I)

• Introduction
  * Prob Basics (I)
  * Prob Basics (II)
  * Discrete Random Variables (I)
  * Discrete Random Variables (II) Mean, Var
  * Continuous Random Variables (I)
  

• Math Symbols in English
  * Mean & Variance \\

• Syllabus \\

• Discrete Random Variables (I)
  * Discrete Random Variables (II) Mean, Var
  3. Continuous Random Variables \\

References:

• Math Symbols in English

(1) HW1 (Due date: March 14) \\

(1) HW1? (Due date: March 14) \\

(1) Syllabus? (Due date: March 14) \\

• Prob Basics (II)
  2. Discrete Random Variables \\

林振揚 (ED529, x 54228) (talent31022@gmail.com) Recitation: Friday 6:30-8:30pm, ED220\\

林振揚 (ED529, x 54228) (talent31022@gmail.com) \\

• Introduction
  * Prob Basics (I)
  

Contents:

1. Probability Basics \\

1:30pm-3:30pm Monday\\

In this course, we will discuss two most fundamental problems in communication systems, namely, minimum data representation and reliable communication. The focus is the well-known Shannon’s three theorems: source coding, channel coding and rate distortion theorems.　

T.M. Cover and J.A. Thomas, Elements of Information Theory, 2nd ed., Wiley 2006.
\\

Homework: 15%
Computer-project: 20%
Midterm Examine: 30% (2 hours, open book)
Final Examine: 35% (2 hours, open book)

Reference Web:
MIT Open Course Ware

"道爾頓(John Dalton, 1766-1844, 化學原子論開創者) 認為講義是用來鼓勵(引導)學生的，不能取代學生自己的探索。" 張文亮: 回到起初, p.109, 時報出版 2003.
(John Dalton: Classnotes are meant for guiding students; they should not replace the students' own quest for knowledge.)

• Syllabus Δ
• Introduction Δ
• Chapter 1: Information and Entropy Δ
• Chapter 2: Source Coding Δ
• Chapter 3: Channel Coding (I) Δ
• Chapter 4: Channel Coding (II) Δ (updated: 2009.11.17)
• Chapter 5: Rate-distortion Theory Δ
• Chapter 6: Differential Entropy/Gaussian Channel Δ
• Chapter 7: RD Theory for Continuous Sources Δ

References:

• Shannon 1948 Δ
• Blahut 1972 Δ
• Berger Book RD Section Δ
• Pearlman Image Coding Δ

Homework Assignment:

Recommended Readings:

1. R. W. Yueng (楊偉豪, 香港中文大學), Information Theory and Network Coding, Springer, 2008.
2. R.G. Gallager, Principles of Digital Communications, Cambridge, 2008.
3. R.G. Gallager, Information Theory and Reliable Communications, Wiley, 1968.
4. R.E. Blahut, Principles and Practices of Information Theory, Addison Wesley,1987.

蔡家揚 (ED422, x 54231) (chyatsai@gmail.com)