¨EE 670 Information Theory and Coding ¨  

SPRING 2005

ª COURSE WEB PAGE:

http://koala.ece.stevens-tech.edu/~utureli/EE670/home.html for further information.


Lecture #1 on Jan. 20, 2004: Chapter 2 in Cover & Thomas pdf


Lecture #2 on Jan. 27, 2004: Chapter 2 in Cover & Thomas pdf



HW #1 : Problems 2.5,11,19,23 and Chapter 3.3 in Cover & Thomas pdf

 

HW 2 : Problems 3.5, 4.2, 4.7 and 4.10 in Cover & Thomas pdf


Please note 3.5 is due in Homework #2 !



HW 3 : Problems 5.4, 5.8, 5.14 and 5.25 in Cover & Thomas pdf



HW 4 : Problems 8.6, 8.12, 9.1 and 9.3 in Cover & Thomas pdf



HW 5 : Problems 10.2 and 10.4 iin Cover & Thomas

 

 

COORDINATOR: Dr. Uf Tureli, utureli@stevens-tech.edu  

Tel: 201-216 5603

 

SCHEDULE: Thurday  06:15 PM-08:45 PM   T.B.A.

 

OFFICE HOURS: Wednesdays 3-4pm, Thursdays 5-6pm, Burchard  202.

TEXT:  "Elements of Information Theory" by Cover and Thomas, New York: Wiley, 1991.

PREREQUISITE:  EE 605, Probability and Stochastic Processes I.

TOPICS:  Introduction to information theory and methods used in the analysis and design of telecommunication and computer communication systems. Source and channel coding concepts including, entropy, channel capacity,  rate distortion theory, and introduction to coding.

ASSESSMENT / GRADING:

 

Project

(computer programming, brief in-class presentation and formal report)

20%

 

Homework

(analytical problems 30 % and computer programming 10% )

40%

 

Exams

 

 

 

 

Midterm 

20%

 

 

Final (optional) 

20%

 


 

 

Week 1

Sections covered

Homework

Week 5

Sections covered

Homework

Jan 20

Ch 2

 

Jan 29

Chapter 5

 

 

Entropy, Relative Entropy and Mutual Information

 

 

Data Compression

 

 

Week 2

            

        

 

 

Week 6

 

 

Jan 29 

No class Monday

 

 Feb 26

Chapter 6

 

 

Class schedule!

 

 

Gambling and Data Compression

 

Week 3

 

 

Week 7

  

 

Feb 5

Chapter 3

 

Mar 4

MIDTERM

 

 

The Asymptotic Equipartition Property

 

 

Ch1-5

 

 

 

 

 

Closed book

 

 

 

 

 

1 page formula 

 

 

 

 

 

sheet

 

Week 4

 

 

Week 8

 

 

Feb 12

Chapter 4

 

Mar 11

 

 

 

Entropy Rate of a Stochastic Process