From mwein@exch.hpl.hp.com Wed May 5 19:58:34 2004 X-UIDL: 8b533099e4037196b8cfd56bcaee69c8 Return-Path: Received: from mailslot.cs.purdue.edu (IDENT:0@mailslot.cs.purdue.edu [128.10.19.22]) by lukasz.cs.purdue.edu (8.12.9/8.12.9/PURDUE_CS-2.0) with ESMTP id i460wXGG012556 for ; Wed, 5 May 2004 19:58:34 -0500 (EST) Received: from palrel11.hp.com (palrel11.hp.com [156.153.255.246]) by mailslot.cs.purdue.edu (8.12.9/8.12.9/PURDUE_CS-2.0) with ESMTP id i460wQLk009314 for ; Wed, 5 May 2004 19:58:28 -0500 (EST) Received: from hplms2.hpl.hp.com (hplms2.hpl.hp.com [15.0.152.33]) by palrel11.hp.com (Postfix) with ESMTP id A514522117 for ; Wed, 5 May 2004 17:58:21 -0700 (PDT) Received: from hplex1.hpl.hp.com (hplex1.hpl.hp.com [15.0.152.182]) by hplms2.hpl.hp.com (8.12.10/8.12.10/HPL-PA Hub) with SMTP id i460wNYu002293; Wed, 5 May 2004 17:58:23 -0700 (PDT) Received: from 15.0.152.182 by hplex1.hpl.hp.com (InterScan E-Mail VirusWall NT); Wed, 05 May 2004 17:58:22 -0700 Received: by hplex1.hpl.hp.com with Internet Mail Service (5.5.2657.72) id ; Wed, 5 May 2004 17:58:22 -0700 Message-ID: <40700B4C02ABD5119F00009027876644043F3F5F@hplex1.hpl.hp.com> From: "Weinberger, Marcelo" To: "'spa@cs.purdue.edu'" Cc: seroussi@hpl.hp.com Subject: MSRI course Date: Wed, 5 May 2004 17:58:21 -0700 MIME-Version: 1.0 X-Mailer: Internet Mail Service (5.5.2657.72) Content-Type: multipart/mixed; boundary="----_=_NextPart_000_01C43305.19BA3706" X-Virus-Scanned: clamd / ClamAV version 0.70, clamav-milter version 0.70j X-Spam-Status: No, hits=0.0 required=6.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on mailslot.cs.purdue.edu Status: RO Content-Length: 17364 This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. ------_=_NextPart_000_01C43305.19BA3706 Content-Type: text/plain Wojtek, Attached please find the course syllabus in html format. As discussed on the phone, we assume that we have 9 hours of instruction available, which would be the minimum required to cover these subjects. Regards, -- Marcelo ------_=_NextPart_000_01C43305.19BA3706 Content-Type: application/octet-stream; name="msri course.htm" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="msri course.htm" 1)

Universal Source = Coding

 

This part of the course will introduce the student = to Source Coding, a sub-area of Information Theory, and particularly to universal = data compression, which greatly benefits from techniques of analysis of = algorithms.

 

1)     Source = coding fundamentals

a.       = Information sources

b.      = Modeling and coding

c.       = Source codes

d.      = Entropy and coding theorem

2)     Basic = coding techniques

a.       =A0Huffman codes

b.      = =A0Ideal code length and arithmetic = coding

3)     Universal coding

a.       = Universal modeling and coding, model classes

b.      = Redundancy in various settings

c.       = Lower bounds on redundancy

d.      = Some primitive universal codes

4)     The = Lempel-Ziv algorithm

a.       = Description of LZ'77 and LZ'78

b.      = Universality of LZ=9278

 

A link to an expanded = version of this course will be available here.

Other references:

 

l      = T. M. Cover and J. A. Thomas, = Elements of Information Theory. NY: John Wiley & Sons, Inc., = 1991.

l      = L. D. Davisson, =93Universal = noiseless coding,=94 IEEE Trans. Inform. Theory, vol. IT-19, pp. 783=96795, Nov. = 1973.

l      = J. Rissanen and G. G. Langdon, Jr., =93Universal modeling and coding,=94 IEEE Trans. Inform. Theory, = vol. IT-27, pp. 12=9623, Jan. 1981.

l      = A. Barron, J. Rissanen, B. Yu, = =93The minimum description length principle in coding and modeling,=94 IEEE Trans. Inform. = Theory, vol. IT-44, pp. 2743=962760, Oct. 1998.

l      = N. Merhav and M. Feder, = =93Universal prediction,=94 IEEE Trans. Inform. Theory, vol. IT-44, pp. = 2124=962147, Oct. 1998.

l      = J. Ziv and A. Lempel, =93A = universal algorithm for sequential data compression,=94 IEEE Trans. Inform. Theory, = vol. IT-23, pp. 337=96343, May 1977.

l      = J. Ziv and A. Lempel, = =93Compression of individual sequences via variable rate coding,=94 IEEE Trans. = Inform. Theory, vol. IT-24, pp. 530=96536, Sept. 1978.

 

------_=_NextPart_000_01C43305.19BA3706--