18 Information Theory References
Description
This article is from the Biological Information Theory and Chowder Society FAQ, by Thomas D. Schneider toms@ncifcrf.gov.
18 Information Theory References
* Basic References
o John Pierce was at Bell Labs while Shannon dreamed up information
theory. He saw the development from the inside, and wrote it up in
"An Introduction to Information Theory: Symbols, Signals and
Noise". Although it is not highly mathematical, this book is still
the best one to start with because it gives one a feeling for the
scope and implications of the theory, without dumping on the math,
yet without leaving out important topics that later generations of
popular writers skipped.
@book{Pierce1980,
author = "J. R. Pierce",
title = "An Introduction to Information Theory:
Symbols, Signals and Noise",
edition = "second",
publisher = "Dover Publications, Inc.",
address = "New York",
isbn = "0-486-24061-4",
comment = "
original copyright 1961
Ordering information: Pierce1980 is currently available by mail
from:
Dover Publications, Inc.
31 East 2nd street
Mineola, New York 11501
order:
Pierce, An Introduction to Information Theory: Symbols, Signals
and Noise
code number: 24061-4
$7.95 + charges. Payment in full, no telephone or credit card
orders.
Postage and Handling charges are:
Bookrate: $3 (US only)
UPS: $4.50 (US only, not Alaska or Hawaii or PO boxes)
Foreign orders: add 20% of total (minimum $2.50)
Sales Tax (Ny residents only)
Foreign Orders Note: Remittances must be sent by international
money order or in U.S. funds via Federal Wire System to Chemical
Bank, N. Y. ABA #021000128. Mark all remittances `For the account
of Dover Publications, Inc. #001 053 272'. This information is
from the Dover Math and Science Catalogue 9/92", price = "price as
of 1994 October 31: \$8.95", year = "1980"}
o Christopher Hillman (hillman@math.washington.edu) suggests that
Cover and Thomas' book is a better starting point, but that's
because he is a mathematician People who have seen both could post
their opinions.
@book{Cover.Thomas1991,
author = "Thomas M. Cover
and Joy A. Thomas",
title = "Elements of Information Theory",
publisher = "John Wiley \& Sons, Inc.",
address = "N. Y.",
isbn = "0-471-06259-6",
year = "1991"}
o A good introduction to the mathematics, written for high school
students:
@book{Sacco1988,
author = "W. Sacco
and W. Copes
and C. Sloyer
and R. Stark",
title = "Information Theory: Saving Bits",
publisher = "Janson Publications, Inc.",
comment = "original address was Providence, Rhode Island",
address = "Dedham, MA",
isbn = "0-939765-25-X",
phone = "(800) 322-6284",
price = "price as of 1994 October 31: \$11.95",
year = "1988"}
* Important originals:
o @article{Shannon1948,
author = "C. E. Shannon",
title = "A Mathematical Theory of Communication",
year = "1948",
journal = "Bell System Tech. J.",
volume = "27",
pages = "379-423, 623-656"}
o @book{ShannonWeaver1949,
author = "C. E. Shannon
and W. Weaver",
title = "The Mathematical Theory of Communication",
publisher = "University of Illinois Press",
address = "Urbana",
isbn = "0-252-72548-4",
price = "price as of 1994 October 31: \$9.95",
year = "1949"}
o @article{Shannon1949,
author = "C. E. Shannon",
title = "Communication in the Presence of Noise",
year = "1949",
journal = "Proc. IRE",
volume = "37",
pages = "10-21"}
o For the committed: The Complete Works!
@book{Sloane.Wyner1993,
author = "N. J. A. Sloane and A. D. Wyner",
title = "Claude Elwood Shannon: Collected Papers",
publisher = "IEEE Press",
address = "Piscataway, NJ",
isbn = "0-7803-0434-9",
comment = "IEEE Order Number: PC0331-9
ll To order directly by charge card (eg Visa works) you can call
(908)-981-0060
$69.95 + $5 handling charge
delivery in about 2 weeks",
price = "price as of 1994 October 31: \$69.95",
comment = "this was previously called Shannon1993",
year = "1993"}
* Other basic references
o How locks work and other cool stuff:
@book{Macaulay1988,
author = "D. Macaulay",
title = "The Way Things Work",
publisher = "Houghton Mifflin Company",
address = "Boston",
isbn = "0-395-42857-2",
price = "price as of 1994 October 31: \$29.95",
comment = "This book is also available on Windows-Compatible
CD-ROM
cdrom isbn = 1-56458-901-3 Price as of 1994 October 31: \$99.95",
year = "1988"}
o Leff1990 gives a review of the Maxwell's Demon problem.
See also Schneider.edmm, listed below.
@book{Leff1990,
author = "H. S. Leff and A. F. Rex",
title = "Maxwell's Demon: Entropy, Information, Computing",
publisher = "Princeton University Press",
address = "Princeton, N. J.",
phone = "1(800) 777-4726",
isbn.hard = "0-691-08726-1 (hard cover)",
price.hard = "price as of 1994 October 31: \$80.00",
isbn.paper = "0-691-08727-X (paperback)",
price.paper = "price as of 1994 October 31: \$26.95",
year = "1990"}
Continue to:
My Books
