StATS: More on information theory models (August 31, 2004).
I received a few suggestions for interesting web sites today. They deal with information theory and trying to establish causation.
Jan Kahre has written a book, The Mathematical Theory of Information [BookFinder4U link]. A web page promoting this book includes the first chapter, references and other resources. This book defines the Law of Diminishing Information, and applies the concept to medicine, biology, engineering, and physics.
Jan Hajek has several papers related to causation, information theory, and other interesting topics.
I had previously written about information theory on this weblog, and I have a simple definition and a more elaborate discussion elsewhere on this website.
This page was written by Steve Simon while working at Children's Mercy Hospital. Although I do not hold the copyright for this material, I am reproducing it here as a service, as it is no longer available on the Children's Mercy Hospital website. Need more information? I have a page with general help resources. You can also browse for pages similar to this one at Category: Information theory.