- Human pathology

Home > Resources in pathology > Epistemology > information theory

information theory

Sunday 13 November 2005


Definition: Information theory is a branch of applied mathematics, electrical engineering, and computer science involving the quantification of information. It can also be seen as a branch of cybernetics that attempts to define the amount of information required to control a process of given complexity.

Information theory was developed by Claude E. Shannon to find fundamental limits on signal processing operations such as compressing data and on reliably storing and communicating data.

Since its inception it has broadened to find applications in many other areas, including statistical inference, natural language processing, cryptography, neurobiology, the evolution and function[ of molecular codes, model selection in ecology, thermal physics,[ quantum computing, linguistics, plagiarism detection, pattern recognition, anomaly detection and other forms of data analysis.

See also

- information

  • information science
  • information in biology