information theory


: a theory that deals statistically with information, with the measurement of its content in terms of its distinguishing essential characteristics or by the number of alternatives from which it makes a choice possible, and with the efficiency of processes of communication between humans and machines

Examples of information theory in a Sentence

Recent Examples on the Web Today’s Bell Labs, however, is very different than the Bell Labs where information theory was invented. IEEE Spectrum, 4 May 2016 Doyle teamed up with a group of scientists researching whale communications and brought information theory to the mix in order to get a better idea of the complexity of whale songs, searching for rules and patterns. Avery Hurt, Discover Magazine, 8 Nov. 2023 This approach is computationally quite difficult, but the team incorporated recent information theory advances to find a near-optimal choice quickly. Dina Genkina, Scientific American, 1 Sep. 2023 Initially a way to think about heat and the dissipation of energy that makes perpetual motion machines impossible, entropy has evolved to take a central place in information theory. WIRED, 27 Sep. 2023 Seventy years ago, a Massachusetts Institute of Technology professor named Robert Fano offered the students in his information theory class a choice: Take a traditional final exam, or improve a leading algorithm for data compression. Quanta Magazine, 31 May 2023 Mathematician Claude Shannon, founder of information theory, recognized this and defined a measure of information content with this relationship in mind. Manon Bischoff, Scientific American, 28 Apr. 2023 Through Berkeley, the Sutherland brothers were introduced to Claude Shannon, renowned for his development of information theory. IEEE Spectrum, 14 Apr. 2023 At the Technion and at Bell, Ziv conducted research in data compression, information theory, and statistical communications. IEEE Spectrum, 10 Apr. 2023

These examples are programmatically compiled from various online sources to illustrate current usage of the word 'information theory.' Any opinions expressed in the examples do not represent those of Merriam-Webster or its editors. Send us feedback about these examples.

Word History

First Known Use

1945, in the meaning defined above

Time Traveler
The first known use of information theory was in 1945

Dictionary Entries Near information theory

Cite this Entry

“Information theory.” Dictionary, Merriam-Webster, Accessed 29 May. 2024.

More from Merriam-Webster on information theory

Love words? Need even more definitions?

Subscribe to America's largest dictionary and get thousands more definitions and advanced search—ad free!