information theory


information theory

noun

Definition of INFORMATION THEORY

:  a theory that deals statistically with information, with the measurement of its content in terms of its distinguishing essential characteristics or by the number of alternatives from which it makes a choice possible, and with the efficiency of processes of communication between humans and machines

First Known Use of INFORMATION THEORY

1950

information theory

noun    (Concise Encyclopedia)

Field of mathematics that studies the problems of signal transmission, reception, and processing. It stems from Claude E. Shannon's mathematical methods for measuring the degree of order (nonrandomness) in a signal, which drew largely on probability theory and stochastic processes and led to techniques for determining a source's rate of information production, a channel's capacity to handle information, and the average amount of information in a given type of message. Crucial to the design of communications systems, these techniques have important applications in linguistics, psychology, and even literary theory.

Browse

Next Word in the Dictionary: informative
Previous Word in the Dictionary: information technology
All Words Near: information theory

Seen & Heard

What made you want to look up information theory? Please tell us where you read or heard it (including the quote, if possible).

Get Our Free Apps
Voice Search, Favorites,
Word of the Day, and More
Join Us on FB & Twitter
Get the Word of the Day and More