MUSI 3702 Lecture Notes - Lecture 15: Information Theory, Low-Pass Filter, Ralph Hartley
Document Summary
Information theory has different formulations in different disciplines. Mathematical approaches, how they interact with engineering information theory as framework e. g. , math, engineering, and psychology for thinking about certain aspects of digital audio. Historical question: the origins and nature of information theory as it developed in engineering and mathematics. Began to be formulated in early 20th century: telecommunications, radio, electronics, etc. , all needed a theory of how info could be mechanically coded, measured, and controlled. Gathered steam in 1940s, partly because of the war effort and related technologies like radar and cryptography. Focused on elements related to a particular sort of communication model. Message coded message transmission decoding message". The message" is not the same as the message, at best it is an exact duplicate. For coded message select code suitable for message and transition channel, adequate in notation (deliberate reduction of information), code most be explicit and coherent enough.