Information Theory

Description from DukeHub

Information theory is the science of processing, transmitting, storing, and using information. This course provides an introduction to mathematical measures of information and their connection to practical problems in communication, compression, and inference. Entropy, mutual information, lossless data compression, channel capacity, Gaussian channels, rate distortion theory, Fisher information. Useful for researchers in a variety of fields, including signal processing, machine learning, statistics, and neuroscience. Appropriate for beginning graduate students in electrical engineering, computer science, statistics, and math with a background in probability.

Skills

• programmingdepartment: ECE
• data and statisticsdescription: "statistics" and 2 more

AI-resilient: 0 of 5 0/5

• No: Physical, lab or field work
• No: Live work with people
• No: Judgment someone is accountable for
• No: A craft you practice with your hands or body
• No: Small, in-person format

The checks lean on Microsoft Research, Working with AI (2025), which found generative AI applies least to physical work and hands-on work with people. A signal, not a promise. How the score works

More in ECE

• Fundamentals of Electrical and Computer Engineering ECE 110L
• Fundamentals of Electrical and Computer Engineering - Lab ECE 110L9
• Introduction to Microelectronic Devices and Circuits ECE 230L
• Introduction to Microelectronic Devices and Circuits-Lab ECE 230L9
• Fields and Waves: Fundamentals of Information Propagation ECE 270DL
• Fields and Waves: Fundamentals of Information Propagation (Lab) ECE 270L9

All ECE courses · All of Graduate School