Yuning Wang / notes ← back to home

Notes on Information Theory, Coding, and Learning Algorithms

01

Information Theory

Information theory, with fundamental concepts, Shannon's source coding, and channel coding theorem.

Read notes →
02

Coding Theory

Coding theory with mathematical preliminary and block codes, then a focus on LDPC codes.

Read notes →
03

Learning Algorithms

Machine learning in a probabilistic perspective, from basics to various modern learning algorithms.

Read notes →


These notes are my own summary on various topics including information theory, coding theory, and probabilistic machine learning. The goal is to make the concepts, algorithms, derivations more concise than the textbooks, and easy to look up. Personally, I use these notes for me to look up core concepts and equations during my study, research, and daily work, which I found quite useful. As I continue to read and learn more in these fields, I will continue to update these notes to make them more complete, rather than focusing on several topics only. Therefore, future updates are expected.

I started working on these notes during my undergraduate study and mostly summarized by myself. If you spot any errors/typos, or you have professional advice, I would really appreciate if you could reach out to me!

Github page of these notes can be found here, which contains the most up-to-date versions and the reference.