Understanding Artificial Intelligence through Algorithmic Information Theory
Chapter 1. Describing data
- Complexity as code length
- Conditional Complexity
Chapter 2. Measuring Information
- Complexity and frequency
- Meaning distance
Chapter 3. Algorithmic information & mathematics
- Algorithmic probability, Randomness
- Gödel’s theorem
Chapter 4. Machine Learning and Algorithmic Information
- Universal induction - MDL
- Analogy & Machine Learning as complexity minimization
Chapter 5. Subjective information
- Simplicity & coincidences
- Subjective probability
- Relevance
