The coding theorem from algorithmic information theory (AIT) - which should be much more widely taught in Physics! - suggests that many processes in nature may be highly biased towards simple outputs.
Why the world is simple - Prof Ard Louis
Loading Video...
Here simple means highly compressible, or more formally, outputs with relatively lower Kolmogorov complexity. I will explore applications to biological evolution, where the coding theorem implies an exponential bias towards outcomes with higher symmetry, and to deep learning neural networks, where the coding theorem predicts an Occam's razor like bias that may explain why these highly overparamterised systems work so well.
People:
Oxford Unit:
Keywords:
More in this Series...
Learn about quantum mechanics, black holes, dark matter, plasma, particle accelerators, the Large Hadron Collider and other key Theoretical Physics topics. The Rudolf Peierls Centre for Theoretical Physics holds morning sessions consisting of three talks, pitched to explain an area of our research to an audience familiar with physics at about second-year undergraduate level.