Posts

  • The Game of Clue: An Information Theory Perspective

    The classic board game “Clue” has entertained countless individuals, inviting players to dive deep into a mystery using wit and deduction. But beneath its playful exterior lies a mathematical tapestry woven with probabilities and information. In this exploration, we embark on an information theory analysis of “Clue,” revealing the intrinsic entropy and the enlightening information gains as players receive their cards.

  • Neural Turing Machine

    Neural Turing Machine (NTM) is one of the first practices for utilizing an external memory to improve neural network performance; It aims to learn how to use a memory bank and act like a computer program to achieve a more generalized solution with fewer samples. This post discusses how NTM interacts and utilizes memory and tricks for a robust implementation.