The video explores the performance of AI models in the social deception game 'Blood on the Clocktower', comparing their abilities to scheme and reason as a team.
Key points
The video begins by explaining the rules of 'Blood on the Clocktower', a social deception game with teams of good and evil players. 0:46
AI models were tested in the game to evaluate their deception and strategic reasoning abilities. 2:01
GPT-6 Astro emerged as the best AI model in the game, significantly outperforming its predecessor, Claude Opus 4.6. 3:03
A notable game involved GPT-6 Astro successfully deceiving the good team by pretending to be a detective. 3:40
Another game highlighted the strategic sacrifice by an evil player to replace the demon and mislead the good team. 5:00
OpenAI's models have improved significantly in playing as the good team, showing better skepticism and holistic analysis. 7:38
The video discusses the potential for AI models to learn and improve over time by retaining game experiences. 16:05
The creator built a software-based game environment to eliminate human bias, using AI to manage game probabilities. 11:14
The video invites viewers to explore the game environment and test AI models against human players. 17:14
Quotes
Astro wins about 92% of the games it plays against Opus 4.6.
The models have become much better at long-term coherence and strategic thinking.
You are invited to use my code to investigate these questions yourself.