WATCH
18 min
2 min

Which AI is the best liar?

Insightful analysis of AI deception in social games.

FOR WHOAI enthusiasts, gamers
DenseAnalysisExpert

Channel: Dwarkesh Patel

Context

The video explores the performance of AI models in the social deception game 'Blood on the Clocktower', comparing their abilities to scheme and reason as a team.

Key points

  • The video begins by explaining the rules of 'Blood on the Clocktower', a social deception game with teams of good and evil players. 0:46
  • AI models were tested in the game to evaluate their deception and strategic reasoning abilities. 2:01
  • GPT-6 Astro emerged as the best AI model in the game, significantly outperforming its predecessor, Claude Opus 4.6. 3:03
  • A notable game involved GPT-6 Astro successfully deceiving the good team by pretending to be a detective. 3:40
  • Another game highlighted the strategic sacrifice by an evil player to replace the demon and mislead the good team. 5:00
  • OpenAI's models have improved significantly in playing as the good team, showing better skepticism and holistic analysis. 7:38
  • The video discusses the potential for AI models to learn and improve over time by retaining game experiences. 16:05
  • The creator built a software-based game environment to eliminate human bias, using AI to manage game probabilities. 11:14
  • The video invites viewers to explore the game environment and test AI models against human players. 17:14

Quotes

Astro wins about 92% of the games it plays against Opus 4.6.
The models have become much better at long-term coherence and strategic thinking.
You are invited to use my code to investigate these questions yourself.
Watch the video on YouTubeAnalyze your YouTube videos

Create an account for unlimited verdicts