×
DeepMind’s new AI agents framework mimics human-like reasoning
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

AI agents evolve with dual-system approach: DeepMind researchers have introduced a new framework called Talker-Reasoner, inspired by human cognition models, to enhance AI agents’ reasoning capabilities and user interactions.

  • The Talker-Reasoner framework aims to balance fast, intuitive responses with slower, more deliberate reasoning in AI systems.
  • This approach is based on the “two systems” model of human cognition, first introduced by Nobel laureate Daniel Kahneman.
  • The framework divides AI agents into two distinct modules: the Talker (System 1) and the Reasoner (System 2).

Understanding the dual-system cognitive model: The two-systems theory suggests that human thought is driven by two distinct but interacting systems, which AI researchers are now attempting to emulate in artificial agents.

  • System 1 is fast, intuitive, and automatic, governing snap judgments and pattern recognition.
  • System 2 is slow, deliberate, and analytical, enabling complex problem-solving and planning.
  • Current AI agents primarily operate in System 1 mode, excelling at pattern recognition but struggling with multi-step planning and strategic decision-making.

The Talker component: Fast and intuitive interactions: The Talker module in the new framework is designed to handle real-time interactions with users and the environment, mirroring the functions of System 1 thinking.

  • It perceives observations, interprets language, retrieves information from memory, and generates conversational responses.
  • The Talker typically utilizes the in-context learning abilities of large language models to perform its functions.
  • This component maintains a continuous flow of conversation, even as more complex computations occur in the background.

The Reasoner component: Deliberate analysis and planning: The Reasoner module embodies the slow, deliberative nature of System 2 thinking, focusing on complex reasoning and planning tasks.

  • It performs multi-step planning, reasoning, and belief formation based on environmental information provided by the Talker.
  • The Reasoner interacts with tools and external data sources to augment its knowledge and make informed decisions.
  • It updates the agent’s beliefs, which drive future decisions and serve as memory for the Talker’s conversations.

Shared memory system: Bridging the two components: The Talker and Reasoner modules interact primarily through a shared memory system, allowing for efficient communication and coordination.

  • The Reasoner updates the memory with its latest beliefs and reasoning results.
  • The Talker retrieves this information to guide its interactions with users and the environment.
  • This asynchronous communication enables the Talker to maintain a fluid conversation while the Reasoner performs time-consuming computations.

Practical application: AI-powered sleep coaching: DeepMind researchers tested the Talker-Reasoner framework in a sleep coaching application, demonstrating its potential for real-world use.

  • The AI coach interacts with users through natural language, providing personalized guidance for improving sleep habits.
  • The Talker handles empathetic responses and guides users through the coaching process.
  • The Reasoner maintains a belief state about the user’s sleep concerns, goals, and habits, generating personalized recommendations and multi-step plans.

Future research directions: The DeepMind team has outlined several areas for further exploration and improvement of the Talker-Reasoner framework.

  • Optimizing the interaction between the Talker and Reasoner to determine when the Reasoner’s intervention is necessary.
  • Extending the framework to incorporate multiple specialized Reasoners for different types of reasoning or knowledge domains.
  • Exploring applications in other fields, such as customer service and personalized education.

Implications for AI development: The Talker-Reasoner framework represents a significant step towards creating more versatile and human-like AI agents, with potential impacts across various industries and applications.

  • This approach could lead to AI systems that can better handle complex, multi-faceted tasks requiring both quick responses and deep analysis.
  • The framework’s modular nature allows for easier customization and improvement of specific cognitive functions in AI agents.
  • As research progresses, we may see AI systems that can more seamlessly navigate between intuitive and analytical modes of operation, mirroring human cognitive flexibility.
DeepMind’s Talker-Reasoner framework brings System 2 thinking to AI agents

Recent News

Baidu reports steepest revenue drop in 2 years amid slowdown

China's tech giant Baidu saw revenue drop 3% despite major AI investments, signaling broader challenges for the nation's technology sector amid economic headwinds.

How to manage risk in the age of AI

A conversation with Palo Alto Networks CEO about his approach to innovation as new technologies and risks emerge.

How to balance bold, responsible and successful AI deployment

Major companies are establishing AI governance structures and training programs while racing to deploy generative AI for competitive advantage.