Mistral unveils Leanstral 1.5, an open-source Lean 4 coding assistant solving 87% of PutnamBench problems
Reported by MarkTechPost: Mistral AI Releases Leanstral 1.5: An Apache-2.0 Lean 4 Code Agent Model Solving 587 of 672 PutnamBench Problems. Analysis and context written by TickrWire.
Mistral AI launched Leanstral 1.5, an Apache-2.0 licensed code agent for Lean 4 that solves 587 of 672 PutnamBench problems. The model uses a 119B MoE architecture with 6.5B active parameters.
- Leanstral 1.5 solves 587 of 672 PutnamBench problems, achieving an 87% success rate in formal theorem proving.
- The model uses a 119B parameter MoE architecture with only 6.5B active parameters per token for efficiency.
- It saturates performance on the miniF2F benchmark, indicating state-of-the-art capabilities in automated reasoning.
- Includes real bug-finding case studies and deployment code under the Apache-2.0 license.
Mistral AI has released Leanstral 1.5, a free and open-source code agent model designed specifically for Lean 4, a formal proof assistant used in mathematical theorem proving. The model achieves state-of-the-art performance by solving 587 out of 672 problems in the PutnamBench benchmark, representing an 87% success rate. This positions Leanstral 1.5 as a significant advancement in automated theorem proving and formal verification tools.
The architecture leverages a 119 billion parameter mixture-of-experts (MoE) design, where only 6.5 billion parameters are activated per token. This sparse activation approach enables high performance while maintaining computational efficiency. The model has been validated on the miniF2F benchmark, where it saturates performance, indicating it has reached or surpassed human-level capabilities in certain formal reasoning tasks.
Beyond benchmark performance, Mistral AI has included real-world case studies demonstrating the model's ability to identify and fix bugs in Lean 4 codebases. The release also comes with deployment code and documentation, making it accessible for researchers and developers to integrate into their workflows. The Apache-2.0 license ensures the model can be freely used, modified, and distributed.
Provides a powerful, open-source tool for formal verification and theorem proving in Lean 4.
Enables automation of formal reasoning tasks, reducing manual verification costs in critical systems.
Offers an accessible way to learn and experiment with formal mathematics and automated theorem proving.
Demonstrates rapid progress in AI-driven formal reasoning and its potential applications in mathematics and computer science.
- PutnamBench
- A benchmark dataset of challenging mathematical problems used to evaluate formal theorem proving models.
- miniF2F
- A standardized benchmark for evaluating formal reasoning models across multiple theorem-proving languages.
- Mixture-of-Experts (MoE)
- A neural network architecture where only a subset of parameters (experts) are activated for each input, improving efficiency.
Don’t mistake chatbot intelligence for consciousness - The Economist
Biological AI models: new paradigms to leverage the languages of life - joint-research-centre.ec.europa.eu
China’s Military Says AI Can’t Replace Commanders. Xi Is Testing That - War on the Rocks
SPADE: Self-Play in Adaptive Synthetic Executable Environments
Beyond Teacher Likelihood: Group-Calibrated On-Policy Distillation for Long-Context Reasoning
AI ToolsMeta AI’s new Mac app wants you to talk to your apps
Meta released a new Mac application that lets users control apps and dictate text using voice commands powered by its Muse Spark AI model.
New White House strategy clarifies military tech priorities: undersea, outer space and AI - Breaking Defense
The White House released a new strategy prioritizing military investments in artificial intelligence, space systems and undersea technologies to counter emerging threats.
AI in an iron grip: How dictatorships use artificial intelligence to strengthen their rule - theins.press
A new report examines how authoritarian governments deploy AI for surveillance, censorship, and propaganda to reinforce their power.
Stripe, OpenRouter finally strike a deal - Banking Dive
Stripe and OpenRouter have partnered to integrate Stripe's payment processing with OpenRouter's AI model aggregation platform.
How one Philadelphia school is using AI to strengthen student learning, not replace teachers - CBS News
A Philadelphia school is integrating AI tools to support teachers and improve student outcomes, focusing on collaboration rather than replacement.
Exclusive-How a Texas student blew the whistle on a rogue AI hacking attempt - The Mighty 790 KFGO
A Texas student uncovered an AI-powered hacking attempt targeting local systems, prompting a swift law enforcement response.