Hot French startup ZML releases free product to speed inference across lots of AI chips
ZML, a French AI startup backed by Turing Award winner Yann LeCun, has released ZML/LLMD, a free software tool designed to reduce the cost of running AI inference across multiple chips.
- ZML/LLMD is an open-source tool designed to optimize AI inference performance across multiple chip architectures.
- Backed by Yann LeCun, the tool claims to reduce inference costs by up to 30% in speed and 25% in power consumption.
- The software supports GPUs, TPUs, and custom silicon, making it adaptable for cloud, data center, and edge deployments.
- ZML plans to monetize through enterprise support while keeping the core tool free for community adoption.
ZML, a Paris-based AI startup founded by former Meta and Google researchers, has launched ZML/LLMD, an open-source software tool that optimizes AI inference performance across heterogeneous chip architectures. The tool is designed to reduce computational overhead and energy consumption, making AI deployments more cost-effective for developers and enterprises. Backed by Turing Award winner Yann LeCun, who serves as an advisor, ZML positions itself as a key player in the growing field of AI efficiency solutions.
The release comes at a time when inference costs remain a major bottleneck for AI adoption, particularly as models grow larger and hardware diversity expands. ZML/LLMD claims to deliver up to 30% faster inference times while cutting power usage by up to 25%, according to preliminary benchmarks shared by the company. The software supports a wide range of AI accelerators, including GPUs, TPUs, and custom silicon, making it a versatile solution for cloud providers, data centers, and edge devices.
Unlike proprietary solutions from major tech firms, ZML is offering ZML/LLMD under an open-source license, encouraging community adoption and contributions. The company plans to monetize through enterprise support and premium features, signaling a shift toward sustainable AI infrastructure development.
Source: Hot French startup ZML releases free product to speed inference across lots of AI chips. Read the full piece at the source.
Provides a free, open-source tool to optimize AI inference across diverse hardware, reducing costs and improving performance.
Offers a cost-effective solution for scaling AI deployments while maintaining flexibility across different chip architectures.
Highlights a growing niche in AI efficiency tools, with potential for monetization through enterprise services.
Could democratize access to efficient AI inference, lowering barriers for smaller players in the AI ecosystem.
- Inference
- The process of running a trained AI model to make predictions or generate outputs, as opposed to training the model.
- Heterogeneous chip architectures
- Computing systems that combine different types of processors (e.g., GPUs, TPUs, custom silicon) to optimize performance and efficiency.
AI ToolsNVIDIA’s Cosmos-Framework Tutorial: Designing a Colab-Friendly Miniature of Cosmos 3 World Models with Omnimodal Mixture-of-Transformers
AI ToolsMeta rolls out Muse, a new AI image generator
AI ToolsFrom Hugging Face to Amazon SageMaker Studio in one click
AI ToolsMeta’s new Muse Image model can pull other Instagram users into AI photos
Artificial Intelligence-Driven Call Center Operations in a High-Volume Neurology Practice: Impact on Access, Efficiency, Revenue Growth, and Cost Containment - Cureus
SecurityThis Former DeepMind Exec Thinks the AI Arms Race Could End in Disaster
A former DeepMind executive argues that US AI policy risks escalating into a dangerous arms race with global consequences.
Nvidia’s $1 Trillion Slide Sends Valuation to Pre-AI Boom Levels - Bloomberg.com
Nvidia's market capitalization has fallen by approximately $1 trillion, returning its valuation to levels seen before the recent surge driven by AI demand. This significant drop reflects broader market adjustments.
What’s the right role for AI in dementia care? - STAT
The role of AI in dementia care is being explored, with potential applications in diagnosis and patient support. Researchers are considering how AI can be used to improve care for dementia patients.
China warns about AI risks with Anthropic's Claude Code - CNBC
China's internet regulator has raised concerns about Anthropic's Claude Code, warning of potential risks in its use for AI development.
LLMOpenAI's GPT-5.6 launches Thursday after a delay forced by the U.S. government
OpenAI’s GPT-5.6 launches Thursday following a US government-imposed delay, now outperforming Anthropic’s Claude Mythos 5 in coding benchmarks at half the cost.
SambaNova hits $11 billion valuation as investors back Nvidia chip challengers - CNBC
AI chip developer SambaNova Systems has achieved an $11 billion valuation, signaling strong investor interest in companies challenging Nvidia's dominance in the AI hardware market.