Workload-Driven Optimization for On-Device Real-Time Subtitle Translation
arXiv:2607.09957v1 Announce Type: new Abstract: This report studies on-device English-to-Traditional-Chinese subtitle translation for Taiwan under short inputs, short outputs, batch-size-one inference, low latency, and privacy constraints. These conditions limit the value of optimizations designed for long-context or high-throughput language-model serving. Starting from LMT-60-0.6B, preliminary profiling suggests that vocabulary projection becomes a more important decode-time cost after GGUF quantization reduces the relative cost of Transformer blocks. We replace the original 151k-token voc
arXiv:2607.09957v1 Announce Type: new
Abstract: This report studies on-device English-to-Traditional-Chinese subtitle translation for Taiwan under short inputs, short outputs, batch-size-one inference, low latency, and privacy constraints. These conditions limit the value of optimizations designed for long-context or high-throughput language-model serving.
Starting from LMT-60-0.6B, preliminary profiling suggests that vocabulary projection becomes a more important decode-time cost after GGUF quantization reduces the relative cost of Transformer blocks. We replace the original 151k-token voc
Mistral AI Releases Robostral Navigate: An 8B Model Enabling Robots to Navigate Complex Environments Using a Single RGB Camera
Mistral AI introduced Robostral Navigate, an 8B embodied navigation model. It moves robots from a plain-language instruction using only a single RGB camera, with no LiDAR or depth sensors. The model reaches 76.6% success on R2R-CE validation unseen through a pointing method, prefix-caching training, and CISPO online reinforcement learning. The post Mistral AI Releases Robostral Navigate: An 8B Model Enabling Robots to Navigate Complex Environments Using a Single RGB Camera appeared first on MarkTechPost.
Google Delays Gemini 3.5 Pro Over Early Performance Flaws - Geeky Gadgets
Google has reportedly delayed the release of its Gemini 3.5 Pro model, citing early performance issues. This postponement impacts the anticipated update to its advanced AI capabilities.
To AI-Proof Lawyers, Some Law Schools Restrict Technology - Inside Higher Ed
Some law schools are implementing restrictions on technology use during exams and assignments to ensure students develop fundamental legal skills, anticipating the transformative impact of AI on the legal profession.
I tried Google Maps' new 3D Immersive View for Android Auto, and it fixed my biggest navigation problems
The update is the biggest visual change in a decade, and it makes navigating much easier.
CRS finds Trump's frontier AI order relies on voluntary industry participation, leaves definitions and funding unresolved - Industrial Cyber
CRS finds Trump's frontier AI order relies on voluntary industry participation, leaves definitions and funding unresolved Industrial Cyber
OpenAI CEO Sam Altman Throws Shade At Anthropic's New Ad Amid Tussle With Elon Musk, Apple: 'Thought This Was Satire' - Yahoo Finance
OpenAI CEO Sam Altman Throws Shade At Anthropic's New Ad Amid Tussle With Elon Musk, Apple: 'Thought This Was Satire' Yahoo Finance