When Liquid AI, a startup founded by MIT computer scientists back in 2023, launched its Liquid Foundation Models series 2 (LFM2) in July 2025, the pitch was easy: ship the quickest on-device basis fashions on the market utilizing the new “liquid” structure, with coaching and inference effectivity that made small fashions a critical various to cloud-only giant language fashions (LLMs) akin to OpenAI’s GPT sequence and Google’s Gemini.
The preliminary launch shipped dense checkpoints at 350M, 700M, and 1.2B parameters, a hybrid structure closely weighted towards gated quick convolutions, and benchmark numbers that positioned LFM2 forward of equally sized rivals like Qwen3, Llama 3.2, and Gemma 3 on each high quality and CPU throughput. The message to enterprises was clear: real-time, privacy-preserving AI on telephones, laptops, and automobiles not required sacrificing functionality for latency.
In the months since that launch, Liquid has expanded LFM2 right into a broader product line — including task-and-domain-specialized variants, a small video ingestion and analysis model, and an edge-focused deployment stack called LEAP — and positioned the fashions as the management layer for on-device and on-prem agentic methods.
Now, with the publication of the detailed, 51-page LFM2 technical report on arXiv, the firm is going a step additional: making public the structure search course of, coaching information combination, distillation goal, curriculum technique, and post-training pipeline behind these fashions.
And in contrast to earlier open fashions, LFM2 is constructed round a repeatable recipe: a hardware-in-the-loop search course of, a coaching curriculum that compensates for smaller parameter budgets, and a post-training pipeline tuned for instruction following and gear use.
Relatively than simply providing weights and an API, Liquid is successfully publishing an in depth blueprint that different organizations can use as a reference for coaching their very own small, environment friendly fashions from scratch, tuned to their very own {hardware} and deployment constraints.
A mannequin household designed round actual constraints, not GPU labs
The technical report begins with a premise enterprises are intimately accustomed to: actual AI methods hit limits lengthy before benchmarks do. Latency budgets, peak reminiscence ceilings, and thermal throttling outline what can truly run in manufacturing—particularly on laptops, tablets, commodity servers, and cell units.
To deal with this, Liquid AI carried out structure search immediately on goal {hardware}, together with Snapdragon cell SoCs and Ryzen laptop computer CPUs. The consequence is a constant end result throughout sizes: a minimal hybrid structure dominated by gated quick convolution blocks and a small variety of grouped-query consideration (GQA) layers. This design was repeatedly chosen over extra unique linear-attention and SSM hybrids as a result of it delivered a greater quality-latency-memory Pareto profile beneath actual machine circumstances.
This issues for enterprise groups in 3 ways:
-
Predictability. The structure is easy, parameter-efficient, and secure throughout mannequin sizes from 350M to 2.6B.
-
Operational portability. Dense and MoE variants share the similar structural spine, simplifying deployment throughout combined {hardware} fleets.
-
On-device feasibility. Prefill and decode throughput on CPUs surpass comparable open fashions by roughly 2× in lots of instances, lowering the want to offload routine duties to cloud inference endpoints.
As an alternative of optimizing for educational novelty, the report reads as a scientific try to design fashions enterprises can truly ship.
This is notable and extra sensible for enterprises in a discipline the place many open fashions quietly assume entry to multi-H100 clusters throughout inference.
A coaching pipeline tuned for enterprise-relevant habits
LFM2 adopts a coaching method that compensates for the smaller scale of its fashions with construction somewhat than brute pressure. Key parts embrace:
-
10–12T token pre-training and an extra 32K-context mid-training section, which extends the mannequin’s helpful context window with out exploding compute prices.
-
A decoupled Prime-Okay data distillation goal that sidesteps the instability of ordinary KL distillation when academics present solely partial logits.
-
A three-stage post-training sequence—SFT, length-normalized choice alignment, and mannequin merging—designed to produce extra dependable instruction following and tool-use habits.
For enterprise AI builders, the significance is that LFM2 fashions behave much less like “tiny LLMs” and extra like sensible brokers ready to comply with structured codecs, adhere to JSON schemas, and handle multi-turn chat flows. Many open fashions at comparable sizes fail not due to lack of reasoning skill, however due to brittle adherence to instruction templates. The LFM2 post-training recipe immediately targets these tough edges.
In different phrases: Liquid AI optimized small fashions for operational reliability, not simply scoreboards.
Multimodality designed for machine constraints, not lab demos
The LFM2-VL and LFM2-Audio variants replicate one other shift: multimodality constructed round token effectivity.
Relatively than embedding an enormous imaginative and prescient transformer immediately into an LLM, LFM2-VL attaches a SigLIP2 encoder by a connector that aggressively reduces visible token depend by way of PixelUnshuffle. Excessive-resolution inputs mechanically set off dynamic tiling, maintaining token budgets controllable even on cell {hardware}. LFM2-Audio makes use of a bifurcated audio path—one for embeddings, one for era—supporting real-time transcription or speech-to-speech on modest CPUs.
For enterprise platform architects, this design factors towards a sensible future the place:
-
doc understanding occurs immediately on endpoints akin to discipline units;
-
audio transcription and speech brokers run regionally for privateness compliance;
-
multimodal brokers function inside fastened latency envelopes with out streaming information off-device.
The through-line is the similar: multimodal functionality with out requiring a GPU farm.
Retrieval fashions constructed for agent methods, not legacy search
LFM2-ColBERT extends late-interaction retrieval right into a footprint sufficiently small for enterprise deployments that want multilingual RAG with out the overhead of specialised vector DB accelerators.
This is notably significant as organizations start to orchestrate fleets of brokers. Quick native retrieval—working on the similar {hardware} as the reasoning mannequin—reduces latency and offers a governance win: paperwork by no means go away the machine boundary.
Taken collectively, the VL, Audio, and ColBERT variants present LFM2 as a modular system, not a single mannequin drop.
The rising blueprint for hybrid enterprise AI architectures
Throughout all variants, the LFM2 report implicitly sketches what tomorrow’s enterprise AI stack will appear to be: hybrid local-cloud orchestration, the place small, quick fashions working on units deal with time-critical notion, formatting, software invocation, and judgment duties, whereas bigger fashions in the cloud supply heavyweight reasoning when wanted.
A number of traits converge right here:
-
Value management. Operating routine inference regionally avoids unpredictable cloud billing.
-
Latency determinism. TTFT and decode stability matter in agent workflows; on-device eliminates community jitter.
-
Governance and compliance. Native execution simplifies PII dealing with, information residency, and auditability.
-
Resilience. Agentic methods degrade gracefully if the cloud path turns into unavailable.
Enterprises adopting these architectures will possible deal with small on-device fashions as the “management aircraft” of agentic workflows, with giant cloud fashions serving as on-demand accelerators.
LFM2 is one in every of the clearest open-source foundations for that management layer to date.
The strategic takeaway: on-device AI is now a design alternative, not a compromise
For years, organizations constructing AI options have accepted that “actual AI” requires cloud inference. LFM2 challenges that assumption. The fashions carry out competitively throughout reasoning, instruction following, multilingual duties, and RAG—whereas concurrently reaching substantial latency features over different open small-model households.
For CIOs and CTOs finalizing 2026 roadmaps, the implication is direct: small, open, on-device fashions are now sturdy sufficient to carry significant slices of manufacturing workloads.
LFM2 will not change frontier cloud fashions for frontier-scale reasoning. Nevertheless it presents one thing enterprises arguably want extra: a reproducible, open, and operationally possible basis for agentic methods that should run anyplace, from telephones to industrial endpoints to air-gapped safe services.
In the broadening panorama of enterprise AI, LFM2 is much less a analysis milestone and extra an indication of architectural convergence. The longer term is not cloud or edge—it’s each, working in live performance. And releases like LFM2 present the constructing blocks for organizations ready to construct that hybrid future deliberately somewhat than by chance.
Disclaimer: This article is sourced from external platforms. OverBeta has not independently verified the information. Readers are advised to verify details before relying on them.
