Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More<\/em><\/p>\n\n\n\n French AI startup Pleias made waves late last year with the launch of its ethically trained Pleias 1.0 family of small language models \u2014 among the first and only to date to be built entirely on scraping \u201copen\u201d data, that is, data explicitly labeled as public domain, open source, or unlicensed and not copyrighted. <\/p>\n\n\n\n Now the company has announced the release of two open source small-scale reasoning models designed specifically for retrieval-augmented generation (RAG), citation synthesis, and structured multilingual output. <\/p>\n\n\n\n The launch includes two core models \u2014 Pleias-RAG-350M and Pleias-RAG-1B \u2014 each also available in CPU-optimized GGUF format, making a total of four deployment-ready variants. <\/p>\n\n\n\n They are all based on Pleias 1.0, and can be used independently or in conjunction with other LLMs that the organization may already or plan to deploy. All appear to be available under a permissive Apache 2.0 open source license, meaning they are<\/em> eligible for organizations to take, modify and deploy for commercial use cases.<\/p>\n\n\n\n RAG, as you\u2019ll recall, is the widely-used technique that enterprises and organizations can deploy to hook an AI large language model (LLM) such as OpenAI\u2019s GPT-4o, Google\u2019s Gemini 2.5 Flash, Anthropic\u2019s Claude Sonnet 3.7 or Cohere\u2019s Command-A, or open source alternatives like Llama 4 and DeepSeek V3 to external knowledge bases, such as enterprise documents and cloud storages. <\/p>\n\n\n\n This is often necessary for enterprises that want to build chatbots and other AI applications that reference their internal policies or product catalogs (an alternative, prompting a long context LLM with all the information necessary, may not be suitable for enterprise use cases where security and per-token transmission costs are concerns). <\/p>\n\n\n\n The Pleias-RAG model family is the latest effort to bridge the gap between accuracy and efficiency in small language models.<\/p>\n\n\n\n These models are aimed at enterprises, developers, and researchers looking for cost-effective alternatives to large-scale language models without compromising traceability, multilingual capabilities, or structured reasoning workflows.<\/p>\n\n\n\n The target userbase is actually Pleias\u2019s home continent of Europe, as co-founder Alexander Doria told VentureBeat via direct message on the social network X:<\/p>\n\n\n\n \u201cA primary motivation has been the difficulty of scaling RAG applications in Europe. Most private organization have little GPUs (it may have changed but not long ago less than 2% of all [Nvidia] H100 [GPUs] were in Europe). And yet simultaneously there are strong incentive to self-host for regulated reasons, including GDPR.<\/em><\/p>\n\n\n\n \u201cSLMs have progressed significantly over the past year, yet they are too often conceived as \u2018mini-chatbots\u2019 and we have observed a significant drop of performance in non-English languages, both in terms of source understanding and quality of text generation. So we have been satisfied to hit most of our objectives: <\/em><\/p>\n\n\n\n However, of course the models being open source under the Apache 2.0 license means anyone could take and use them freely anywhere in the world.<\/p>\n\n\n\n A key feature of the new Pleias-RAG models is their native support for source citation with literal quotes, fully integrated into the model\u2019s inference process. <\/p>\n\n\n\n Unlike post-hoc citation methods or external chunking pipelines, the Pleias-RAG models generate citations directly, using a syntax inspired by Wikipedia\u2019s reference format. <\/p>\n\n\n\n This approach allows for shorter, more readable citation snippets while maintaining verifiability.<\/p>\n\n\n\n Citation grounding plays a functional role in regulated settings. <\/p>\n\n\n\n For sectors like healthcare, legal, and finance \u2014 where decision-making must be documented and traceable \u2014 these built-in references offer a direct path to auditability. Pleias positions this design choice as an ethical imperative, aligning with increasing regulatory demands for explainable AI.<\/p>\n\n\n\n Pleias-RAG models are described as \u201cproto-agentic\u201d \u2014 they can autonomously assess whether a query is understandable, determine if it is trivial or complex, and decide whether to answer, reformulate, or refuse based on source adequacy. <\/p>\n\n\n\n Their structured output includes language detection, query and source analysis reports, and a reasoned answer.<\/p>\n\n\n\n Despite their relatively small size (Pleias-RAG-350M has just 350 million parameters) the models exhibit behavior traditionally associated with larger, agentic systems. <\/p>\n\n\n\n According to Pleias, these capabilities stem from a specialized mid-training pipeline that blends synthetic data generation with iterative reasoning prompts.<\/p>\n\n\n\n Pleias-RAG-350M is explicitly designed for constrained environments. It performs well on standard CPUs, including mobile-class infrastructure. <\/p>\n\n\n\n According to internal benchmarks, the unquantized GGUF version produces complete reasoning outputs in roughly 20 seconds on 8GB RAM setups. Its small footprint places it in a niche with very few competitors, such as Qwen-0.5 and SmolLM, but with a much stronger emphasis on structured source synthesis.<\/p>\n\n\n\n In benchmark evaluations, Pleias-RAG-350M and Pleias-RAG-1B outperform most open-weight models under 4 billion parameters, including Llama-3.1-8B and Qwen-2.5-7B, on tasks such as HotPotQA, 2WikiMultiHopQA, and MuSiQue. <\/p>\n\n\n\n These multi-hop RAG benchmarks test the model\u2019s ability to reason across multiple documents and identify distractors \u2014 common requirements in enterprise-grade knowledge systems.<\/p>\n\n\n\n The models\u2019 strength extends to multilingual scenarios. On translated benchmark sets across French, German, Spanish, and Italian, the Pleias models show negligible degradation in performance. <\/p>\n\n\n\n This sets them apart from other SLMs, which typically experience a 10\u201335% performance loss when handling non-English queries.<\/p>\n\n\n\n The multilingual support stems from careful tokenizer design and synthetic adversarial training that includes language-switching exercises. The models not only detect the language of a user query but aim to respond in the same language\u2014an important feature for global deployments.<\/p>\n\n\n\n In addition, Doria highlighted how the models could be used to augment the performance of other existing models an enterprise may already be using:<\/p>\n\n\n\n \u201cWe envision the models to be used in orchestration setting, especially since their compute cost is low. A very interesting results on the evaluation side: even the 350m model turned out to be good on entirely different answers than the answers [Meta] Llama and [Alibaba] Qwen were performing at. So there\u2019s a real complementarity we attribute to our reasoning pipeline, that goes beyond cost-effectiveness<\/em>\u2026\u201d<\/p>\n\n\n\n According to Doria and a technical paper detailing the training of the Pleias-RAG family, the models were trained on: \u201cCommon Corpus to create the RAG training set (all the 3 million examples came from it). We used [Google] Gemma on top for generation of reasoning synthetic traces since the license allowed for reuse\/retraining.\u201d<\/em> <\/p>\n\n\n\n Both models are released under the Apache 2.0 license, allowing for commercial reuse and integration into larger systems. <\/p>\n\n\n\n Pleias emphasizes the models\u2019 suitability for integration into search-augmented assistants, educational tools, and user support systems. The company also provides an API library to simplify structured input-output formatting for developers.<\/p>\n\n\n\n The models\u2019 release is part of a broader push by Pleias to reposition small LLMs as tools for structured reasoning, rather than as general-purpose conversational bots. <\/p>\n\n\n\n By leveraging an external memory architecture and systematic citation methods, the Pleias-RAG series offers a transparent, auditable alternative to more opaque frontier models.<\/p>\n\n\n\n Looking ahead, Pleias plans to expand the models\u2019 capabilities through longer context handling, tighter search integration, and personality tuning for more consistent identity presentation. <\/p>\n\n\n\n Reinforcement learning is also being explored, particularly in domains like citation accuracy, where quote verification can be measured algorithmically.<\/p>\n\n\n\n The team is also actively collaborating with partners such as the Wikimedia Foundation to support targeted search integrations using trusted sources.<\/p>\n\n\n\n Ultimately, the current usage of RAG-specific implementations, models and workflows may fall away as more advanced AI models are trained and deployed, ones that incorporate RAG and agentic tool usage natively. As Doria told VentureBeat via DM:<\/p>\n\n\n\n \u201cLong term, my conviction is that both classic RAG pipeline and long context models are going to be disrupted by search agents. We have started to move in this direction: that\u2019s why the model already comes equipped with many features that are currently externalized in RAG applications (query reformulation, reranking, etc.). We obviously aim to go further and integrate search capacities and source processing capacities directly in the model itself. My conviction is that RAG will disappear in a way as it gets automated by agentic models able to direct their own workflows.<\/em>\u201c<\/p>\n\n\n\n With Pleias-RAG-350M and 1B, the company is betting that small models\u2014when paired with strong reasoning scaffolding and verifiable outputs\u2014can compete with much larger counterparts, especially in multilingual and infrastructure-limited deployments.<\/p>\n Daily insights on business use cases with VB Daily<\/strong><\/p>\n If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.<\/p>\n \n\t\t\t\t\tThanks for subscribing. Check out more VB newsletters here.\n\t\t\t\t<\/p>\n An error occured.<\/p>\n<\/p><\/div>\n
\n<\/div>\n
Focused on grounding, citations, and facts<\/h2>\n\n\n\n
Proto agentic?<\/h2>\n\n\n\n
Competitive performance across tasks and languages<\/h2>\n\n\n\n
Open access and licensing<\/h2>\n\n\n\n
Future outlook<\/h2>\n\n\n\n
![\"\"\/](\"https:\/\/venturebeat.com\/wp-content\/themes\/vb-news\/brand\/img\/vb-daily-phone.png\")
\n\t\t\t\t<\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n