Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More<\/em><\/p>\n\n\n\n Large language models (LLMs) have seen remarkable advancements in using reasoning capabilities. However, their ability to correctly reference and use external data \u2014 information that they weren\u2019t trained on \u2014 in conjunction with reasoning has largely lagged behind.\u00a0<\/p>\n\n\n\n This is an issue especially when using LLMs dynamic, information-intensive scenarios that demand up-to-date data from search engines. <\/p>\n\n\n\n But an improvement has arrived: SEARCH-R1, a technique introduced in a paper by researchers at the University of Illinois at Urbana-Champaign and the University of Massachusetts Amherst, trains LLMs to generate search queries and seamlessly integrate search engine retrieval into their reasoning.\u00a0<\/p>\n\n\n\n With enterprises seeking ways to integrate these new models into their applications, techniques such as SEARCH-R1 promise to unlock new reasoning capabilities that rely on external data sources.<\/p>\n\n\n\n Search engines are crucial for providing LLM applications with up-to-date, external knowledge. The two main methods for integrating search engines with LLMs are Retrieval-Augmented Generation (RAG) and tool use, implemented through prompt engineering or model fine-tuning.\u00a0<\/p>\n\n\n\n However, both methods have limitations that make them unsuitable for reasoning models. RAG often struggles with retrieval inaccuracies and lacks the ability to perform multi-turn, multi-query retrieval, which is essential for reasoning tasks.\u00a0<\/p>\n\n\n\n Prompting-based tool use often struggles with generalization, while training-based approaches require extensive, annotated datasets of search-and-reasoning interactions, which are difficult to produce at scale.<\/p>\n\n\n\n (In our own experiments with reasoning models, we found that information retrieval remains one of the key challenges.)\u00a0<\/p>\n\n\n\n SEARCH-R1 enables LLMs to interact with search engines during<\/em> their reasoning process as opposed to having a separate retrieval stage. <\/p>\n\n\n\n SEARCH-R1 defines the search engine as part of the LLM\u2019s environment, enabling the model to integrate its token generation with search engine results seamlessly.\u00a0<\/p>\n\n\n\n The researchers designed SEARCH-R1 to support iterative reasoning and search. The model is trained to generate separate sets of tokens for thinking, search, information, and answer segments. This means that during its reasoning process (marked by This structure allows the model to invoke the search engine multiple times as it reasons about the problem and obtains new information (see example below).<\/p>\n\n\n Training LLMs to interleave search queries with their reasoning chain is challenging. To simplify the process, the researchers designed SEARCH-R1 to train the model through pure reinforcement learning (RL), where the model is left to explore the use of reasoning and search tools without guidance from human-generated data.<\/p>\n\n\n\n SEARCH-R1 uses an \u201coutcome-based reward model,\u201d in which the model is only evaluated based on the correctness of the final response. This eliminates the need for creating complex reward models that verify the model\u2019s reasoning process. <\/p>\n\n\n\n This is the same approach used in DeepSeek-R1-Zero, where the model was given a task and only judged based on the outcome. The use of pure RL obviates the need to create large datasets of manually annotated examples (supervised fine-tuning).<\/p>\n\n\n\n \u201cSEARCH-R1 can be viewed as an extension of DeepSeek-R1, which primarily focuses on parametric reasoning by introducing search-augmented RL training for enhanced retrieval-driven decision-making,\u201d the researchers write in their paper.<\/p>\n\n\n\n The researchers tested SEARCH-R1 by fine-tuning the base and instruct versions of Qwen-2.5 and Llama-3.2 and evaluating them on seven benchmarks encompassing a diverse range of reasoning tasks requiring single-turn and multi-hop search. They compared SEARCH-R1 against different baselines:\u200c direct inference with Chain-of-Thought (CoT) reasoning, inference with RAG, and supervised fine-tuning for tool use.<\/p>\n\n\n\n SEARCH-R1 consistently outperforms baseline methods by a fair margin. It also outperforms reasoning models trained on RL but without search retrieval. \u201cThis aligns with expectations, as incorporating search into LLM reasoning provides access to relevant external knowledge, improving overall performance,\u201d the researchers write.<\/p>\n\n\n SEARCH-R1 is also effective for different model families and both base and instruction-tuned variants, suggesting that RL with outcome-based rewards can be useful beyond pure reasoning scenarios. The researchers have released the code for SEARCH-R1 on GitHub.<\/p>\n\n\n\n SEARCH-R1\u2019s ability to autonomously generate search queries and integrate real-time information into reasoning can have significant implications for enterprise applications. It can enhance the accuracy and reliability of LLM-driven systems in areas such as customer support, knowledge management, and data analysis. By enabling LLMs to dynamically adapt to changing information, SEARCH-R1 can help enterprises build more intelligent and responsive AI solutions. This capability can be very helpful for applications that require access to constantly changing data, and that require multiple steps to find an answer.\u00a0<\/p>\n\n\n\n It also suggests that we have yet to explore the full potential of the new reinforcement learning paradigm that has emerged since the release of DeepSeek-R1.<\/p>\n Daily insights on business use cases with VB Daily<\/strong><\/p>\n If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.<\/p>\n \n\t\t\t\t\tThanks for subscribing. Check out more VB newsletters here.\n\t\t\t\t<\/p>\n An error occured.<\/p>\n<\/p><\/div>\n
\n<\/div>The challenge of integrating search with LLMs<\/h2>\n\n\n\n
SEARCH-R1<\/h2>\n\n\n\n
![\"\"](\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/03\/image_131bd9.png?w=549\")
Reinforcement learning<\/h2>\n\n\n\n
SEARCH-R1 in action<\/h2>\n\n\n\n
![\"\"](\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/03\/image_1a6bfa.png?w=568\")
<\/figure><\/div>\n\n\n
![\"\"\/](\"https:\/\/venturebeat.com\/wp-content\/themes\/vb-news\/brand\/img\/vb-daily-phone.png\")
\n\t\t\t\t<\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n