\n
![](\"https:\/\/images.ctfassets.net\/jdtwqhzvc2n1\/2KW1BliyFMc64n78OqnVlM\/ac451c69dcc831ebd51d04db82bb7336\/crimedy7_illustration_of_digital_pipes_--ar_169_--v_7_bd27b512-87b7-4c25-a63a-7c8829441315_0.png?w=300&q=30\")
<\/p>\n
\n<\/p>\n
By now, enterprises understand that retrieval augmented generation (RAG) allows applications and agents to find the best, most grounded information for queries. However, typical RAG setups could be an engineering challenge and also exhibit undesirable traits<\/u>.\u00a0<\/p>\n
To help solve this, Google<\/u> released the File Search Tool on the Gemini API, a fully managed RAG system \u201cthat abstracts away the retrieval pipeline.\u201d File Search removes much of the tool and application-gathering involved in setting up RAG pipelines, so engineers don\u2019t need to stitch together things like storage solutions and embedding creators.\u00a0\u00a0<\/p>\n
This tool competes directly with enterprise RAG products from OpenAI<\/u>, AWS<\/u> and Microsoft<\/u>, which also aim to simplify RAG architecture. Google, though, claims its offering requires less orchestration and is more standalone.\u00a0<\/p>\n
\u201cFile Search provides a simple, integrated and scalable way to ground Gemini with your data, delivering responses that are more accurate, relevant and verifiable,\u201d Google said in a blog post<\/u>.\u00a0<\/p>\n
Enterprises can access some features of File Search, such as storage and embedding generation, for free at query time. Users will begin paying for embeddings when these files are indexed at a fixed rate of $0.15 per 1 million tokens.\u00a0<\/p>\n
Google\u2019s Gemini Embedding model, which eventually became the top embedding model <\/u>on the Massive Text Embedding Benchmark, powers File Search.\u00a0<\/p>\nFile Search and integrated experiences\u00a0<\/h2>\n
Google said File Search works \u201cby handling the complexities of RAG for you.\u201d\u00a0<\/p>\n
File Search manages file storage, chunking strategies and embeddings. Developers can invoke File Search within the existing generateContent API, which Google said makes the tool easier to adopt.\u00a0<\/p>\n
File Search uses vector search to \u201cunderstand the meaning and context of a user\u2019s query.\u201d Ideally, it will find the relevant information to answer a query from documents, even if the prompt contains inexact words.\u00a0<\/p>\n
The feature has built-in citations that point to the specific parts of a document it used to generate answers, and also supports a variety of file formats. These include PDF, Docx, txt, JSON and \u201cmany common programming language file types," Google says. <\/p>\n
Enterprises may have already begun building out a RAG pipeline as they lay the groundwork for their AI agents to actually tap the correct data and make informed decisions.\u00a0<\/p>\n
Because RAG represents a key part of how enterprises maintain accuracy and tap into insights about their business, organizations must quickly have visibility into this pipeline. RAG can be an engineering pain because orchestrating multiple tools together can become complicated.\u00a0<\/p>\n
Building \u201ctraditional\u201d RAG pipelines means organizations must assemble and fine-tune a file ingestion and parsing program, including chunking, embedding generation and updates. They must then contract a vector database like Pinecone<\/u>, determine its retrieval logic, and fit it all within a model\u2019s context window. Additionally, they can, if desired, add source citations.\u00a0<\/p>\n
File Search aims to streamline all of that, although competitor platforms offer similar features. OpenAI\u2019s Assistants API<\/u> allows developers to utilize a file search feature, guiding an agent to relevant documents for responses. AWS\u2019s Bedrock unveiled a data automation managed service<\/u> in December.\u00a0<\/p>\n
While File Search stands similarly to these other platforms, Google\u2019s offering abstracts all, rather than just some, elements of the RAG pipeline creation.\u00a0<\/p>\n
Phaser Studio, the creator of AI-driven game generation platform Beam, said in Google\u2019s blog that it used File Search to sift through its library of 3,000 files.<\/p>\n
\u201cFile Search allows us to instantly surface the right material, whether that\u2019s a code snippet for bullet patterns, genre templates or architectural guidance from our Phaser \u2018brain\u2019 corpus,\u201d said Phaser CTO Richard Davey. \u201cThe result is ideas that once took days to prototype now become playable in minutes.\u201d<\/p>\n
Since the announcement, several users expressed interest in using the feature.<\/p>\n