{"id":2281,"date":"2025-07-05T03:57:06","date_gmt":"2025-07-05T03:57:06","guid":{"rendered":"https:\/\/violethoward.com\/new\/kumos-relational-foundation-model-predicts-the-future-your-llm-cant-see\/"},"modified":"2025-07-05T03:57:06","modified_gmt":"2025-07-05T03:57:06","slug":"kumos-relational-foundation-model-predicts-the-future-your-llm-cant-see","status":"publish","type":"post","link":"https:\/\/violethoward.com\/new\/kumos-relational-foundation-model-predicts-the-future-your-llm-cant-see\/","title":{"rendered":"Kumo&#8217;s &#8216;relational foundation model&#8217; predicts the future your LLM can&#8217;t see"},"content":{"rendered":" \r\n<br><div>\n\t\t\t\t<div id=\"boilerplate_2682874\" class=\"post-boilerplate boilerplate-before\">\n<p><em>Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders.<\/em> <em>Subscribe Now<\/em><\/p>\n\n\n\n<hr class=\"wp-block-separator has-css-opacity is-style-wide\"\/>\n<\/div><p><em>Editor\u2019s note: Kumo AI was one of the finalists at VB Transform during our annual innovation showcase and presented RFM from the mainstage at VB Transform on Wednesday.<\/em><\/p>\n\n\n\n<p>The generative AI boom has given us powerful language models that can write, summarize and reason over vast amounts of text and other types of data. But when it comes to high-value predictive tasks like predicting customer churn or detecting fraud from structured, relational data, enterprises remain stuck in the world of traditional machine learning.\u00a0<\/p>\n\n\n\n<p>Stanford professor and Kumo AI co-founder Jure Leskovec argues that this is the critical missing piece. His company\u2019s tool, a relational foundation model (RFM), is a new kind of pre-trained AI that brings the \u201czero-shot\u201d capabilities of large language models (LLMs) to structured databases.<\/p>\n\n\n\n<p>\u201cIt\u2019s about making a forecast about something you don\u2019t know, something that has not happened yet,\u201d Leskovec told VentureBeat. \u201cAnd that\u2019s a fundamentally new capability that is, I would argue, missing from the current purview of what we think of as gen AI.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-why-predictive-ml-is-a-30-year-old-technology\">Why predictive ML is a \u201c30-year-old technology\u201d<\/h2>\n\n\n\n<p>While LLMs and retrieval-augmented generation (RAG) systems can answer questions about existing knowledge, they are fundamentally retrospective. They retrieve and reason over information that is already there. For predictive business tasks, companies still rely on classic machine learning.\u00a0<\/p>\n\n\n\n<p>For example, to build a model that predicts customer churn, a business must hire a team of data scientists who spend a considerably long time doing \u201cfeature engineering,\u201d the process of manually creating predictive signals from the data. This involves complex data wrangling to join information from different tables, such as a customer\u2019s purchase history and website clicks, to create a single, massive training table.<\/p>\n\n\n\n<p>\u201cIf you want to do machine learning (ML), sorry, you are stuck in the past,\u201d Leskovec said. Expensive and time-consuming bottlenecks prevent most organizations from being truly agile with their data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-kumo-is-generalizing-transformers-for-databases\">How Kumo is generalizing transformers for databases<\/h2>\n\n\n\n<p>Kumo\u2019s approach, \u201crelational deep learning,\u201d sidesteps this manual process with two key insights. First, it automatically represents any relational database as a single, interconnected graph. For example, if the database has a \u201cusers\u201d table to record customer information and an \u201corders\u201d table to record customer purchases, every row in the users table becomes a user node, every row in an orders table becomes an order node, and so on. These nodes are then automatically connected using the database\u2019s existing relationships, such as foreign keys, creating a rich map of the entire dataset with no manual effort.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img fetchpriority=\"high\" decoding=\"async\" height=\"475\" width=\"800\" src=\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?w=800\" alt=\"\" class=\"wp-image-3013277\" srcset=\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png 1074w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=300,178 300w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=768,456 768w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=800,475 800w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=400,238 400w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=750,446 750w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=578,343 578w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/image_a91cd7.png?resize=930,552 930w\" sizes=\"(max-width: 800px) 100vw, 800px\"\/><figcaption class=\"wp-element-caption\"><em>Relational deep learning Source: Kumo AI<\/em><\/figcaption><\/figure><\/div>\n\n\n<p>Second, Kumo generalized the transformer architecture, the engine behind LLMs, to learn directly from this graph representation. Transformers excel at understanding sequences of tokens by using an \u201cattention mechanism\u201d to weigh the importance of different tokens in relation to each other.\u00a0<\/p>\n\n\n\n<p>Kumo\u2019s RFM applies this same attention mechanism to the graph, allowing it to learn complex patterns and relationships across multiple tables simultaneously. Leskovec compares this leap to the evolution of computer vision. In the early 2000s, ML engineers had to manually design features like edges and shapes to detect an object. But newer architectures like convolutional neural networks (CNN) can take in raw pixels and automatically learn the relevant features.\u00a0<\/p>\n\n\n\n<p>Similarly, the RFM ingests raw database tables and lets the network discover the most predictive signals on its own without the need for manual effort.<\/p>\n\n\n\n<p>The result is a pre-trained foundation model that can perform predictive tasks on a new database instantly, what\u2019s known as \u201czero-shot.\u201d During a demo, Leskovec showed how a user could type a simple query to predict whether a specific customer would place an order in the next 30 days. Within seconds, the system returned a probability score and an explanation of the data points that led to its conclusion, such as the user\u2019s recent activity or lack thereof. The model was not trained on the provided database and adapted to it in real time through in-context learning.\u00a0<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" height=\"523\" width=\"800\" src=\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?w=800\" alt=\"\" class=\"wp-image-3013274\" srcset=\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png 1514w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=300,196 300w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=768,502 768w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=800,523 800w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=400,262 400w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=750,490 750w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=578,378 578w, https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/06\/Screen-Shot-2025-06-10-at-20.57.40.png?resize=930,608 930w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\"\/><\/figure><\/div>\n\n\n<p>\u201cWe have a pre-trained model that you simply point to your data, and it will give you an accurate prediction 200 milliseconds later,\u201d Leskovec said. He added that it can be \u201cas accurate as, let\u2019s say, weeks of a data scientist\u2019s work.\u201d\u00a0<\/p>\n\n\n\n<p>The interface is designed to be familiar to data analysts, not just machine learning specialists, democratizing access to predictive analytics.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-powering-the-agentic-future\">Powering the agentic future<\/h2>\n\n\n\n<p>This technology has significant implications for the development of AI agents. For an agent to perform meaningful tasks within an enterprise, it needs to do more than just process language; it must make intelligent decisions based on the company\u2019s private data. The RFM can serve as a predictive engine for these agents. For example, a customer service agent could query the RFM to determine a customer\u2019s likelihood of churning or their potential future value, then use an LLM to tailor its conversation and offers accordingly.<\/p>\n\n\n\n<p>\u201cIf we believe in an agentic future, agents will need to make decisions rooted in private data. And this is the way for an agent to make decisions,\u201d Leskovec explained.<\/p>\n\n\n\n<p>Kumo\u2019s work points to a future where enterprise AI is split into two complementary domains: LLMs for handling retrospective knowledge in unstructured text, and RFMs for predictive forecasting on structured data. By eliminating the feature engineering bottleneck, the RFM promises to put powerful ML tools into the hands of more enterprises, drastically reducing the time and cost to get from data to decision.<\/p>\n\n\n\n<p>The company has released a public demo of the RFM and plans to launch a version that allows users to connect their own data in the coming weeks. For organizations that require maximum accuracy, Kumo will also offer a fine-tuning service to further boost performance on private datasets.<\/p>\n\n\n\n\n<div id=\"boilerplate_2660155\" class=\"post-boilerplate boilerplate-after\"><div class=\"Boilerplate__newsletter-container vb\">\n<div class=\"Boilerplate__newsletter-main\">\n<p><strong>Daily insights on business use cases with VB Daily<\/strong><\/p>\n<p class=\"copy\">If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.<\/p>\n<p class=\"Form__newsletter-legal\">Read our Privacy Policy<\/p>\n<p class=\"Form__success\" id=\"boilerplateNewsletterConfirmation\">\n\t\t\t\t\tThanks for subscribing. Check out more VB newsletters here.\n\t\t\t\t<\/p>\n<p class=\"Form__error\">An error occured.<\/p>\n<\/p><\/div>\n<div class=\"image-container\">\n\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/venturebeat.com\/wp-content\/themes\/vb-news\/brand\/img\/vb-daily-phone.png\" alt=\"\"\/>\n\t\t\t\t<\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n<br>\r\n<br><a href=\"https:\/\/venturebeat.com\/ai\/kumos-relational-foundation-model-predicts-the-future-your-llm-cant-see\/\">Source link <\/a>","protected":false},"excerpt":{"rendered":"<p>Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Editor\u2019s note: Kumo AI was one of the finalists at VB Transform during our annual innovation showcase and presented RFM from the mainstage at VB Transform on Wednesday. The [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2282,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[33],"tags":[],"class_list":["post-2281","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-automation"],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/violethoward.com\/new\/wp-content\/uploads\/2025\/07\/ChatGPT-Image-Jun-25-2025-07_21_08-PM.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts\/2281","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/comments?post=2281"}],"version-history":[{"count":0,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts\/2281\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/media\/2282"}],"wp:attachment":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/media?parent=2281"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/categories?post=2281"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/tags?post=2281"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<!-- This website is optimized by Airlift. Learn more: https://airlift.net. Template:. Learn more: https://airlift.net. Template: 69e302c146fa5c92dc28ac12. Config Timestamp: 2026-04-18 04:04:16 UTC, Cached Timestamp: 2026-04-29 12:02:36 UTC -->