\n
![](\"https:\/\/images.ctfassets.net\/jdtwqhzvc2n1\/4UhFQT7cP4EsW10hrJr6Tj\/c13730af61d302ca31c26f54c8253fca\/Notion.png\")
<\/p>\n
\n<\/p>\n
Many organizations would be hesitant to overhaul their tech stack and start from scratch. <\/p>\n
Not Notion. <\/p>\n
For the 3.0 version of its productivity software (released in September), the company didn\u2019t hesitate to rebuild from the ground up; they recognized that it was necessary, in fact, to support agentic AI at enterprise scale.<\/p>\n
Whereas traditional AI-powered workflows involve explicit, step-by-step instructions based on few-shot learning, AI agents powered by advanced reasoning models are thoughtful about tool definition, can identify and comprehend what tools they have at their disposal and plan next steps. <\/p>\n
\u201cRather than trying to retrofit into what we were building, we wanted to play to the strengths of reasoning models,\u201d Sarah Sachs, Notion\u2019s head of AI modeling, told VentureBeat. \u201cWe've rebuilt a new architecture because workflows are different from agents.\u201d<\/p>\n
Notion has been adopted by 94% of Forbes AI 50 companies, has 100 million total users and counts among its customers OpenAI, Cursor, Figma, Ramp and Vercel. <\/p>\n
In a rapidly evolving AI landscape, the company identified the need to move beyond simpler, task-based workflows to goal-oriented reasoning systems that allow agents to autonomously select, orchestrate, and execute tools across connected environments. <\/p>\n
Very quickly, reasoning models have become \u201cfar better\u201d at learning to use tools and follow chain-of-thought (CoT) instructions, Sachs noted. This allows them to be \u201cfar more independent\u201d and make multiple decisions within one agentic workflow. \u201cWe rebuilt our AI system to play to that," she said. <\/p>\n
From an engineering perspective, this meant replacing rigid prompt-based flows with a unified orchestration model, Sachs explained. This core model is supported by modular sub-agents that search Notion and the web, query and add to databases and edit content. <\/p>\n
Each agent uses tools contextually; for instance, they can decide whether to search Notion itself, or another platform like Slack. The model will perform successive searches until the relevant information is found. It can then, for instance, convert notes into proposals, create follow-up messages, track tasks, and spot and make updates in knowledge bases. <\/p>\n
In Notion 2.0, the team focused on having AI perform specific tasks, which required them to \u201cthink exhaustively\u201d about how to prompt the model, Sachs noted. However, with version 3.0, users can assign tasks to agents, and agents can actually take action and perform multiple tasks concurrently. <\/p>\n
\u201cWe reorchestrated it to be self-selecting on the tools, rather than few-shotting, which is explicitly prompting how to go through all these different scenarios,\u201d Sachs explained. The aim is to ensure everything interfaces with AI and that \u201canything you can do, your Notion agent can do.\u201d<\/p>\n
Notion\u2019s philosophy of \u201cbetter, faster, cheaper,\u201d drives a continuous iteration cycle that balances latency and accuracy through fine-tuned vector embeddings and elastic search optimization. Sachs\u2019 team employs a rigorous evaluation framework that combines deterministic tests, vernacular optimization, human-annotated data and LLMs-as-a-judge, with model-based scoring identifying discrepancies and inaccuracies. <\/p>\n
\u201cBy bifurcating the evaluation, we're able to identify where the problems come from, and that helps us isolate unnecessary hallucinations,\u201d Sachs explained. Further, making the architecture itself simpler means it\u2019s easier to make changes as models and techniques evolve. <\/p>\n
\u201cWe optimize latency and parallel thinking as much as possible,\u201d which leads to \u201cway better accuracy,\u201d Sachs noted. Models are grounded in data from the web and the Notion connected workspace. <\/p>\n
Ultimately, Sachs reported, the investment in rebuilding its architecture has already provided Notion returns in terms of capability and faster rate of change. <\/p>\n
She added, \u201cWe are fully open to rebuilding it again, when the next breakthrough happens, if we have to.\u201d<\/p>\n
When building and fine-tuning models, it\u2019s important to understand that latency is subjective: AI must provide the most relevant information, not necessarily the most, at the cost of speed. <\/p>\n
\u201cYou'd be surprised at the different ways customers are willing to wait for things and not wait for things,\u201d Sachs said. It makes for an interesting experiment: How slow can you go before people abandon the model?<\/p>\n
With pure navigational search, for instance, users may not be as patient; they want answers near-immediately. \u201cIf you ask, \u2018What's two plus two,\u2019 you don't want to wait for your agent to be searching everywhere in Slack and JIRA,\u201d Sachs pointed out. <\/p>\n
But the longer the time it's given, the more exhaustive a reasoning agent can be. For instance, Notion can perform 20 minutes of autonomous work across hundreds of websites, files and other materials. In these instances, users are more willing to wait, Sachs explained; they allow the model to execute in the background while they attend to other tasks. <\/p>\n
\u201cIt's a product question,\u201d said Sachs. \u201cHow do we set user expectations from the UI? How do we ascertain user expectations on latency?\u201d<\/p>\n
Notion understands the importance of using its own product \u2014 in fact, its employees are among its biggest power users. <\/p>\n
Sachs explained that teams have active sandboxes that generate training and evaluation data, as well as a \u201creally active\u201d thumbs-up-thumbs-down user feedback loop. Users aren\u2019t shy about saying what they think should be improved or features they\u2019d like to see. <\/p>\n
Sachs emphasized that when a user thumbs down an interaction, they are explicitly giving permission to a human annotator to analyze that interaction in a way that de-anonymizes them as much as possible. <\/p>\n
\u201cWe are using our own tool as a company all day, every day, and so we get really fast feedback loops,\u201d said Sachs. \u201cWe\u2019re really dogfooding our own product.\u201d <\/p>\n
That said, it\u2019s their own product they\u2019re building, Sachs noted, so they understand that they may have goggles on when it comes to quality and functionality. To balance this out, Notion has trusted "very AI-savvy" design partners who are granted early access to new capabilities and provide important feedback. <\/p>\n
Sachs emphasized that this is just as important as internal prototyping. <\/p>\n
\u201cWe're all about experimenting in the open, I think you get much richer feedback,\u201d said Sachs. \u201cBecause at the end of the day, if we just look at how Notion uses Notion, we're not really giving the best experience to our customers.\u201d <\/p>\n
Just as importantly, continuous internal testing allows teams to evaluate progressions and make sure models aren't regressing (when accuracy and performance degrades over time). "Everything you're doing stays faithful," Sachs explained. "You know that your latency is within bounds." <\/p>\n
Many companies make the mistake of focusing too intensely on retroactively-focused evans; this makes it difficult for them to understand how or where they're improving, Sachs pointed out. Notion considers evals as a "litmus test" of development and forward-looking progression and evals of observability and regression proofing. <\/p>\n
\u201cI think a big mistake a lot of companies make is conflating the two,\u201d said Sachs. \u201cWe use them for both purposes; we think about them really differently.\u201d<\/p>\n
For enterprises, Notion can serve as a blueprint for how to responsibly and dynamically operationalize agentic AI in a connected, permissioned enterprise workspace. <\/p>\n
Sach\u2019s takeaways for other tech leaders: <\/p>\n
Don\u2019t be afraid to rebuild when foundational capabilities change; Notion fully re-engineered its architecture to align with reasoning-based models.<\/p>\n<\/li>\n
Treat latency as contextual: Optimize per use case, rather than universally. <\/p>\n<\/li>\n
Ground all outputs in trustworthy, curated enterprise data to ensure accuracy and trust. <\/p>\n
She advised: \u201cBe willing to make the hard decisions. Be willing to sit at the top of the frontier, so to speak, on what you're developing to build the best product you can for your customers.\u201d <\/p>\n<\/li>\n<\/ul>\n