{"id":2118,"date":"2025-06-27T19:07:30","date_gmt":"2025-06-27T19:07:30","guid":{"rendered":"https:\/\/violethoward.com\/new\/openais-api-lead-on-how-enterprises-are-succeeding-with-agents\/"},"modified":"2025-06-27T19:07:30","modified_gmt":"2025-06-27T19:07:30","slug":"openais-api-lead-on-how-enterprises-are-succeeding-with-agents","status":"publish","type":"post","link":"https:\/\/violethoward.com\/new\/openais-api-lead-on-how-enterprises-are-succeeding-with-agents\/","title":{"rendered":"OpenAI&#8217;s API lead on how enterprises are succeeding with agents"},"content":{"rendered":" \r\n<br><div>\n\t\t\t\t<div id=\"boilerplate_2682874\" class=\"post-boilerplate boilerplate-before\">\n<p><em>Join the event trusted by enterprise leaders for nearly two decades. VB Transform brings together the people building real enterprise AI strategy.\u00a0Learn more<\/em><\/p>\n\n\n\n<hr class=\"wp-block-separator has-css-opacity is-style-wide\"\/>\n<\/div><p>At VentureBeat\u2019s Transform 2025 conference, Olivier Godement, Head of Product for OpenAI\u2019s API platform, provided a behind-the-scenes look at how enterprise teams are adopting and deploying AI agents at scale. <\/p>\n\n\n\n<p>In a 20-minute panel discussion I hosted exclusively with Godement, the former Stripe researcher and current OpenAI API boss unpacked OpenAI\u2019s latest developer tools\u2014the Responses API and Agents SDK\u2014while highlighting real-world patterns, security considerations, and cost-return examples from early adopters like Stripe and Box.<\/p>\n\n\n\n<p>For enterprise leaders unable to attend the session live, here are top 8 most important takeaways:<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-agents-are-rapidly-moving-from-prototype-to-production\">Agents Are Rapidly Moving From Prototype to Production<\/h2>\n\n\n\n<p>According to Godement, 2025 marks a real shift in how AI is being deployed at scale. With over a million monthly active developers now using OpenAI\u2019s API platform globally, and token usage up 700% year over year, AI is moving beyond experimentation.<\/p>\n\n\n\n<p>\u201cIt\u2019s been five years since we launched essentially GPT-3\u2026 and man, the past five years has been pretty wild.\u201d<\/p>\n\n\n\n<p>Godement emphasized that current demand isn\u2019t just about chatbots anymore. \u201cAI use cases are moving from simple Q&amp;A to actually use cases where the application, the agent, can do stuff for you.\u201d<\/p>\n\n\n\n<p>This shift prompted OpenAI to launch two major developer-facing tools in March: the <strong>Responses API<\/strong> and the <strong>Agents SDK<\/strong>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-when-to-use-single-agents-vs-sub-agent-architectures\">When to Use Single Agents vs. Sub-Agent Architectures<\/h2>\n\n\n\n<p>A major theme was architectural choice. Godement noted that single-agent loops, which encapsulate full tool access and context in one model, are conceptually elegant but often impractical at scale.<\/p>\n\n\n\n<p>\u201cBuilding accurate and reliable single agents is hard. Like, it\u2019s really hard.\u201d<\/p>\n\n\n\n<p>As complexity increases\u2014more tools, more possible user inputs, more logic\u2014teams often move toward modular architectures with specialized sub-agents.<\/p>\n\n\n\n<p>\u201cA practice which has emerged is to essentially break down the agents into multiple sub-agents\u2026 You would do separation of concerns like in software.\u201d<\/p>\n\n\n\n<p>These sub-agents function like roles in a small team: a triage agent classifies intent, tier-one agents handle routine issues, and others escalate or resolve edge cases.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-why-the-responses-api-is-a-step-change\">Why the Responses API Is a Step Change<\/h2>\n\n\n\n<p>Godement positioned the Responses API as a foundational evolution in developer tooling. Previously, developers manually orchestrated sequences of model calls. Now, that orchestration is handled internally.<\/p>\n\n\n\n<p>\u201cThe Responses API is probably the biggest new layer of abstraction we introduced since pretty much GPT-3.\u201d<\/p>\n\n\n\n<p>It allows developers to express intent, not just configure model flows. \u201cYou care about returning a really good response to the customer\u2026 the Response API essentially handles that loop.\u201d<\/p>\n\n\n\n<p>It also includes built-in capabilities for knowledge retrieval, web search, and function calling\u2014tools that enterprises need for real-world agent workflows.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-observability-and-security-are-built-in\">Observability and Security Are Built In<\/h2>\n\n\n\n<p>Security and compliance were top of mind. Godement cited key guardrails that make OpenAI\u2019s stack viable for regulated sectors like finance and healthcare:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Policy-based refusals<\/strong><\/li>\n\n\n\n<li><strong>SOC-2 logging<\/strong><\/li>\n\n\n\n<li><strong>Data residency support<\/strong><\/li>\n<\/ul>\n\n\n\n<p>Evaluation is where Godement sees the biggest gap between demo and production.<\/p>\n\n\n\n<p>\u201cMy hot take is that model evaluation is probably the biggest bottleneck to massive AI adoption.\u201d<\/p>\n\n\n\n<p>OpenAI now includes tracing and eval tools with the API stack to help teams define what success looks like and track how agents perform over time.<\/p>\n\n\n\n<p>\u201cUnless you invest in evaluation\u2026 it\u2019s really hard to build that trust, that confidence that the model is being accurate, reliable.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-early-roi-is-visible-in-specific-functions\">Early ROI Is Visible in Specific Functions<\/h2>\n\n\n\n<p>Some enterprise use cases are already delivering measurable gains. Godement shared examples from:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Stripe<\/strong>, which uses agents to accelerate invoice handling, reporting <strong>\u201c35% faster invoice resolution\u201d<\/strong><\/li>\n\n\n\n<li><strong>Box<\/strong>, which launched knowledge assistants that enable <strong>\u201czero-touch ticket triage\u201d<\/strong><\/li>\n<\/ul>\n\n\n\n<p>Other high-value use cases include customer support (including voice), internal governance, and knowledge assistants for navigating dense documentation.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-it-takes-to-launch-in-production\">What It Takes to Launch in Production<\/h2>\n\n\n\n<p>Godement emphasized the human factor in successful deployments. <\/p>\n\n\n\n<p>\u201cThere is a small fraction of very high-end people who, whenever they see a problem and see a technology, they run at it.\u201d<\/p>\n\n\n\n<p>These internal champions don\u2019t always come from engineering. What unites them is persistence.<\/p>\n\n\n\n<p>\u201cTheir first reaction is, OK, how can I make it work?\u201d<\/p>\n\n\n\n<p>OpenAI sees many initial deployments driven by this group \u2014 people who pushed early ChatGPT use in the enterprise and are now experimenting with full agent systems.<\/p>\n\n\n\n<p>He also pointed out a gap many overlook: domain expertise. \u201cThe knowledge in an enterprise\u2026 does not lie with engineers. It lies with the ops teams.\u201d<\/p>\n\n\n\n<p>Making agent-building tools accessible to non-developers is a challenge OpenAI aims to address.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-s-next-for-enterprise-agents\">What\u2019s Next for Enterprise Agents<\/h2>\n\n\n\n<p>Godement offered a glimpse into the roadmap. OpenAI is actively working on:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Multimodal agents<\/strong> that can interact via text, voice, images, and structured data<\/li>\n\n\n\n<li><strong>Long-term memory<\/strong> for retaining knowledge across sessions<\/li>\n\n\n\n<li><strong>Cross-cloud orchestration<\/strong> to support complex, distributed IT environments<\/li>\n<\/ul>\n\n\n\n<p>These aren\u2019t radical changes, but iterative layers that expand what\u2019s already possible. \u201cOnce we have models that can think not only for a few seconds but for minutes, for hours\u2026 that\u2019s going to enable some pretty mind-blowing use cases.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-final-word-reasoning-models-are-underhyped\">Final Word: Reasoning Models Are Underhyped<\/h2>\n\n\n\n<p>Godement closed the session by reaffirming his belief that reasoning-capable models\u2014those that can reflect before responding\u2014will be the true enablers of long-term transformation.<\/p>\n\n\n\n<p>\u201cI still have conviction that we are pretty much at the GPT-2 or GPT-3 level of maturity of those models\u2026.We are still scratching the surface on what reasoning models can do.\u201d<\/p>\n\n\n\n<p>For enterprise decision makers, the message is clear: the infrastructure for agentic automation is here. What matters now is building a focused use case, empowering cross-functional teams, and being ready to iterate. The next phase of value creation lies not in novel demos\u2014but in durable systems, shaped by real-world needs and the operational discipline to make them reliable.<\/p>\n<div id=\"boilerplate_2660155\" class=\"post-boilerplate boilerplate-after\"><div class=\"Boilerplate__newsletter-container vb\">\n<div class=\"Boilerplate__newsletter-main\">\n<p><strong>Daily insights on business use cases with VB Daily<\/strong><\/p>\n<p class=\"copy\">If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.<\/p>\n<p class=\"Form__newsletter-legal\">Read our Privacy Policy<\/p>\n<p class=\"Form__success\" id=\"boilerplateNewsletterConfirmation\">\n\t\t\t\t\tThanks for subscribing. Check out more VB newsletters here.\n\t\t\t\t<\/p>\n<p class=\"Form__error\">An error occured.<\/p>\n<\/p><\/div>\n<div class=\"image-container\">\n\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/venturebeat.com\/wp-content\/themes\/vb-news\/brand\/img\/vb-daily-phone.png\" alt=\"\"\/>\n\t\t\t\t<\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n<br>\r\n<br><a href=\"https:\/\/venturebeat.com\/programming-development\/openais-api-lead-explains-how-enterprises-are-already-succeeding-with-its-agents-sdk-and-responses-api\/\">Source link <\/a>","protected":false},"excerpt":{"rendered":"<p>Join the event trusted by enterprise leaders for nearly two decades. VB Transform brings together the people building real enterprise AI strategy.\u00a0Learn more At VentureBeat\u2019s Transform 2025 conference, Olivier Godement, Head of Product for OpenAI\u2019s API platform, provided a behind-the-scenes look at how enterprise teams are adopting and deploying AI agents at scale. In a [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":812,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[33],"tags":[],"class_list":["post-2118","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-automation"],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/violethoward.com\/new\/wp-content\/uploads\/2025\/03\/vb-daily-phone.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts\/2118","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/comments?post=2118"}],"version-history":[{"count":0,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts\/2118\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/media\/812"}],"wp:attachment":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/media?parent=2118"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/categories?post=2118"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/tags?post=2118"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<!-- This website is optimized by Airlift. Learn more: https://airlift.net. Template:. Learn more: https://airlift.net. Template: 69e302c146fa5c92dc28ac12. Config Timestamp: 2026-04-18 04:04:16 UTC, Cached Timestamp: 2026-04-29 11:15:53 UTC -->