{"id":2878,"date":"2025-07-29T18:47:19","date_gmt":"2025-07-29T18:47:19","guid":{"rendered":"https:\/\/violethoward.com\/new\/positron-believes-it-has-found-the-secret-to-take-on-nvidia-in-ai-inference-chips-heres-how-it-could-benefit-enterprises\/"},"modified":"2025-07-29T18:47:19","modified_gmt":"2025-07-29T18:47:19","slug":"positron-believes-it-has-found-the-secret-to-take-on-nvidia-in-ai-inference-chips-heres-how-it-could-benefit-enterprises","status":"publish","type":"post","link":"https:\/\/violethoward.com\/new\/positron-believes-it-has-found-the-secret-to-take-on-nvidia-in-ai-inference-chips-heres-how-it-could-benefit-enterprises\/","title":{"rendered":"Positron believes it has found the secret to take on Nvidia in AI inference chips \u2014 here&#8217;s how it could benefit enterprises"},"content":{"rendered":" \r\n<br><div>\n\t\t\t\t<div id=\"boilerplate_2682874\" class=\"post-boilerplate boilerplate-before\">\n<p><em>Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders.<\/em> <em>Subscribe Now<\/em><\/p>\n\n\n\n<hr class=\"wp-block-separator has-css-opacity is-style-wide\"\/>\n<\/div><p>As demand for large-scale AI deployment skyrockets, the lesser-known,<strong> private chip startup Positron is positioning itself as a direct challenger to market leader Nvidia <\/strong>by offering dedicated, energy-efficient, memory-optimized inference chips aimed at relieving the industry\u2019s mounting cost, power, and availability bottlenecks. <\/p>\n\n\n\n<p><strong>\u201cA key differentiator is our ability to run frontier AI models with better efficiency\u2014achieving 2x to 5x performance per watt and dollar compared to Nvidia,\u201d said Thomas Sohmers, Positron co-founder and CTO,<\/strong> in a recent video call interview with VentureBeat.<\/p>\n\n\n\n<p>Obviously, that\u2019s good news for big AI model providers, but Positron\u2019s leadership contends it is helpful for many more enterprises beyond, including those using AI models in their workflows, not as service offerings to customers.<\/p>\n\n\n\n<p>\u201cWe build chips that can be deployed in hundreds of existing data centers because they don\u2019t require liquid cooling or extreme power densities,\u201d <strong>pointed out Mitesh Agrawal, Positron\u2019s CEO and the former chief operating officer of AI cloud inference provider Lambda<\/strong>, also in the same video call interview with VentureBeat. <\/p>\n\n\n\n<div id=\"boilerplate_2803147\" class=\"post-boilerplate boilerplate-speedbump\">\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p><strong>The AI Impact Series Returns to San Francisco &#8211; August 5<\/strong><\/p>\n\n\n\n<p>The next phase of AI is here &#8211; are you ready? Join leaders from Block, GSK, and SAP for an exclusive look at how autonomous agents are reshaping enterprise workflows &#8211; from real-time decision-making to end-to-end automation.<\/p>\n\n\n\n<p>Secure your spot now &#8211; space is limited: https:\/\/bit.ly\/3GuuPLF<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n<\/div><p>Venture capitalists and early users seem to agree.<\/p>\n\n\n\n<p><strong>Positron yesterday announced an oversubscribed $51.6 million Series A funding round<\/strong>\u00a0led by Valor Equity Partners, Atreides Management and DFJ Growth, with support from Flume Ventures, Resilience Reserve, 1517 Fund and Unless.<\/p>\n\n\n\n<p>As for Positron\u2019s early customer base, that includes both name-brand enterprises and companies operating in inference-heavy sectors. Confirmed deployments include the major security and cloud content networking provider <strong>Cloudflare<\/strong>, which uses Positron\u2019s Atlas hardware in its globally distributed, power-constrained data centers, and <strong>Parasail<\/strong>, via its AI-native data infrastructure platform SnapServe. <\/p>\n\n\n\n<p>Beyond these, Positron reports adoption across several key verticals where efficient inference is critical, such as <strong>networking, gaming, content moderation, content delivery networks (CDNs), and Token-as-a-Service providers<\/strong>. <\/p>\n\n\n\n<p>These early users are reportedly drawn in by Atlas\u2019s ability to deliver high throughput and lower power consumption without requiring specialized cooling or reworked infrastructure, making it an attractive drop-in option for AI workloads across enterprise environments.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-entering-a-challenging-market-that-is-decreasing-ai-model-size-and-increasing-efficiency\">Entering a challenging market that is decreasing AI model size and increasing efficiency<\/h2>\n\n\n\n<p>But Positron is also entering a challenging market. <em>The Information<\/em> just reported that r<strong>ival buzzy AI inference chip startup Groq<\/strong> \u2014 <strong>where Sohmers previously worked as Director of Technology Strategy<\/strong> \u2014 has reduced its 2025 revenue projection from $2 billion+ to $500 million,  highlighting just how volatile the AI hardware space can be. <\/p>\n\n\n\n<p>Even well-funded firms face headwinds as they compete for data center capacity and enterprise mindshare against entrenched GPU providers like Nvidia, not to mention the elephant in the room: the rise of more efficient, smaller large language models (LLMs) and specialized small language models (SLMs) that can even run on devices as small and low-powered as smartphones.<\/p>\n\n\n\n<p>Yet Positron\u2019s leadership is for now embracing the trend and shrugging off the possible impacts on its growth trajectory.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><strong>\u201cThere\u2019s always been this duality\u2014lightweight applications on local devices and heavyweight processing in centralized infrastructure,\u201d said Agrawal. \u201cWe believe both will keep growing.\u201d<\/strong><\/p>\n\n\n\n<p><strong>Sohmers agreed, stating: \u201cWe see a future where every person might have a capable model on their phone, but those will still rely on large models in data centers to generate deeper insights.\u201d<\/strong><\/p>\n<\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-atlas-is-an-inference-first-ai-chip\">Atlas is an inference-first AI chip<\/h2>\n\n\n\n<p>While Nvidia GPUs helped catalyze the deep learning boom by accelerating model training, Positron argues that inference \u2014 the stage where models generate output in production \u2014 is now the true bottleneck. <\/p>\n\n\n\n<p>Its founders call it the most under-optimized part of the \u201cAI stack,\u201d especially for generative AI workloads that depend on fast, efficient model serving.<\/p>\n\n\n\n<p>Positron\u2019s solution is <strong>Atlas, its first-generation inference accelerator built specifically to handle large transformer models. <\/strong><\/p>\n\n\n\n<p>Unlike general-purpose GPUs, Atlas is optimized for the unique memory and throughput needs of modern inference tasks. <\/p>\n\n\n\n<p>The company claims Atlas delivers 3.5x better performance per dollar and up to 66% lower power usage than Nvidia\u2019s H100, while also achieving 93% memory bandwidth utilization\u2014far above the typical 10\u201330% range seen in GPUs.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-from-atlas-to-titan-supporting-multi-trillion-parameter-models\">From Atlas to Titan, supporting multi-trillion parameter models<\/h2>\n\n\n\n<p>Launched just 15 months after founding \u2014 and with only $12.5 million in seed capital \u2014 Atlas is already shipping and in production.<\/p>\n\n\n\n<p> The system supports up to 0.5 trillion-parameter models in a single 2kW server and is compatible with Hugging Face transformer models via an OpenAI API-compatible endpoint.<\/p>\n\n\n\n<p><strong>Positron is now preparing to launch its next-generation platform, Titan, in 2026. <\/strong><\/p>\n\n\n\n<p>Built on custom-designed \u201cAsimov\u201d silicon, <strong>Titan will feature up to two terabytes of high-speed memory per accelerator and support models up to 16 trillion parameters<\/strong>. <\/p>\n\n\n\n<p>Today\u2019s frontier models are in the hundred billions and single digit trillions of parameters, but newer models like OpenAI\u2019s GPT-5 are presumed to be in the multi-trillions, and larger models are currently thought to be required to reach artificial general intelligence (AGI), AI that outperforms humans on most economically valuable work, and superintelligence, AI that exceeds the ability for humans to understand and control. <\/p>\n\n\n\n<p>Crucially, Titan is designed to operate with standard air cooling in conventional data center environments, avoiding the high-density, liquid-cooled configurations that next-gen GPUs increasingly require.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-engineering-for-efficiency-and-compatibility\">Engineering for efficiency and compatibility<\/h2>\n\n\n\n<p>From the start, Positron designed its system to be a drop-in replacement, allowing customers to use existing model binaries without code rewrites. <\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><strong>\u201cIf a customer had to change their behavior or their actions in any way, shape or form, that was a barrier,\u201d said Sohmers.<\/strong><\/p>\n<\/blockquote>\n\n\n\n<p>Sohmers explained that instead of building a complex compiler stack or rearchitecting software ecosystems, Positron focused narrowly on inference, designing hardware that ingests Nvidia-trained models directly.<\/p>\n\n\n\n<p><strong>\u201cCUDA mode isn\u2019t something to fight,\u201d said Agrawal. \u201cIt\u2019s an ecosystem to participate in.\u201d<\/strong><\/p>\n\n\n\n<p>This pragmatic approach helped the company ship its first product quickly, validate performance with real enterprise users, and secure significant follow-on investment. In addition, its focus on air cooling versus liquid cooling makes its Atlas chips the only option for some deployments. <\/p>\n\n\n\n<p><strong>\u201cWe\u2019re focused entirely on purely air-cooled deployments\u2026 all these Nvidia Hopper- and Blackwell-based solutions going forward are required liquid cooling<\/strong>\u2026 The only place you can put those racks are in data centers that are being newly built now in the middle of nowhere,\u201d said Sohmers.<\/p>\n\n\n\n<p>All told, Positron\u2019s ability to execute quickly and capital-efficiently has helped distinguish it in a crowded AI hardware market.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-memory-is-what-you-need\">Memory is what you need<\/h2>\n\n\n\n<p>Sohmers and Agrawal point to a fundamental shift in AI workloads: from compute-bound convolutional neural networks to memory-bound transformer architectures. <\/p>\n\n\n\n<p>Whereas older models demanded high FLOPs (floating-point operations), modern transformers require massive memory capacity and bandwidth to run efficiently.<\/p>\n\n\n\n<p>While Nvidia and others continue to focus on compute scaling, Positron is betting on memory-first design. <\/p>\n\n\n\n<p>Sohmers noted that with transformer inference, the ratio of compute to memory operations flips to near 1:1, meaning that boosting memory utilization has a direct and dramatic impact on performance and power efficiency.<\/p>\n\n\n\n<p>With Atlas already outperforming contemporary GPUs on key efficiency metrics, Titan aims to take this further by offering the highest memory capacity per chip in the industry. <\/p>\n\n\n\n<p>At launch, Titan is expected to offer an order-of-magnitude increase over typical GPU memory configurations \u2014 without demanding specialized cooling or boutique networking setups.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-u-s-built-chips\">U.S.-built chips<\/h2>\n\n\n\n<p>Positron\u2019s production pipeline is proudly domestic. The company\u2019s first-generation chips were fabricated in the U.S. using Intel facilities, with final server assembly and integration also based domestically. <\/p>\n\n\n\n<p>For the Asimov chip, fabrication will shift to TSMC, though the team is aiming to keep as much of the rest of the production chain in the U.S. as possible, depending on foundry capacity.<\/p>\n\n\n\n<p>Geopolitical resilience and supply chain stability are becoming key purchasing criteria for many customers \u2014 another reason Positron believes its U.S.-made hardware offers a compelling alternative.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-s-next\">What\u2019s next?<\/h2>\n\n\n\n<p>Agrawal noted that Positron\u2019s silicon targets not just broad compatibility but maximum utility for enterprise, cloud, and research labs alike. <\/p>\n\n\n\n<p>While the company has not named any frontier model providers as customers yet, he confirmed that outreach and conversations are underway.<\/p>\n\n\n\n<p>Agrawal emphasized that selling physical infrastructure based on economics and performance\u2014not bundling it with proprietary APIs or business models\u2014is part of what gives Positron credibility in a skeptical market.<\/p>\n\n\n\n<p>\u201cIf you can\u2019t convince a customer to deploy your hardware based on its economics, you\u2019re not going to be profitable,\u201d he said.<\/p>\n<div id=\"boilerplate_2660155\" class=\"post-boilerplate boilerplate-after\"><div class=\"Boilerplate__newsletter-container vb\">\n<div class=\"Boilerplate__newsletter-main\">\n<p><strong>Daily insights on business use cases with VB Daily<\/strong><\/p>\n<p class=\"copy\">If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.<\/p>\n<p class=\"Form__newsletter-legal\">Read our Privacy Policy<\/p>\n<p class=\"Form__success\" id=\"boilerplateNewsletterConfirmation\">\n\t\t\t\t\tThanks for subscribing. Check out more VB newsletters here.\n\t\t\t\t<\/p>\n<p class=\"Form__error\">An error occured.<\/p>\n<\/p><\/div>\n<div class=\"image-container\">\n\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/venturebeat.com\/wp-content\/themes\/vb-news\/brand\/img\/vb-daily-phone.png\" alt=\"\"\/>\n\t\t\t\t<\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n<br>\r\n<br><a href=\"https:\/\/venturebeat.com\/ai\/positron-believes-it-has-found-the-secret-to-take-on-nvidia-in-ai-inference-chips-heres-how-it-could-benefit-enterprises\/\">Source link <\/a>","protected":false},"excerpt":{"rendered":"<p>Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now As demand for large-scale AI deployment skyrockets, the lesser-known, private chip startup Positron is positioning itself as a direct challenger to market leader Nvidia by offering dedicated, energy-efficient, memory-optimized [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2879,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[33],"tags":[],"class_list":["post-2878","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-automation"],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/violethoward.com\/new\/wp-content\/uploads\/2025\/07\/cfr0z3n_vector_art_line_art_flat_illustration_dominant_green__c7287e77-740b-47f7-a6d5-e2933a10b1cc_1.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts\/2878","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/comments?post=2878"}],"version-history":[{"count":0,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/posts\/2878\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/media\/2879"}],"wp:attachment":[{"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/media?parent=2878"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/categories?post=2878"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/violethoward.com\/new\/wp-json\/wp\/v2\/tags?post=2878"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<!-- This website is optimized by Airlift. Learn more: https://airlift.net. Template:. Learn more: https://airlift.net. Template: 69e302c146fa5c92dc28ac12. Config Timestamp: 2026-04-18 04:04:16 UTC, Cached Timestamp: 2026-04-29 17:01:23 UTC -->