Skip to content

Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal

By Latent Space

1 hr 25 min video·en··4261 views

This is an AI-generated summary of “Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal” — a 1 hr 25 min YouTube video by Latent Space, published October 22, 2026. It condenses the full transcript into 10 key takeaways with clickable timestamps.

Summary

Modal is an AI infrastructure company that provides a computing and storage platform enabling customers to build and deploy AI applications, with a focus on developer experience and efficient resource utilization.

Key Points

  • Modal provides a computing and storage platform for AI applications, allowing customers like Deck of Gone, Suno, and Runway to build and deploy their AI solutions. 
  • The company has experienced significant growth, with revenues and usage increasing by at least 50 times since their last appearance on Latent Space. 
  • Modal experienced rapid revenue growth starting in late 2022, jumping from $100/month to $30,000/month in a few months, driven initially by a single large customer in the Stable Diffusion space. 
  • Modal's founder previously worked at Spotify, where he built the first version of the music recommendation system, gaining experience with computationally intensive tasks that informed Modal's development. 
  • The core motivation behind Modal was to address the poor infrastructure for building AI applications, stemming from the founder's experiences at Spotify. 
  • The company is optimistic about future growth areas including training, batch processing, and low-latency applications, aiming to provide foundational building blocks for AI development. 
  • Modal initially focused on general-purpose cloud computing but pivoted to focus on AI and machine learning workloads, particularly after the rise of Stable Diffusion. 
  • Modal offers two main products: Modal Functions for serverless, scalable computing, and Modal Sandboxes for isolated environments, which have seen significant adoption. 
  • Founder-led marketing, through consistent tweeting and blogging about Modal's development, played a significant role in the company's early growth. 
  • The company has had to significantly adapt its capacity acquisition strategy, now working with around 25 cloud providers and entering into multi-year deals due to market changes. 
Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal

Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal

Modal is an AI infrastructure company that provides a computing and storage platform enabling customers to build and deploy AI applications, with a focus on developer experience and efficient resource utilization.

Key Points

—Modal provides a computing and storage platform for AI applications, allowing customers like Deck of Gone, Suno, and Runway to build and deploy their AI solutions.
—The company has experienced significant growth, with revenues and usage increasing by at least 50 times since their last appearance on Latent Space.
—Modal experienced rapid revenue growth starting in late 2022, jumping from $100/month to $30,000/month in a few months, driven initially by a single large customer in the Stable Diffusion space.
—Modal's founder previously worked at Spotify, where he built the first version of the music recommendation system, gaining experience with computationally intensive tasks that informed Modal's development.
—The core motivation behind Modal was to address the poor infrastructure for building AI applications, stemming from the founder's experiences at Spotify.
—The company is optimistic about future growth areas including training, batch processing, and low-latency applications, aiming to provide foundational building blocks for AI development.
—Modal initially focused on general-purpose cloud computing but pivoted to focus on AI and machine learning workloads, particularly after the rise of Stable Diffusion.
—Modal offers two main products: Modal Functions for serverless, scalable computing, and Modal Sandboxes for isolated environments, which have seen significant adoption.
—Founder-led marketing, through consistent tweeting and blogging about Modal's development, played a significant role in the company's early growth.
—The company has had to significantly adapt its capacity acquisition strategy, now working with around 25 cloud providers and entering into multi-year deals due to market changes.
Summarize any video — free
Summarizer.tube
Copy All
Share Link
Bookmark

Summarize any YouTube video, free

You just read an AI summary of this video. Paste any other YouTube link and get the key points with clickable timestamps in seconds — no signup, 5 free a day.

More Resources

More Summaries

27 min

Real Signs the AI Bubble is about to burst??

JayzTwoCentsen

The video argues that the current AI boom is an unsustainable bubble, driven by speculative purchasing and a lack of deployed infrastructure, which poses significant financial risks not only to tech c