How to Power the AI Boom

Episode 48

In this episode of B2BaCEO, I speak with Robert Nishihara, co-founder and CEO of Anyscale. Anyscale’s aspiration is to build the fastest, most cost-efficient infrastructure for running LLMs and AI workloads. When it is successful, Anyscale will be to the AI era what Microsoft was for the PC era: the underlying operating system on which all AI applications are developed and run.

Anyscale is built on Ray, an open-source compute framework that Robert and his co-founders developed as PhD students at UC Berkeley. Under the guidance of Professor Ion Stoica, who also co-founded Conviva and Databricks, the team sought to make distributed computing broadly accessible. Anyscale was then launched as a fully managed platform for Ray, making even the toughest problems in distributed computing easy for developers to tackle. Today, Anyscale is a billion-dollar business powering mission-critical AI use cases at companies like Amazon, Cohere, Hugging Face, NVIDIA, OpenAI, and Visa.

If you’ve been a PhD student at UC Berkeley, created a popular open-source framework, and built a billion-dollar business on top of it, you’ve likely learned a thing or two along the way. Robert’s story offers valuable lessons for fellow founders and builders at all stages of the startup journey.