Inferact Secures $150M to Commercialize vLLM Inference Startup

Inferact Secures $150 Million to Advance AI Inference technology

The open-source project vLLM has evolved into a venture capital-backed startup, Inferact, following a successful $150 million seed funding round that values the company at $800 million. The funding was co-led by prominent venture capital firms Andreessen Horowitz and Lightspeed Venture Partners, confirming previous reports of investment from a16z.

This move mirrors a recent trend in the artificial intelligence sector, exemplified by the commercialization of the SGLang project as RadixArk, which recently secured funding at a $400 million valuation. The growing investor interest in companies like Inferact and RadixArk highlights a notable shift in the AI landscape. The industry is increasingly focused on inference – the process of deploying trained AI models into practical applications – rather than solely on model training. technologies that enhance the speed and affordability of AI inference are now attracting substantial capital.

Both vLLM and SGLang originated from research incubated in 2023 within the UC Berkeley lab led by Databricks co-founder Ion Stoica. Inferact CEO Simon Mo, a key creator of vLLM, revealed to Bloomberg that current vLLM users include major players such as AmazonS cloud service and a prominent shopping application. This demonstrates the existing market demand and practical application of the technology underpinning Inferact’s future growth.