Nvidia AI Chip Rival Groq Raises More Than Expected, Hits $6.9 Billion Valuation

Groq, an AI chip startup, announced on Wednesday that it has raised $750 million in a new funding round, bringing its post-money valuation to $6.9 billion.

This outcome surpasses earlier rumors. When news first emerged in July that Groq was seeking funding, reports suggested a target of around $600 million with a valuation nearing $6 billion.

Groq, which also offers computing power for data centers, previously raised $640 million in August 2024 at a valuation of $2.8 billion. This means its valuation has more than doubled in about a year. According to PitchBook estimates, Groq has now raised over $3 billion in total.

The company has attracted significant attention as it strives to challenge Nvidia's dominance in the AI chip market. Groq’s chips are not the typical graphics processing units (GPUs) commonly used to power AI systems. Instead, the company refers to its technology as an LPU (Language Processing Unit), which it describes as a dedicated inference engine—computing hardware optimized specifically for running AI models quickly and efficiently.

Groq's offerings target developers and enterprises, available via cloud services or on-premises hardware clusters. The on-premises solution is a server rack packed with integrated hardware-software nodes. Both cloud and local deployments support popular open versions of AI models from companies like Meta, DeepSeek, Qwen, Mistral, Google, and OpenAI. Groq claims that its solutions significantly reduce costs while maintaining or even improving AI performance in some cases.

Jonathan Ross, Groq's founder, brings particularly relevant expertise to the table. Ross previously worked at Google, where he developed the Tensor Processing Unit (TPU) chip—an application-specific integrated circuit designed for machine learning tasks. TPUs were launched in 2016, the same year Groq emerged from stealth mode. TPUs continue to power Google Cloud’s AI services.

Groq now reports over 2 million developers using its AI applications, a substantial increase from the 356,000 developers it reported to TechCrunch just a year ago.

The latest funding round was led by Disruptive, with participation from BlackRock, Neuberger Berman, and Deutsche Telekom Capital Partners. Existing investors, including Samsung, Cisco, D1, and Altimeter, also joined the round.