Labelbox CEO Manu Sharma joined Andreessen Horowitz partner Matt Bornstein on the AI + a16z podcast to discuss the evolution of data labeling and evaluation in artificial intelligence. The conversation highlighted how the industry has shifted from pre-training to post-training optimization, with companies now building global networks of domain experts to fine-tune AI systems and align outputs with user expectations.
What you should know: The AI industry has fundamentally transformed from building custom models to renting base intelligence and enhancing it for specific use cases.
- Labelbox originally focused on computer vision but pivoted as foundation models and generative AI changed the competitive landscape.
- The company now operates a global network of experts from fields like coding, healthcare, and customer service who label and evaluate data for AI fine-tuning.
- Modern AI systems are increasingly trained not just to answer questions but to assess the quality of their own responses.
The big picture: Data labeling has evolved from simple supervised learning tasks to sophisticated reinforcement learning loops that require domain expertise.
- Value creation has shifted from the pre-training phase to post-training optimization and evaluation.
- Companies are no longer primarily building their own models but instead renting foundational intelligence and customizing it.
- The focus has moved toward aligning AI outputs with human expectations through expert evaluation.
What they’re saying: Sharma explained the strategic pivot Labelbox made to adapt to the changing AI landscape.
- “It took us some time to really understand like that the world is shifting from building AI models to renting AI intelligence. A vast number of enterprises around the world are no longer building their own models; they’re actually renting base intelligence and adding on top of it to make that work for their company.”
- “The even bigger opportunity was the hyperscalers and the AI labs that are spending billions of dollars of capital developing these models and data sets. We really ought to go and figure out and innovate for them.”
Why this matters: The conversation underscored how critical high-quality data and specialized talent have become in the race toward artificial general intelligence.
- Meta’s acquisition of Scale AI demonstrates the strategic importance of data labeling companies.
- Expert evaluation networks are becoming essential infrastructure for AI development.
- The shift from software-tools mindset to service-oriented approaches reflects broader industry transformation.
Key challenge: Sharma acknowledged the difficulty of transitioning from a traditional software company approach to serving AI labs and hyperscalers.
- “The hardest part for many of us, at that time, was to just make the decision that we’re going just go try it and do it. And nothing is better than that: ‘Let’s just go build an MVP and see what happens.'”
Recent Stories
DOE fusion roadmap targets 2030s commercial deployment as AI drives $9B investment
The Department of Energy has released a new roadmap targeting commercial-scale fusion power deployment by the mid-2030s, though the plan lacks specific funding commitments and relies on scientific breakthroughs that have eluded researchers for decades. The strategy emphasizes public-private partnerships and positions AI as both a research tool and motivation for developing fusion energy to meet data centers' growing electricity demands. The big picture: The DOE's roadmap aims to "deliver the public infrastructure that supports the fusion private sector scale up in the 2030s," but acknowledges it cannot commit to specific funding levels and remains subject to Congressional appropriations. Why...
Oct 17, 2025Tying it all together: Credo’s purple cables power the $4B AI data center boom
Credo, a Silicon Valley semiconductor company specializing in data center cables and chips, has seen its stock price more than double this year to $143.61, following a 245% surge in 2024. The company's signature purple cables, which cost between $300-$500 each, have become essential infrastructure for AI data centers, positioning Credo to capitalize on the trillion-dollar AI infrastructure expansion as hyperscalers like Amazon, Microsoft, and Elon Musk's xAI rapidly build out massive computing facilities. What you should know: Credo's active electrical cables (AECs) are becoming indispensable for connecting the massive GPU clusters required for AI training and inference. The company...
Oct 17, 2025Vatican launches Latin American AI network for human development
The Vatican hosted a two-day conference bringing together 50 global experts to explore how artificial intelligence can advance peace, social justice, and human development. The event launched the Latin American AI Network for Integral Human Development and established principles for ethical AI governance that prioritize human dignity over technological advancement. What you should know: The Pontifical Academy of Social Sciences, the Vatican's research body for social issues, organized the "Digital Rerum Novarum" conference on October 16-17, combining academic research with practical AI applications. Participants included leading experts from MIT, Microsoft, Columbia University, the UN, and major European institutions. The conference...