Artwork for Training Data

Podcast

Training Data

Sequoia Capital conversations with AI founders, researchers, and builders about company building and technology shifts.

Original source
Artwork for Chai Discovery's Bitter Lesson: Drug Design Is Another Scaling Problem
Training Data

Chai Discovery's Bitter Lesson: Drug Design Is Another Scaling Problem

Chai Discovery argues drug design is a scaling problem: build simpler models, scale data and compute, and verify results in the lab. The episode centers on Chai-2’s jump in antibody hit rate from roughly 0.1% to 15% and the company’s plan to turn discovery into a computer-aided design loop.

Artwork for Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil
Training Data

Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil

Core Automation’s Jerry Tworek and Rohan Anil argue that transformers have reached an architectural ceiling and that the next frontier is continual learning, test-time adaptation, and tighter end-to-end optimization. They also describe an automation-first research lab strategy, starting with kernel generation and GPU performance as the key bottleneck.

Artwork for Factory's Matan Grinberg: The Coming ‘Dark Factory’ Where Software Builds Itself
Training DataMatan Grinberg

Factory's Matan Grinberg: The Coming ‘Dark Factory’ Where Software Builds Itself

Matan Grinberg says Factory bet early on autonomous coding agents, endured years of weak product-market fit, and eventually rebuilt around a model-agnostic router and CLI that developers actually wanted. He argues the future of software is a “dark factory” of asynchronous agents, with open models taking most token share and enterprises optimizing token spend like headcount.

Artwork for Anthropic's Katelyn Lesse & Angela Jiang: Building an Ecosystem, not a Walled Garden
Training DataKatelyn Lesse, Angela Jiang

Anthropic's Katelyn Lesse & Angela Jiang: Building an Ecosystem, not a Walled Garden

Anthropic’s platform team is building a layered developer stack for both internal products and external builders, with a roadmap that moves from knowledge and execution to coordination strategies. The guests argue for an open ecosystem built on standards like MCP and interoperable sandboxes, while keeping harnesses tuned to Claude rather than treating models as freely swappable commodities.

Artwork for Inside Zipline's Autonomous System: 140M Miles, Zero Incidents
Training DataKeller Rinaudo Cliffton, Eric Watson

Inside Zipline's Autonomous System: 140M Miles, Zero Incidents

Zipline’s founders argue the company is not a drone business but an autonomous logistics infrastructure layer, with the aircraft only a small part of a much larger system. The episode traces how that system scaled from Rwanda blood deliveries to millions of deliveries, zero safety incidents, and a path toward delivery economics that can beat cars.

Artwork for Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis
Training DataDylan Patel

Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis

Dylan Patel argues that AI’s biggest gains come from hardware-software-model co-design, not raw chip speed alone. He also makes the case that inference is becoming a giant market, and that benchmarking, supply chains, and data-center economics will determine who wins.

Artwork for Memory and Continual Learning: Engram's Dan Biderman and Jessy Lin
Training DataDan Biderman, Jessy Lin

Memory and Continual Learning: Engram's Dan Biderman and Jessy Lin

Engram’s Dan Biderman and Jessy Lin argue that AI’s real bottleneck is memory and continual learning, not raw intelligence. Their thesis is to bake company-specific knowledge into model weights so teams get faster, cheaper, more context-aware models that improve over time.

Artwork for Simulating Humans at Scale: Simile's Joon Sung Park
Training DataJoon Sung Park

Simulating Humans at Scale: Simile's Joon Sung Park

Joon Sung Park argues Simile is building a simulation layer for human society, not a superhuman reasoning model, by training on real behavioral data, interviews, surveys, and RCTs. He says the company can already use these models for concept testing, earnings-call simulation, and broader social-science questions, with a long-term vision of modeling large-scale societal dynamics.

Artwork for Google DeepMind's Logan Kilpatrick: Why the Model Eats the Harness
Training DataLogan Kilpatrick

Google DeepMind's Logan Kilpatrick: Why the Model Eats the Harness

Logan Kilpatrick argues Google’s next platform shift is from model-centric AI to agent harnesses that the model will increasingly absorb. He also says coding is already a form of narrow superintelligence, while Google’s multimodal Omni effort aims to collapse many separate media systems into one model.