(2:05)LoRA origins — Edward describes the practical need that led to the creation of LoRA at Microsoft in 2021 while collaborating with OpenAI

(6:50)Why LoRA worked — Low-rank updates to large models made fine-tuning efficient and widely accessible

(9:45)Biological analogy — LoRA as the equivalent of learning a new instrument with shared prior knowledge

(11:35)Industry adoption — Edward reflects on companies thanking him for saving compute costs and resource usage

(13:30)Intelligence as compression — Discussion of whether brains and AI share a compression-based structure for learning

(17:15)Risks of over-biological inspiration — Why not everything in AI needs to imitate the brain

(18:45)MuTransfer explained — Training stability via infinite-width theoretical insights and their practical payoff

(23:00)Real-world impact of MuTransfer — Especially valuable for massive models at top labs like OpenAI, Anthropic

(26:30)The joy of theory with impact — The rare but powerful moment when theory turns into applied breakthrough

(28:05)Training trillion-parameter models — How MuTransfer enables precise hyperparameter prediction at scale

(30:30)Edward’s path — From Microsoft to PhD with Yoshua Bengio to OpenAI and now entrepreneurship

(34:00)Why leave OpenAI? — Personal itch for autonomy and new challenges, despite leaving pre-vesting

(37:20)From researcher to founder — Edward’s shift to launching multiple ventures with strong partners

(41:00)“Tech alone isn’t enough” — Why proprietary data + distribution is the real edge for AI startups

(44:00)Vertical vs horizontal plays — Studio model allows broad application of AI in many industries

(46:40)Laura-as-a-metaphor — Marc proposes a meta analogy: Edward as the foundation, fine-tuned by domain experts

(49:25)The fall of engineering costs — Why software is easier to build than ever, and what that unlocks

(52:00)The new venture model — VCs must adapt to a world with lower costs and smaller teams

(55:45)Edward’s self-awareness — On knowing his strengths and staying in his zone of genius

(57:10)The Compute Exchange — Edward unveils a new project: a dynamic GPU auction platform for buyers and sellers

(1:00:20)Compute is the new oil — Making GPU access as transparent and efficient as financial markets

(1:02:10)On IP and creator rights — Edward’s take on respecting creativity, compensating artists, and not undermining the creative industry

(1:06:00)The soul in human creation — Machines may be good imitators, but creativity may still be uniquely human

(1:08:00)Recommended Reading — Edward recommends The Creative Act: A Way of Being by Rick Rubin as a meditation on creativity across disciplines

(1:10:15)Outro — Marc reflects on Edward’s polymath career arc and cross-industry potential