Women in AI Research (WiAIR)
Women in AI Research (WiAIR)
Podcast Description
Women in AI Research (WiAIR) is a podcast dedicated to celebrating the remarkable contributions of female AI researchers from around the globe. Our mission is to challenge the prevailing perception that AI research is predominantly male-driven. Our goal is to empower early career researchers, especially women, to pursue their passion for AI and make an impact in this rapidly growing field. You will learn from women at different career stages, stay updated on the latest research and advancements, and hear powerful stories of overcoming obstacles and breaking stereotypes.
Podcast Insights
Content Themes
The podcast focuses on topics such as bias in AI, the limitations of transformer models, and the personal journeys of women in AI research. Episodes include discussions on the social implications of AI, technical challenges in language models, and the overall impact of diverse voices in the AI field.

Women in AI Research (WiAIR) is a podcast dedicated to celebrating the remarkable contributions of female AI researchers from around the globe. Our mission is to challenge the prevailing perception that AI research is predominantly male-driven. Our goal is to empower early career researchers, especially women, to pursue their passion for AI and make an impact in this rapidly growing field. You will learn from women at different career stages, stay updated on the latest research and advancements, and hear powerful stories of overcoming obstacles and breaking stereotypes.
Can a language model learn a language no human ever could? Stanford PhD researcher Julie Kallini put Noam Chomsky's claim to the test, and won the ACL 2024 Best Paper Award for it.
In this episode of Women in AI Research, Julie takes us from ”impossible languages” to the hidden costs of tokenization, and shows how byte-level models could make LLMs faster, fairer across languages, and smarter about where they spend compute. We also talk about choosing a PhD advisor, leaving a software engineering job at Meta for a PhD, and what doing research at FAIR is really like.
In this episode:
- Why it would be unethical to raise a child on an invented language, but not a language model
- Why linguists still can't agree on what makes a language ”impossible”
- Why ChatGPT couldn't count the R's in ”strawberry”, and what tokenization has to do with it
- How tokenization can make the same request cost more in some languages than others
- MrT5: teaching a byte-level model to decide which bytes it can safely drop
- Fast BLT: speeding up byte-level generation with diffusion and self-speculation
- Diffusion vs. autoregressive generation: practical advice for practitioners
- What's next: adaptive compression, or why spend dozens of tokens on the MIT license?
📄 Papers discussed
- Mission: Impossible Language Models (ACL 2024, Best Paper)
- MrT5: Dynamic Token Merging for Efficient Byte-level Language Models (ICLR 2025)
- Fast Byte Latent Transformer
- Byte Latent Transformer: Patches Scale Better Than Tokens (Meta FAIR)
- Information Locality as an Inductive Bias for Neural Language Models (Someya et al., ACL 2025)
👩🔬 About Julie Kallini
Julie is a fourth-year Computer Science PhD student at Stanford, advised by Chris Potts and Dan Jurafsky. Her research spans computational linguistics, tokenization, efficient language model architectures, and byte-level modeling.
🎙️ About WiAIR
Women in AI Research (WiAIR) features in-depth conversations with women shaping AI research: their work, their ideas, and the paths that led them there.
🔔 Subscribe for new episodes

Disclaimer
This podcast’s information is provided for general reference and was obtained from publicly accessible sources. The Podcast Collaborative neither produces nor verifies the content, accuracy, or suitability of this podcast. Views and opinions belong solely to the podcast creators and guests.
For a complete disclaimer, please see our Full Disclaimer on the archive page. The Podcast Collaborative bears no responsibility for the podcast’s themes, language, or overall content. Listener discretion is advised. Read our Terms of Use and Privacy Policy for more details.