TopicPartition
Podcast Description
A in-depth engineering podcast about Apache Kafka
Podcast Insights
Content Themes
Covers advanced topics related to Apache Kafka with a special emphasis on architectural innovations like KIP-1150, as well as discussions on data replication, batch coordination, and latency requirements. Episodes delve into specific concepts like diskless topics, caching strategies, and the implications of open-source contributions.

A in-depth engineering podcast about Apache Kafka
Introducing Omnigraph – an open source, schema-first, lakehouse-native context graph engine built on Rust, Lance, Apache Arrow and DataFusion. It is S3-native infrastructure built to solve the problem of agent coordination.Omnigraph caught my attention so I brought the two authors to the podcast – Andrew Altshuler and Ragnor Comerford. It was a very densely-packed conversation where we covered everything around modern day AI engineering, including:- why a schema-first is a must for agents- the importance of guardrails in autonomous workloads (schemas, tests, linters, policies, and type systems)- what Omnigraph is, and how its being built/dogfooded at Modern Relay / how Slack + Linear start to break down with many parallel agents- how Lance, DataFusion, Arrow, and object storage fit perfectly into the open AI data stack- why proper agent coordination looks more like decentralized decision making than central planning- the importance of good taste (when agents can implement almost anything)- why AI massively compresses business timelines- and a lot more0:00 Why build a graph database for agents?5:43 Why not Postgres? (or any relational database)17:03 The composable ”company brain” substrate for agents20:51 Need for guardrails for agents (eg type safety)27:00 Importance of Schemas33:48 NoSQL vs SQL42:46 Lance, DataFusion, and Arrow as the open stack51:00 What Modern Relay and OmniGraph are52:13 Branches: GitHub for agent-written data1:00:59 Slack Agents, the Dependency Graph and decoupling for parallelization1:12:32 Why Graphs are great and a 2yr prediction1:17:32 Centralization vs decentralization for long-horizon coordination————————————MODERN RELAYhttps://modernrelay.com/ANDREW• GitHub: https://github.com/aaltshuler• X: https://x.com/1eo/• LinkedIn : https://www.linkedin.com/in/aaltshuler/RAGNOR• GitHub: https://github.com/ragnorc• X: https://x.com/ragnorco————————————TRANSCRIPTPaste into your favorite LLM- https://gist.github.com/stanislavkozlovski/70d5663466f19a247b336437ea2a968d– https://gist.githubusercontent.com/stanislavkozlovski/70d5663466f19a247b336437ea2a968d/raw/003ae11c2e70fba76ccaad182e17c9b9389b3db9/modern_relay.md
————————————If you found anything useful from this episode, please consider supporting our growth (so we can continue delivering valuable content). You can do this by simply liking the video. It takes 2 seconds to do, and recording/producing this takes us 8hrs+

Disclaimer
This podcast’s information is provided for general reference and was obtained from publicly accessible sources. The Podcast Collaborative neither produces nor verifies the content, accuracy, or suitability of this podcast. Views and opinions belong solely to the podcast creators and guests.
For a complete disclaimer, please see our Full Disclaimer on the archive page. The Podcast Collaborative bears no responsibility for the podcast’s themes, language, or overall content. Listener discretion is advised. Read our Terms of Use and Privacy Policy for more details.