Your LLM Issues Are Really Data Issues
In a recent episode of the Stack Overflow Podcast, host Ryan Donovan interviews Harsha Chintalapani, co-founder and CTO of Collate and co-creator of Open Metadata. The discussion centers on the critical challenges Large Language Models (LLMs) face when interacting with real-time, structured production data. Chintalapani argues that many perceived AI failures are fundamentally data infrastructure problems, including schema changes, inconsistent semantic definitions, and weak data governance. Drawing from his extensive experience at Yahoo and Hortonworks, he explains how the industry has shifted from solving big data scaling issues to ensuring data utility and reliability for AI applications. The conversation highlights the importance of metadata management and observability in making data AI-ready. Collate, Chintalapani’s current venture, is introduced as a semantic intelligence platform designed to address these gaps through a semantic metadata graph. The article underscores that without robust data governance and clear semantic understanding, organizations struggle to derive accurate business insights and effective ML models from their data ecosystems.
Wire timeline
Your LLM Issues Are Really Data Issues
In a recent episode of the Stack Overflow Podcast, host Ryan Donovan interviews Harsha Chintalapani, co-founder and CTO of Collate and co-creator of Open Metadata. The discussion centers on the critical challenges Large Language Models (LLMs) face when interacting with real-time, structured production data. Chintalapani argues that many perceived AI failures are fundamentally data infrastructure problems, including schema changes, inconsistent semantic definitions, and weak data governance. Drawing from his extensive experience at Yahoo and Hortonworks, he explains how the industry has shifted from solving big data scaling issues to ensuring data utility and reliability for AI applications. The conversation highlights the importance of metadata management and observability in making data AI-ready. Collate, Chintalapani’s current venture, is introduced as a semantic intelligence platform designed to address these gaps through a semantic metadata graph. The article underscores that without robust data governance and clear semantic understanding, organizations struggle to derive accurate business insights and effective ML models from their data ecosystems.
Stack Overflow Blog