AI Loves Data Podcast

From Prototype to Production, Engineering Enterprise AI That Actually Works

Episode Summary

In this episode of the AI Loves Data Podcast, we sit down with Sai Krishna Reddy Mudhiganti, Staff AI/ML Software Engineer at Samsung Semiconductor, to explore what it actually takes to move enterprise AI beyond the prototype and into production. Questions or Comments? Let us know: info@formulatedby.com

Episode Notes

Sai works across enterprise AI platforms, agentic systems, RAG, and document intelligence, designing intelligent systems that combine data, reasoning, and automation while remaining scalable, secure, and maintainable.

We go beyond the model itself to explore the engineering challenges surrounding modern AI systems, from retrieval and context management to agent orchestration, evaluation, observability, cost, latency, and production reliability.

Key Highlights:

• Why building an impressive AI demo is very different from engineering a system that can reliably support real enterprise users and workflows.
• The architectural decisions behind retrieval, chunking, reranking, context construction, and reliable enterprise knowledge systems.
• When agents make sense, how to orchestrate them, and how to avoid unnecessary complexity as agents gain access to more tools and workflows.
• How teams can measure multi-step AI systems and diagnose whether failures come from retrieval, reasoning, context, tools, or the underlying model.
• Balancing model capability with latency, infrastructure requirements, and the economics of running enterprise AI in production.
• How organizations can create maintainable AI platforms without becoming overly dependent on a single model or rapidly changing technology stack.

🎧 Tune in to Episode 70 to hear Sai Krishna Reddy Mudhiganti’s perspective on the engineering decisions that separate promising AI prototypes from reliable, production-ready enterprise AI systems.

Be sure to mark your calendars for the annual ALD SF on Nov 5. Join us for the Enterprise Builder’s conference to hear from experts on how AI is shaping the enterprise AI. Apply to attend for FREE: https://ailovesdata.com/san-francisco/