Automatic Data Pipelining: One More Turtle Ahead

About this episode

The episode discusses the complexities of enterprise data management and the disconnect between data collectors and business consumers.

Share Episode                     We grabbed Donald Nguyen, co-founder and CTO at Corvic, to discuss the absurd complexities of enterprise data and multimodal inference. We explore how organizations habitually hoard mountains of useless, "dead" data just out of the sheer fantascy that someone might ask for it later. We highlight the fundamental disconnect where data collectors using tools like Airbyte and Kafka speak a completely different language than the business consumers analyzing it in Excel.           True scale isn't just about managing petabytes; it's the absolute nightmare of extracting subjective business meaning from flat PDFs and invoices. In the deep-end of vector embeddings, we're challenging translating data into a different semantic universe requires imposing a heavy business bias. Auditors and artists will view the exact same invoice completely differently, meaning your embedding model selection is incredibly subjective to the business context.           The industry's desperate search…

People in this episode

Hosts: Will Button, Warren Parad

Guest: Donald Nguyen

Topics covered

• data pipelining
• enterprise data
• multimodal inference
• data management
• AI in business
• data analysis

Keywords

• data pipelining
• enterprise data
• multimodal inference
• AI
• data analysis
• Airbyte
• Kafka
• LLM

Mentioned in this episode

Organizations: Corvic

Products: Airbyte, Kafka, LLM

More episodes of Adventures in DevOps

• DR: Staying resilient in the cloud · June 5, 2026 · 1h 5m
• Eat your security vegetables · May 29, 2026 · 59 min
• The Human Value Versus AI Legacy Code · May 11, 2026 · 1h 5m
• Who needs a server? · May 1, 2026 · 55 min
• How to build a monolith the right way · April 24, 2026 · 45 min
• Infrastructure as code: why you can never avoid thinking · April 17, 2026 · 53 min