Skin in The Game with Debbie Go

LLM Trust Trap: Why Natural Language Bypasses Critical Thinking | Skin in the Game with Amit Shivpuja

• Season 2 • Episode 3

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 35:22

There is a paradox emerging in the age of Generative AI.

Business leaders are trained to be skeptical of raw data. They question spreadsheets. They interrogate dashboards. But the moment that same data is wrapped in a conversational sentence by an LLM? The skepticism vanishes.
In the latest episode of Skin in the Game, I sat down with Amit Shivpuja (Director of Data Product & AI Enablement @ Walmart) to discuss why our biggest AI challenge isn't the technology—it's the misplaced trust that comes with a friendly chat interface.

As Amit put it:
"People tend to put a lot more trust in the system than they would normally do. They're a little skeptical if you give them a table of numbers, but if you write them a sentence saying the answer is X, they tend to trust it. It's on us to show them how we came up with the answer, not just give them a number."


We also explored a fascinating case from his VR days where survey data (what people said) completely contradicted usage data (what people did). The lesson? Whether you are dealing with human feedback or AI output, validation is non-negotiable.

If your organization is racing to adopt AI tools, this conversation is a vital reality check. We dig into:

  • The "Data Sandwich" framework for building trustworthy systems
  • How to build trust through radical transparency
  • Why accountability must always remain with the human

🔗 Links & Resources:

  • linkedin.com/in/amitshivpuja
  • datacompass.substack.com

📺 Watch on YouTube: youtu.be/o6n5IP_Z2DY

What makes YOU trust an AI output? Is it the authority of the tone, or the transparency of the source?. Drop your thoughts below. 👇

#AI #DataGovernance #DigitalTransformation #Leadership #GenerativeAI #Walmart #DataIntegrity #StanfordLEAD #stanfordgsb #SkinInTheGamewithDebbieGo

Enjoying the podcast? Leave us a quick review!

Support the show

Follow Us:

People on this episode

Podcasts we love

Check out these other fine podcasts recommended by us, not an algorithm.

Think Fast Talk Smart: Communication Techniques Artwork

Think Fast Talk Smart: Communication Techniques

Matt Abrahams, Think Fast Talk Smart
Grit & Growth Artwork

Grit & Growth

Stanford Graduate School of Business
View From The Top Artwork

View From The Top

StanfordGSB