About this episode
In Season 2, Episode 27 of Faces in FinOps, host Stephen Old sits down with Adam Richter, Senior Optimization Solutions Architect on the AWS OPTICS team, to unpack the intersection of AI and FinOps. Together, they explore the dual lenses of AI for FinOps—using AI to enhance automation and insight—and FinOps for AI—applying financial operations discipline to manage the rapidly evolving costs of AI workloads.
Adam shares real-world guidance on managing GPU utilization, optimizing token consumption, leveraging techniques like RAG (Retrieval-Augmented Generation), and aligning AI costs to business value.
The conversation offers a grounded look at how FinOps principles can bring clarity and control to the complex economics of AI.
👉 Listen now to discover how AWS and FinOps teams are shaping the future of intelligent, value-driven cloud operations.
Key insights include:
- FinOps for AI and AI for FinOps are converging: While AI workloads feel new, the core FinOps principles still apply—compute is compute, and cost visibility, consumption patterns, and efficiency remain the foundation.
- Token efficiency is the new optimization frontier: Prompt quality, model choice, verbosity control, and context management can dramatically impact cost—sometimes by 20× or more.
- RAG drives smarter, more cost-effective AI: Retrieval-Augmented Generation lets teams enrich models with private context without expensive retraining, but requires good data hygiene to stay efficient.
- Visibility is non-negotiable: Understanding GPU utilization, inference patterns, and workload behavior unlocks rightsizing, higher utilization, and better alignment of AI costs to real business value.
Adam’s final thought is simple and foundational: get visibility in place as soon as possible—because you can’t manage AI costs, performance, or value if you can’t measure them.
Much thanks to Adam for such a great conversation, and we look forward to Pt. 2 in the near future!
Whether you are new to #FinOps or a seasoned pro, this episode has something for everyone so tune in to the Faces in FinOps Podcast today.
“Faces in FinOps” is powered by ProsperOps.
The Faces in FinOps podcast features candid conversations with practitioners, influencers, and thought leaders in cloud financial management.
Subscribe
Subscribe to the Faces in FinOps podcast on YouTube: @FacesInFinOps
