David vonThenen

When token costs get expensive.... you gotta do, what you gotta do 🤣

LLMs don't run out of compute first… they run out of memory. 🤯🧠
KV cache, memory tiering, and shared storage are reshaping the economics of AI inference. I break down what's happening inside systems like vLLM + LMCache.

Read more: https://bit.ly/4bl87kn

#AIInference

People love AI demos… until production hits. 😅

On the Automate or Die Trying podcast, we break down the real challenges of enterprise AI: RAG accuracy, agent security, governance, and why "similarity" ≠ correctness in production.

Watch the episode: https://bit.ly/3PxRryI

Spent years chasing bigger models… turns out smarter engineering wins. 🚀
I joined the @_odsc AI X Podcast to talk about real-world production AI: RAG failures, quantization, SLMs, and building efficient systems that actually ship. 🎧

Listen here: https://bit.ly/4ssrdMm

#AI

@socallinuxexpo starts tomorrow!

I'll be presenting:
• A Practical Guide to Training a Small Language Model: https://bit.ly/3LkKjo0
• The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend: https://bit.ly/4rlTiEP

Sneak peek below 👇

Bigger models used to win headlines. Now they win power bills ⚡

On the @odsc.bsky.social blog, I break down how quantization and specialized SLMs are reshaping agentic AI around efficiency, not ego. It's about value per watt, not parameter count 🚀

Read here: https://bit.ly/4s6iKye

Excited to join @WDI_conference 2026 🎉 My VoD session, “Rethinking RAG: How MCP and Agent2Agent Will Transform the Future of Intelligent Search”, dives into governance, grounding & multi-agent design 🚀

Register: https://bit.ly/474WJrs
Code: WID26SP20 🎟️

#GenAI

1 week until @socallinuxexpo.bsky.social

Session: The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend
https://bit.ly/4rlTiEP

Session: A Practical Guide to Training a Small Language Model: Tokenizers, Training, and Real-World Pitfalls
https://bit.ly/3LkKjo0

Excited to share that my talk was accepted for @devoxx.fr. I'll be presenting "The Sound of Your Secrets: Teaching Your Model to Spy So You Can Learn to Defend," all about acoustic side-channel attacks and defenses.

More details: https://www.devoxx.fr/