Semantic Caching for LLM Calls in .NET 10: When “Close Enough” Is a Bug
A plain similarity threshold can replay the answer to “cancel my order” when someone asks “do not cancel my order”. This article builds a semantic cache on Microsoft.Extensions.AI that serves an earlier answer only when it’s safe. It runs offline with fake models, so your CI never needs an API key.