Back to Ideas

By Simons Chase

August 2026

The Missing Layer

The industry's complete AI stack has no layer for conversation.

Vaidehi, the complete AI engineering stack

A diagram is making the rounds on X: the "complete AI engineering stack." Nine layers — LLMs, RAG, vector databases, agent frameworks, MCP, memory, observability, security, automation. Thirty-six thousand people saved it. It is a reasonable map of what the industry is building.

Look closer and something is missing. There is no layer for conversation.

Nine layers describe what the machine does internally: retrieve, orchestrate, remember, observe itself. Not one describes the surface where a human actually meets the system — the turn-taking, the voice, the held role, the arc of an exchange that builds toward something neither party said in the first minute. The industry's self-portrait has no face.

This is not a small omission. Conversation is where AI is going. The text box was a transitional interface — a concession to what the technology couldn't yet do. As models leave the text box, the qualities that matter shift: not just whether an answer is correct, but whether the system can hold its position under pushback, stay coherent across a long exchange, answer the question that was never directly addressed without inventing a position its source never held. None of the nine layers measures any of that. Neither do the benchmarks. Standard evaluation scores answers whose support already exists in the corpus — useful for the floor, blind to the surface.

I know this blindness from the inside, because I fell into it. The first version of our own internal selflet had every layer on that diagram — retrieval, memory, observability, security, the works — and it was still bad. Not broken: bad. It answered like a filing cabinet with a voice. What fixed it wasn't a tenth layer. It was moving the thinking to where thinking belongs and shrinking the machinery to the few things machinery does best. The diagram tells you what to buy. It does not tell you where the thinking should live, or how you'd know if the conversation was any good. Those two questions are the whole game, and they appear on no map.

That absence is the wedge. When an industry's entire instrument set — its benchmarks, its stacks, its saved-and-shared diagrams — cannot see a surface, that surface is unpriced. Either it doesn't matter, or it hasn't been claimed yet. Our evidence says the latter: the one paying customer we point to didn't buy retrieval; they bought a system that holds a role through a difficult exchange, with a record proving it did. That is a conversational product, evaluated as conversation, and nothing on the nine-layer map knows how to build or judge it.

The stack diagrams will catch up eventually. Maps always do — after the territory is taken.