Browsing: Llm

Picture an agent that answers questions about customer invoices. It has one tool, a lookup against an internal API, and a task that needs four lookups. The first two go through fine. Then the credential behind that API expires, and every call from the third one onward comes back as a 401.

I spent years studying general relativity theory since the beginning of my PhD student life. One of the things that make GR different from classic mechanics is:

Benjamin Nweke described a failure that took him three weeks to notice. He had turned on Structured Outputs for a pipeline that parsed payment confirmation messages into transaction records, and his reconciliation job started flagging a small, steady stream of mismatches — a couple of percent of a week’s volume. Not crashes. Not malformed rows.…

Retrieval-augmented generation (RAG) answers questions using information retrievedfrom a set of documents. That document collection is called a corpus. A typical evaluationsends a well-written question to a tidy corpusand checks whether the retriever returns the correctpassage.

On August 2, 2026, Anthropic began watermarking every piece of text Claude produces. Since 2024, Gemini (Google) has used SynthID-Text, a method they published in Nature and later open-ed labels on AI-generated content since September 2025, and nearly 190 organizations have signed the EU’s transparency code

Every major inference framework shipped prefill-decode disaggregation this year. NVIDIA built it into Dynamo. SGLang made it the default for large-scale deployments. vLLM added a KV connector API to support it natively. The consensus is forming fast: split your prefill and decode onto separate GPU pools, and throughput improves.