AI Engineering — page 4 of 4
- AI Engineering6 min
The 43x You Accept for the 0.66x
By Petru Popa ·Cloudflare published @cloudflare/computer, an agent runtime that routes work between isolates and containers. Its own performance doc says the filesystem beats real disk on metadata and runs up to 43x slower on bulk bytes. That ratio, not the container bill, is the adoption question.
Read - AI Engineering6 min
The CPU Serving Speedup You Won't Measure
By Petru Popa ·vLLM reports up to 6.2x throughput on Arm CPUs. The baseline is code from before the first Arm wheel shipped, and the fastest configuration is a quantization pipeline rather than a flag. What that changes for capacity planning this quarter.
Read - AI Engineering6 min
Your Eval Sandbox Is a Sentence in the Prompt
By Petru Popa ·Anthropic reviewed 141,006 cyber-evaluation runs and found six that reached real systems. Reading the reference harness for one of the benchmarks it names shows the isolation was never enforced anywhere except the prompt.
Read - AI Engineering5 min
The Config Field Was an Interpreter
By Petru Popa ·A four-and-a-half-day intrusion started with a dataset config field that got rendered by a template engine. The bug is ordinary. What it reached afterwards is the part worth reading twice.
Read - AI Engineering6 min
A Faster Encoder, If Your Inputs Are Long Enough
By Petru Popa ·Two new encoder models claim a 3.7x speedup over ModernBERT-base on CPU at long context. The speed claim describes a narrow regime, and the license on the model repository caps commercial use at $10 million in annual revenue — which settles the decision for any company above that line before the crossover point matters.
Read - AI Engineering2 min
From PoC to Production: The AI Gap Nobody Budgets For
By Petru Popa ·The proof-of-concept worked. Now comes the 80% no one scoped: evaluation, integration, monitoring, and cost. A practical checklist for getting AI into production.
Read