FROM THE TRENCHES Issue №310

Practical decisions for AI and software

Technical guides to choose models, verify software and plan delivery.

Latest articles

New comparisons, practical guides and engineering lessons.

Hardware memory blocks ranked against local LLM model sizes AI & Agents

llmfit Guide: Which Local LLM Fits Your Hardware?

Use llmfit to rank local models before downloading them. Learn what its fit, speed, quality and context scores mean, where estimates can mislead, and how to turn a recommendation into a production decision.

Claude Code orchestrating GPT-5.6 Sol through a local CLIProxyAPI gateway AI & Agents

CLIProxyAPI: Run GPT-5.6 Sol Inside Claude Code

Keep Claude Code’s agent harness and route the model calls to GPT-5.6 Sol. This copy-paste setup fixes the incomplete viral alias, locks down the proxy, and shows how to verify every layer.

Floci, LocalStack and AWS SAM compared for local AWS integration testing Delivery & QA

Floci vs LocalStack: AWS Emulator Review for CI in 2026

A fact-checked buyer guide to Floci, LocalStack, AWS SAM and real AWS: fidelity, service coverage, licensing, CI fit and a low-risk migration test.

A voice waveform splitting between a managed Miso TTS API and a private self-hosted GPU AI & Agents

Miso TTS Self-Hosted vs API: Cost, Latency and VRAM Reality

Miso TTS is expressive and open-weight, but the 110 ms claim belongs to its hosted H100 API, not local inference. Compare hardware, pricing, licensing and production risk before choosing.

An MCP client presents an audience-bound token to a resource server that validates it against an identity provider before any tool runs AI & Agents

Enterprise MCP Authorization Architecture

OAuth 2.1, audience-bound tokens and no token passthrough are the spec’s hard rules. The rest, multi-tenant isolation, per-tool scopes, delegated access and audit, is a reference design. Here is the whole trust boundary in two diagrams.

EU AI Act Article 50 transparency obligations mapped to a build checklist for SaaS chatbots, AI agents and generated content Business & Regulation

EU AI Act Article 50 Checklist for SaaS and AI Agents

Article 50 has applied since 2 August 2026. Audit chatbot and agent disclosures, machine-readable marking, deepfake labels, public-interest text, logging, and the evidence kept for enforcement.

Data-oblivious vector quantization turning float32 embeddings into raw 2-bit codes with 16x fewer bytes AI & Agents

Compress RAG Vectors to 2 Bits: Is Data-Oblivious Quantization Production-Ready?

TurboQuant now ships in Qdrant 1.18, while TurboVec has reached 1.0. Learn what the 16x figure applies to, how current benchmarks compare, and what to test.

Eight isolated per-rank KV caches on one server collapsing into a single shared host-side cache layer that every serving process can read AI & Agents

LMCache Reported 13.7x Lower Mean TTFT with a Shared KV Cache

LMCache reported mean time-to-first-token falling from 3.98s to 0.29s in one multi-turn Qwen3-235B benchmark. Here is what the result shows, what it does not prove, and how to test reuse on your own workload.

Lossless BF16 weight compression compared with 8-bit GGUF quantization across exactness, runtime evidence and production readiness AI & Agents

Lossless LLM Weight Compression vs 8-bit GGUF: What Is Ready for Production?

A fact-checked decision guide to the GLM-5.2 result, exact BF16 decoding, Q8 quantization, prior systems, runtime evidence, fleet economics and a 14-day pilot.

Inbox, without the noise

Get the next field note

One concise email when we publish. No tracking pixels, and no inbox filler.