Insights

From the field, not from theory.

Process AutomationObservabilityQueuesReliability

The dead-letter silence that masked our automation failure

Our invoice pipeline silently dropped 4% of events into a dead-letter queue nobody watched. Six weeks later, the finance team noticed. Here is the observability gap and the polling fix that caught it.

GEOAI SearchMeasurementContent Strategy

The GEO citation horizon: where recency beats authority

We tracked 1,200 brand citations across Perplexity and AI Overviews. Pages older than 90 days saw citation rates drop by 74%, regardless of domain authority. Recency is the new ranking signal.

AI AgentsProductionCost ControlMemory

The scratchpad accumulation that broke our agent budget

Our research agent kept appending intermediate reasoning to its context window. After 12 tool calls, the scratchpad hit 9k tokens, turning every subsequent LLM call into a budget-crushing expense.

Generative AIProductionCost ControlSemantic Search

The few-shot prompt bloat that broke our semantic cache

Adding eight few-shot examples improved our classification accuracy by 14%. It also collapsed our semantic cache hit rate from 82% to 11%. Here is how we measured the bleed and rebuilt our cache boundaries.

Custom SoftwareSecurityProductionPostgres

The tenant isolation gap that broke our shared database

We saved weeks by sharing a Postgres instance across SME tenants. Then one customer ran a bulk export, and row-level security locks starved every other query on the server.

Generative AIProductionBrand ControlEvals

The constrained sampling trap that halved our completions

Forcing temperature to zero seemed like the obvious fix for brand consistency. It also cut our usable generation rate in half, replacing creative variance with repetitive dead ends.

Data IntelligenceRAGpgvectorReliability

The rerank precision tax that tripled our RAG latency

Adding a cross-encoder reranker lifted our RAG recall from 68% to 89%, but the synchronous inference call tripled p99 latency. Here is the asymmetric retrieval pattern that cut delay without surrendering quality.

Process AutomationReliabilityCircuit BreakersObservability

The circuit breaker that saved our automation from an API ratelimit cascade

When a downstream API tightened rate limits, our deterministic pipeline retried itself into a 4-hour backlog. A per-key circuit breaker cut recovery time from hours to 90 seconds.

GEOAI Searchllms.txtMeasurement

The llms.txt citation gap: why your neatly structured answers go uncited

We wired up llms.txt and structured our FAQ schema perfectly. ChatGPT read it. Then it cited Wikipedia instead. Here is why structured answers alone do not win GEO citations.

AI AgentsProductionReliabilityCost Control

The tool-call context window that quietly crippled our agent

Autonomous agents accumulate tool results until they hit the context limit and silently truncate system instructions. We fixed it by capping the working memory. Here is the exact threshold we chose.

AI AgentsProductionCost ControlReliability

The token burst that crippled our agent loop

Our multi-step agent hit a 94-token retry that bloated to 3,100 tokens per run. The culprit was not the LLM, but an unbounded context accumulation strategy we forgot to cap.

Custom SoftwareBuild vs BuySecurityProduction

The SME tenant migration trap: why your build-vs-buy auth forgot the data layer

We bought an auth SaaS to handle roles and logins. It worked perfectly until we needed to migrate a 12-tenant database schema. The real build-vs-buy gap is never the login form; it is the data layer.

Generative AIProductionCost ControlStructured Outputs

The structured output schema that doubled our token bill

Forcing LLMs into strict JSON schemas feels safe, but the hidden token cost of schema repetition and refusal loops will quietly destroy your unit economics. Here is how we measured and fixed it.

Data IntelligencepgvectorRAGReliability

The HNSW probe budget that tanked our RAG latency

Switching to pgvector HNSW cut our index build time by 80% but spiked RAG p99 latency to 4.2 seconds. The culprit was a single default we failed to override for production queries.

Process AutomationReliabilityQueuesIdempotency

The idempotency key saved our automation from a queue replay

When our message broker replayed 12,000 events overnight, only 14 duplicate actions escaped. Here is how idempotency keys turned a costly incident into a minor log entry, and the implementation pattern we now mandate.

GEOAI SearchMeasurementLLMs

The brand mention variant problem in GEO measurement

AI engines cite you in ways you never planned. We tracked 12 unexpected mention variants across Perplexity and ChatGPT, revealing a massive blind spot in standard GEO tracking.

AI AgentsProductionReliabilityCost Control

Cheaper to rollback: checkpointing in multi-step agent loops

When an LLM tool call fails halfway through a ten-step agent run, re-running from scratch doubles latency and cost. Checkpointing state at each step cut our retry spend by 62%.

Semantic SearchEmbeddingsProductionEvals

The embedding drift that broke our semantic search

We swapped an embedding model to cut latency by 40ms. Three weeks later, recall silently dropped 18%. Here is the exact measurement that caught it and the reindexing trade-off we chose.

Custom SoftwareBuild vs BuySecurityProduction

The SME build-vs-buy decision that actually matters: authentication and authorization

Most SMEs treat auth as a solved problem you just outsource. Here is why building custom access control cost us 40 hours upfront but saved 200 hours of integration hell later.

Generative AIRAGEvalsProduction

The grounded assistant trade-off: precision at 96 %, recall at 41 %

Raising citation strictness to 96 % precision in grounded assistants cuts useful recall to 41 %. Here is how we calibrate the threshold and why 85 % precision is the pragmatic ceiling for most enterprise copilots.

EvalsGuardrailsProduction

Evals and guardrails: shipping LLM features you can defend

Moving an LLM feature from demo to production requires more than prompt tweaks. Without structured evaluations and guardrails, you are deploying an unpredictable system and hoping for the best.

AI VideoProductionMethod

An AI-generated TV spot in 48 hours: the method

From blank page to a broadcast-ready 15-second master: the exact timeline of a disciplined generative video production — visual anchoring, multi-shot generation, licensed audio.

GEOSEOAI

GEO: getting cited by AI engines is the new SEO

ChatGPT, Perplexity and AI Overviews now answer instead of your pages. Generative Engine Optimization decides whether you are their source — or their blind spot.

AI AgentsProductionReliability

AI agents in production: what actually breaks (and how to prevent it)

Agent demos impress; production forgives less. Lessons from eighteen months of agents in continuous operation: real failures, guardrails that work.