Simor

Data Infrastructure for Production AI

Practical writing on AI data engineering, feature stores, and the infrastructure choices that determine whether AI systems work in production.

LLM cost calculator: estimating spend before you deploy
LLM cost calculator: estimating spend before you deploy
30 Aug, 2026 | 05 Mins read

Teams approve LLM projects based on per-query cost estimates, then get blindsided by the actual invoice. The gap between estimate and reality is not a rounding error. It is a structural problem: the e

Fine-Tuning vs RAG vs Prompt Engineering: Decision Framework
Fine-Tuning vs RAG vs Prompt Engineering: Decision Framework
29 Aug, 2026 | 14 Mins read

Teams new to applied AI often fixate on which foundation model to use. The more important decision is how to shape the model's behavior for your specific task. The three primary levers are prompt engi

Agentic: The Self-Managing Team
Agentic: The Self-Managing Team
28 Aug, 2026 | 09 Mins read

You manage a software team. You do not assign every task. You do not review every decision before it is made. You set the objectives, define the constraints, and trust the team to plan its own sprint,

Embedding models compared: OpenAI, Cohere, Voyage, and open-source options
Embedding models compared: OpenAI, Cohere, Voyage, and open-source options
27 Aug, 2026 | 04 Mins read

Choosing an embedding model is one of the first decisions you make when building a retrieval-augmented generation system, and it is one of the hardest to reverse. The model you pick determines your ve

The craft of data engineering: why fundamentals still matter in the AI age
The craft of data engineering: why fundamentals still matter in the AI age
26 Aug, 2026 | 04 Mins read

Every few months, someone declares that a new tool has made data engineering obsolete. First it was managed warehouses. Then dbt. Then generative AI that writes SQL. Each time, the prediction is the s

The data catalog project that actually stuck — 18 months later
The data catalog project that actually stuck — 18 months later
25 Aug, 2026 | 07 Mins read

Most data catalog projects die within six months. The tool gets purchased, a team populates it with metadata for a few hundred tables, enthusiasm fades, and twelve months later the catalog is a stale

The future of the data engineer: 5 predictions for 2030
The future of the data engineer: 5 predictions for 2030
24 Aug, 2026 | 05 Mins read

Predictions about technology roles are usually wrong in predictable ways. They overestimate the speed of change, underestimate the persistence of legacy systems, and assume that technical trends will

Building an internal AI platform team: org chart and responsibilities
Building an internal AI platform team: org chart and responsibilities
23 Aug, 2026 | 07 Mins read

The decision to centralize AI infrastructure into a platform team usually comes after a period of decentralized pain. Three product teams independently built model serving pipelines. None of them shar

From copilot to autopilot: the autonomy spectrum debate
From copilot to autopilot: the autonomy spectrum debate
22 Aug, 2026 | 04 Mins read

The framing of AI systems as either "copilots" (human-in-the-loop, AI assists) or "autopilots" (human-out-of-the-loop, AI acts independently) has dominated the conversation about AI autonomy for two y