Simor

Data Infrastructure for Production AI

Practical writing on AI data engineering, feature stores, and the infrastructure choices that determine whether AI systems work in production.

Embeddings: GPS for Words
Embeddings: GPS for Words
20 Jun, 2025 | 05 Mins read

Embeddings assign numerical coordinates to words and concepts. "Cat" sits near "kitten" and "feline" but far from "airplane." "Paris" neighbors "France" and "Eiffel Tower" but distances itself from "T

Cosine Similarity: The Handshake Angle
Cosine Similarity: The Handshake Angle
13 Jun, 2025 | 04 Mins read

At a networking event, watch how people greet each other. Some reach straight out for a firm handshake. Others angle up for a high-five. A few go low for a fist bump. Measure not the style of greeting

Edge AI Pipelines: Streaming Data from Sensors to Micro-Models
Edge AI Pipelines: Streaming Data from Sensors to Micro-Models
13 Jun, 2025 | 06 Mins read

A turbine failed catastrophically at a wind farm. Vibration sensors had detected anomalies weeks earlier. By the time sensor data traveled from remote turbines to central data centers, got processed b

Parquet vs ORC: Suitcase vs Trunk
Parquet vs ORC: Suitcase vs Trunk
06 Jun, 2025 | 04 Mins read

Packing for a month-long trip. Do you use a suitcase with clever compartments, compression bags, and built-in organization? Or a trunk with adjustable dividers, heavy-duty locks, and industrial-streng

Column Stores: The Vertical Filing Cabinet
Column Stores: The Vertical Filing Cabinet
30 May, 2025 | 04 Mins read

Reorganize an enormous filing cabinet. Instead of keeping complete employee records in manila folders (one folder per person with all their information), you create specialized drawers: one for all sa

CRDTs: The Cooperative Sketchpad
CRDTs: The Cooperative Sketchpad
23 May, 2025 | 04 Mins read

A magical sketchpad shared by artists around the world. Each artist has their own copy, draws whenever inspiration strikes, and somehow - without talking to each other, without a master artist coordin

Feature Store 2.0: Real-Time & Batch Unification
Feature Store 2.0: Real-Time & Batch Unification
23 May, 2025 | 07 Mins read

A fraud detection model showed 94% accuracy in development. In production Friday evening, it flagged legitimate rides as fraudulent while missing obvious fraud patterns. Investigation revealed the cau

Bank Vault Double Key
Bank Vault Double Key
16 May, 2025 | 04 Mins read

The most secure bank vault in the world requires two different keys, held by two different people, turned simultaneously. Neither person alone can open it. Now try coordinating this when the key holde

Composable Data Governance: Leveraging OpenMetadata & DataHub
Composable Data Governance: Leveraging OpenMetadata & DataHub
16 May, 2025 | 07 Mins read

Data governance fails for predictable reasons. Organizations run quarterly committee meetings while their data infrastructure changes daily. They document schemas manually while automated systems gene