Blog

Product updates, technical deep dives, and lessons learned building data infrastructure for AI.

Engineering December 14, 2025

Bringing Multi-Column B-Trees to Columnar Storage

How we built compound scalar indices for Lance to optimize specific multi-predicate query patterns. A contribution story about tradeoffs, benchmarks, and when compound indices beat dual-index intersection—and when they don't.

By Thomas Santerre

lance indexing database-internals

Engineering November 30, 2025

Extending Apache DataFusion: Custom Table Providers and Physical Optimizers

A practical guide to extending DataFusion with custom data source integrations and optimizer rules. Lessons learned building distributed analytics on DataFusion and Ballista, including the patterns that work and the gotchas that don't.

By Thomas Santerre

datafusion rust query-engines