🎨 Semantic.Art, 💾 Stable Lance 2.1, 🎥 Ray+LanceDB powers Netflix

October 31, 2025
Newsletter

🎨 Semantic.Art

Meet semantic.art, a multi-feature multi-index retrieval art discovery engine that lets you search with a feeling or intent rather than matching keywords.

Powered by LanceDB. The core of the system involves dynamically understanding and inspecting a query's intent. It then chooses the best search path on the fly, blending vector, FTS, hybrid search, filtering, and custom rerankers.

💾 Lance File 2.1 Is Now Stable

Big news from the LanceDB team — Lance File Format 2.1 is officially stable!

This release solves one of the biggest challenges from 2.0: 👉 adding compression without sacrificing random access performance.

__wf_reserved_inherit
Link to blog ^

LanceDB's 🐰RaBitQ Quantization for Blazing Fast Vector Search ⚡️

A new quantization technique in LanceDB engineering for high-performance search on large-scale, high-dimensional data.

__wf_reserved_inherit
Link to blog ^

▶️ Recordings you might've missed!

📅 Upcoming Events

Ray Summit 2025

Ray Summit 2025 | Wednesday, November 5, 4:00 PM

LanceDB and Netflix are joining forces at Ray Summit to do a deep dive on what the Netflix Media Data Lake team is building.

LanceDB at PyData

Look forward to three sessions from the LanceDB team at PyData Seattle!


🌤 Data Loading for Data Engineers
Weston Pace, Senior Software Engineer @ LanceDB | Friday, November 7, 10:10 AM

🌤 Keynote Session: Never Send a Human to do an Agent's Retrieval
Chang She, Co-Founder & CEO @ LanceDB | Saturday, November 8, 9:00 AM

🌤 Supercharging Multimodal Feature Engineering with Lance and Ray
Jack Ye, Senior Software Engineer @ LanceDB | Saturday, November 8, 11:40 AM

LanceDB at KubeCon

Check out our two sessions at KubeCon + CloudNativeCon North America 2025!

🌤 Highly Scalable AI Search Engine and AI Data Lake With Kubernetes and LanceDB
Lu Qiu, Database Engineer & ChanChan Mao, Developer  @ LanceDB | Tuesday, November 11, 5:45 PM

🌤 Building AI/ML Pipelines on Kubernetes
Lu Qiu (LanceDB), Susan Wu & Ian Chakares (Google), Anant Vyas & Lucy Sweet (Uber) | Thursday, November 13, 11:45 AM

Open Lakehouse + AI Mini Summit

Open Lakehouse + AI Mini Summit | Thursday, November 13, 12:00 PM - 4:30 PM

Dive into the key capabilities of LanceDB's Multimodal Lakehouse—fast random-access at scale, vector + full-text search, and optimized schema primitives—so you can iterate rapidly without blowing your budget.

Register: https://luma.com/OLMS-1113

📊 LanceDB Enterprise Product News

Feature Description
Clusters and manifests for Geneva
  • We have web pages and REST APIs for cluster management and manifests in Geneva
Performance improvements
  • Optimized filtered reads with limit pushdown for better query efficiency.
  • Reduced index cache size for memory stability in high-load query nodes.
Operational improvements
  • Reduced Docker image sizes for faster downloads and deployments.
  • Improved concurrent request monitoring with gauges and adjusted logging performance.
  • Enhanced PE metrics for remote filtered reads and request performance.
  • Removed torch and CUDA dependencies from indexer image to reduce image size.
  • Added Geneva metrics dashboards and endpoint response code monitoring.
  • Introduced admin commands in lancedb-cli, starting with health.

🫶 Community Contributions

A heartfelt thank you to our community contributors of lance and lancedb this past month:

@lyang24@wojiaodoubao@jaystarshot@yanghua@chunshao90@ddupg@majin1102@yingjianwu98@xloya@ColdL@niebayes@yingjianwu98@morales-t-netflix@wayneli-vt@steFaiz@zhangyue19921010@timsaucer@wayneli-vt@chenghao-guo@jtuglu1@huyuanfeng2018@valkum@naaa760@edrogers@tlamarre91

🌟 Open Source Releases Spotlight

Feature Version Description
LanceDB 0.22.2 Allow bitmap indexes on large-string, binary, large-binary, and bitmap, support namespace database in Rust.
Lance 0.38.3 Support multi-base write, allowing one Lance dataset to span across multiple buckets. Support zstd/lz4 compression. Support custom stop word in FTS index. Support shallow clone and branching in Python and Java. Support Blob API in Java. Support index against nested field. Support change data feed for inserted and updated rows. Better logging and auditing across code execution.
0.38.2 Fix forward compatibility of FTS index changes in 0.38.0.
0.38.1 Support fragment level column update. Support faster IVF-PQ indexing on GPU.
0.38.0 ❗ As of this release, the 2.1 version of the file format is considered stable. There will be no more breaking changes and the format should be readable by future versions of Lance. In an upcoming release, the 2.1 version will become the default.

Blob encoding for v2.1 file format. Performance improvement of FTS index (reduces P95 latency by 32.3%). FTS index now supports specialized JSON document tokenizer.
Lance Namespace 0.0.17–0.0.20 Add support for Azure OneLake, refactor of Rust library into main Lance repo for better integration.
Lance Ray 0.0.7–0.0.8 Support distributed compaction of Lance table.
Lance Spark 0.0.14–0.0.15 Data Evolution in Apache Spark: users can run ALTER COLUMN FROM to add a column and backfill data simultaneously.
Jasmine Wang
Ecosystem Engagement, Partnership, Community, DevRel

Unifying the AV ML Stack: From Raw Data to Trained Model with LanceDB

Ayush Chaurasia
April 10, 2026
unifying-the-av-ml-stack-lancedb

Volcano Engine LAS's Lance-Based PB-Scale Autonomous Driving Data Lake Solution

Kejian Ju
April 14, 2026
volcano-engine-autonomous-driving-data-lake-solution

Building A Storage Format For The Next Era of Biology

Pavan Ramkumar
April 8, 2026
building-a-storage-format-for-the-next-era-of-biology