My Summer Internship Experience at LanceDB
I'm Raunak, a master's student at the University of Illinois, Urbana-Champaign. This summer, I had the opportunity to intern as a Software Engineer at LanceDB, an early-stage startup based in San Francisco.
Blog category:
Engineering
All posts
Announcement
Applications
Autonomous Vehicles
Case Study
Community
Engineering
FinTech
Gaming
Newsletter
Columnar File Readers in Depth: APIs and Fusion
The API used to read files has evolved over time, from simple full table reads to batch reads and eventually to iterative record batch readers. Lance takes this a step further to return a stream of read tasks.
Developers, Ditch the Black Box: Welcome to Continue
Remember flipping through coding manuals? Those quickly became relics with the rise of Google and Stack Overflow, a one-stop shop for developer queries.
Columnar File Readers in Depth: Parallelism without Row Groups
Explore columnar file readers in depth: column shredding with practical insights and expert guidance from the LanceDB team.
Benchmarking Cohere Rerankers with LanceDB
Improve retrieval quality by reranking LanceDB results with Cohere and ColBERT. You’ll plug rerankers into vector, FTS, and hybrid search and compare accuracy on real datasets.
Lance v2: A New Columnar Container Format
Explore lance v2: a new columnar container format with practical insights and expert guidance from the LanceDB team.
Effortlessly Loading and Processing Images with Lance: a Code Walkthrough
Working with large image datasets in machine learning can be challenging, often requiring significant computational resources and efficient data-handling techniques.
A Practical Guide to Fine-Tuning Embedding Models
Explore a practical guide to fine-tuning embedding models with practical insights and expert guidance from the LanceDB team.
Columnar File Readers in Depth: Backpressure
Streaming data applications can be tricky. When you can read data faster than you can process the data then bad things tend to happen. The various solutions to this problem are largely classified as backpressure.