Rolf Rando
fb46e0bc4b
For this patch we no longer manually do the bit quantization and instead rely on built in sqlite-vec features. Running the performance tests with manual rowLimit set to 10,000 (a typical use case) on my MacM1 semantic searching latency was reduced 3x, from 6.5 to 2.2ms. I have added one additional performance test that uses multiple different queries, because I thought one query was insufficient. In the original we were searching 100 entries for 2 results. That is a '50x' oversample, which is being set manually each time we do a query with a special function. Note there is also a 're-vendor' to upgrade sqlite-vec because they fixed a bug we found in the integration of this patch. Base revision's try run: https://treeherder.mozilla.org/jobs?repo=try&landoCommitID=193651 Local revision's try run: https://treeherder.mozilla.org/jobs?repo=try&landoCommitID=194008 Differential Revision: https://phabricator.services.mozilla.com/D300160
51 lines
1.2 KiB
YAML
51 lines
1.2 KiB
YAML
schema: 1
|
|
|
|
bugzilla:
|
|
product: Core
|
|
component: SQLite and Embedded Database Bindings
|
|
|
|
origin:
|
|
name: sqlite-vec
|
|
description: >
|
|
An extremely small, "fast enough" vector search SQLite extension that runs
|
|
anywhere!
|
|
url: https://github.com/asg017/sqlite-vec
|
|
release: v0.1.10-alpha.4 (2026-05-17T23:50:43-07:00).
|
|
revision: v0.1.10-alpha.4
|
|
license: MIT
|
|
license-file: LICENSE-MIT
|
|
notes: >
|
|
Please check for eventual limitations of this extension on the Github page
|
|
official documentation.
|
|
|
|
vendoring:
|
|
url: https://github.com/asg017/sqlite-vec
|
|
source-hosting: github
|
|
tracking: tag
|
|
vendor-directory: third_party/sqlite3/ext/sqlite-vec
|
|
skip-vendoring-steps:
|
|
- update-moz-build
|
|
exclude:
|
|
- "**"
|
|
include:
|
|
- LICENSE-MIT
|
|
- VERSION
|
|
- sqlite-vec.c
|
|
- sqlite-vec-diskann.c
|
|
- sqlite-vec-ivf-kmeans.c
|
|
- sqlite-vec-ivf.c
|
|
- sqlite-vec-rescore.c
|
|
keep:
|
|
- moz.yaml
|
|
- patches/*
|
|
- vendor.sh
|
|
patches:
|
|
- 'patches/*.patch'
|
|
update-actions:
|
|
- action: move-file
|
|
from: '{vendor_dir}/VERSION'
|
|
to: '{vendor_dir}/VERSION.txt'
|
|
- action: run-script
|
|
script: '{yaml_dir}/vendor.sh'
|
|
cwd: '{vendor_dir}'
|