Upgrade sqlite-vec v0.1.10-alpha.3. New version supports DiskANN, with various bug fixes. However this patch is a minimal patch to simplify code (taking into account fixed bugs), with no schema changes . Compaction may no longer be needed, but for now I'm leaving in, since we will likely need to measure in an experiment. It's my understanding that the Neon optimizations work will all 64 bit arm CPUs, so leaving in. https://docs.google.com/document/d/1ZyBtEqyzJqTrb-kt4wdE4eyyaT-Yo8Y7PyymhYt4_T8/edit?tab=t.0#heading=h.1avovadfdmoa performance try build comparison: Base revision's try run: https://treeherder.mozilla.org/jobs?repo=try&landoCommitID=193651 Local revision's try run: https://treeherder.mozilla.org/jobs?repo=try&landoCommitID=193652 Future patch would be migrating to DiskANN Differential Revision: https://phabricator.services.mozilla.com/D297973
29 lines
835 B
Bash
Executable File
29 lines
835 B
Bash
Executable File
#!/bin/bash
|
|
|
|
# IMPORTANT: use `./mach vendor third_party/sqlite3/ext-sqlite-vec.yaml`,
|
|
# don't invoke this script directly.
|
|
|
|
# Script to download header from sqlite-vec extension amalgamation.
|
|
|
|
set -e
|
|
|
|
# Retrieve latest version value.
|
|
echo ""
|
|
echo "Get extension version."
|
|
version=`cat VERSION.txt`
|
|
echo "Github version: $version";
|
|
|
|
# Retrieve files and update sources.
|
|
|
|
echo ""
|
|
echo "Retrieving amalgamation..."
|
|
amalgamation_url=""https://github.com/asg017/sqlite-vec/releases/download/v$version/sqlite-vec-$version-amalgamation.zip""
|
|
wget -t 3 --retry-connrefused -w 5 --random-wait $amalgamation_url -qO amalgamation.zip
|
|
echo "Unpacking source files..."
|
|
unzip -p "amalgamation.zip" "sqlite-vec.h" > "sqlite-vec.h"
|
|
rm -f "amalgamation.zip"
|
|
|
|
echo ""
|
|
echo "Update complete, please commit and check in your changes."
|
|
echo ""
|