Commit graph

1415 commits

Author SHA1 Message Date
0aebb74b9b Document search result sources and show_sources param 2026-08-23 10:51:37 +02:00
4c736096ae Show search source badges only with show_sources param
The badges are a debugging aid - render them only when explicitly
requested via ?show_sources=1 instead of on every search.
2026-08-23 10:49:32 +02:00
323b7004ed Expose which search strategy produced each result
query_packages now assigns @search_sources - a hash mapping package
ids to the matching strategy that put them into the results: :exact,
:name_prefix, :name_contains, :semantic or :fulltext. The grid and
list views render a small badge with a humanized label per result,
making the search tiers observable. semantic_results() was folded
into search_packages() so each branch tags its own source. Adds the
rails-controller-testing gem for assigns() in tests.
2026-08-23 10:39:50 +02:00
61b64fae25 Log the failing SQL statement in vectorization task
Unique violations on packages_name_key happen on a statement that
cannot logically touch name - log the exact query and a longer
backtrace to identify what really fails.
2026-08-23 00:31:04 +02:00
bada261841 Skip packages without description text in vectorization
Packages with neither description nor long description cannot be
embedded at all; they used to fail on every run. Exclude them from
the scope instead.
2026-08-23 00:20:30 +02:00
2b79470feb Simplify vectorization task to sequential processing
Drop the threaded worker pool (queue, mutexes, connection pooling).
The task now processes packages one by one via find_each - plenty
fast since the external embedding service dominates latency, and
much easier to reason about.
2026-08-23 00:13:50 +02:00
3550a4e2e2 Harden vectorization task against per-package failures
A single failing package used to kill its whole worker thread silently
because only Vectorizer::Error was rescued per package. Now every
StandardError is caught and logged with class and backtrace, and the
embedding write is narrowed to update_column(:embedding) so the task
only ever issues a minimal UPDATE - it cannot touch any other column
or fire model callbacks. Progress stats no longer serialize database
writes through the mutex.
2026-08-23 00:11:52 +02:00
4d07f43a2e Show related packages based on description embeddings
Package pages get a "Related packages" section: a nearest neighbor
query against the package's own stored embedding (no external service
call), excluding the package itself. Packages without an embedding
render no section.
2026-08-22 23:47:42 +02:00
fdf3289f54 Remove lograge configuration from Docker image and production 2026-08-22 22:08:05 +02:00
4948fe50e3 Add semantic package search via pgvector embeddings
Package text search now combines several strategies: exact name match,
name prefix promotion, compound word splitting ("sqlite browser" finds
"sqlitebrowser") and semantic nearest neighbor search over description
embeddings computed by an external embedding service (all-MiniLM-L6-v2,
384 dims) stored with the pgvector extension. Classic PostgreSQL
full-text search remains as fallback when the vector service is
unreachable. Gibberish queries without lexical overlap with the package
data return empty results instead of random matches.

Embeddings can be backfilled with bin/rails debshots:compute_vectors.

Also drops the unused lograge gem from the Gemfile.
2026-08-22 22:07:56 +02:00
c7e8109bbd Add manual Forgejo action to promote :latest → :prod
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 1m14s
2026-05-28 00:33:26 +02:00
cf29664f0a Add wget for Coolify health checks
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 9m16s
2026-05-28 00:10:52 +02:00
a58adf8149 Shrink Docker image: remove node/bun from runtime, exclude test/dev gems, strip bundle cache/doc/build_info
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 8m58s
2026-05-27 23:14:16 +02:00
7472b737e5 Update dependencies: bump Ruby gems, JS packages, remove unused jquery/webpack
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 7m25s
2026-05-27 21:45:41 +02:00
9faf4aeada /json/ URL should work with dots in the package name now
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 7m49s
2026-05-27 21:33:40 +02:00
e3ecd96c99 Upgrade Ruby from 3.2.4 to 3.4.7
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 10m43s
2026-05-21 22:58:42 +02:00
1465733d64 Update gems and npm packages 2026-05-21 22:32:32 +02:00
d0402a3497 Switch from yarn to bun 2026-05-21 22:26:22 +02:00
237077c153 add simage_data to make test pass 2026-05-21 22:21:40 +02:00
0bb09dbbd8 fix package comparison
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 8m45s
2026-05-21 00:40:22 +02:00
aacd2a7794 Optimize Docker build caching for CI: add BuildKit cache mounts for apt, bundler, and yarn; use registry-based cache in CI pipeline
All checks were successful
Build and Push Docker Image / build-and-push-image (push) Successful in 1m22s
2026-04-13 00:05:10 +02:00
86c1d8ae5a copy/paste mistake
Some checks failed
Build and Push Docker Image / build-and-push-image (push) Has been cancelled
2026-04-12 23:36:13 +02:00
9340529d3f Merge branch 'main' of ssh://forgejo/chaas/debshots
Some checks failed
Build and Push Docker Image / build-and-push-image (push) Failing after 3m13s
2026-04-12 23:30:57 +02:00
35d9f0b263 trying to build 2026-04-12 23:30:43 +02:00
8deed9ffd3 Update .forgejo/workflows/playing-around._yaml_ 2026-04-12 11:09:07 +00:00
a88c156174 Merge branch 'main' of salsa.debian.org:debian/debshots 2026-03-01 22:12:34 +01:00
c9248c0af4 fix typo 2026-03-01 22:11:43 +01:00
609acc6db8 ignore test files 2026-03-01 22:11:38 +01:00
Christoph Haas
834403f448 Merge branch 'minor-spellcheck' into 'main'
fix: minor spellcheck

See merge request debian/debshots!1
2026-03-01 21:09:51 +00:00
9adce56098 fixed webhook URL for stage 2026-02-26 20:23:27 +01:00
cf7178fb34 real fix for the UDD import problems – it was looking for /json/screenshots and large_image_url 2026-02-26 20:21:19 +01:00
0e18dd19bb Set up git-crypt to encrypt .env files 2026-02-26 01:45:03 +01:00
784ce73adb Add .env.example template for required environment variables 2026-02-26 01:42:15 +01:00
66e2c8c7f1 Add Makefile for building and deploying container images 2026-02-26 01:40:19 +01:00
b42d99022b typo - fixes https://salsa.debian.org/debian/debshots/-/issues/87 2026-02-26 01:15:22 +01:00
8e95e4f9fd re-add large_image_url attribute that the UDD expects 2026-02-26 01:03:54 +01:00
0669198233 safety check 2026-02-26 00:28:00 +01:00
d5e0f83c54 remove the counting of images because it counts the dummy image as well 2026-02-26 00:23:49 +01:00
f872bd011b disabled minitest/reporters so that RubyMine is happy 2026-02-26 00:23:25 +01:00
b546ee095e create public/versioninfo on every build 2026-02-26 00:22:55 +01:00
ab915419ae fix assertion 2026-02-25 00:50:02 +01:00
9236af0712 rails 8.0.2 to 8.1. lograte for logging. 2026-02-25 00:09:25 +01:00
4e0858ccbe Add AGENTS.md for AI agent guidance 2026-02-24 23:59:56 +01:00
54d607ce23 cruft 2026-02-09 01:34:55 +01:00
8a13c92028 allow all Salsa users to be moderators 2026-02-09 01:34:34 +01:00
b25ef5882f ffs 2026-02-08 23:07:07 +01:00
4e23c6b4de ffs
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-02-08 19:47:06 +01:00
6764b00a77 ffs
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2026-02-08 19:46:37 +01:00
3f6709b3b7 ffs
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-02-08 19:34:12 +01:00
05c22ca558 ffs
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-02-08 19:32:17 +01:00