4948fe50e3
Add semantic package search via pgvector embeddings
...
Package text search now combines several strategies: exact name match,
name prefix promotion, compound word splitting ("sqlite browser" finds
"sqlitebrowser") and semantic nearest neighbor search over description
embeddings computed by an external embedding service (all-MiniLM-L6-v2,
384 dims) stored with the pgvector extension. Classic PostgreSQL
full-text search remains as fallback when the vector service is
unreachable. Gibberish queries without lexical overlap with the package
data return empty results instead of random matches.
Embeddings can be backfilled with bin/rails debshots:compute_vectors.
Also drops the unused lograge gem from the Gemfile.
2026-08-22 22:07:56 +02:00
0bb09dbbd8
fix package comparison
Build and Push Docker Image / build-and-push-image (push) Successful in 8m45s
2026-05-21 00:40:22 +02:00
5bdba5b6cc
added job to purge old log files
2025-06-23 00:46:32 +02:00
e25441f548
add Rake task to create admin users
2025-05-21 00:23:51 +02:00
c235407378
reduce loglevel
2024-07-22 00:00:53 +02:00
48e3a8c67f
bzip2 import fixed
2024-07-14 22:42:34 +02:00
a26b5eaa23
Remove no-longer-needed migration scripts
2021-03-06 19:19:54 +01:00
0a5c64d17c
Rake task fixed for Shring
2021-02-25 00:14:08 +01:00
c234ffec4f
Ignore packages ending in -l10n
2021-02-21 15:57:56 +01:00
afba572dcd
todo hint added
2021-02-13 22:16:03 +01:00
6a99a62ffa
Added rake task to create derivates after migration
2020-11-12 22:28:29 +01:00
3a4f40b7e3
Cruft
2020-11-01 23:25:34 +01:00
c4f5741b0c
Migration to Shrine attachment handling
2020-11-01 15:07:16 +01:00
d0057e490f
Task added to precompute image variants
2020-10-30 18:27:58 +01:00
33086f9430
Merge branch 'master' of salsa.debian.org:debian/debshots
2020-04-20 20:29:06 +02:00
8adf682a0b
Migrations and helpers to move from Paperclip to ActiveStorage
...
To migrate the application as of April 2020:
• leave models/screenshot.rb with “has_attached_file”
• bundle exec rake db:migrate
• bin/move_paperclip_to_activestorage
• set models/screenshot.rb to “has_one_attached”
2020-04-20 20:24:59 +02:00
Christoph Haas
4a9fe8772e
Use package upstream version. Skip revision. Improve regexp parsing.
2018-08-22 13:11:28 +02:00
7ff36f1c5c
More relaxed blacklist for importing packages
2016-10-30 13:03:04 +01:00
046897f1c6
Rake task to clean up broken screenshots works now
2016-08-17 09:27:50 +02:00
b7e82757eb
Speed improvement in updating database
...
Instead of querying the database one package at a time I am now querying
all packages and just update those who have a visits count.
2016-08-11 11:20:37 +02:00
2edae8fbc2
Progress counter in 5% steps added. Comments added.
2016-08-11 09:26:27 +02:00
e895e931fc
Regexp now correctly matches empty referers and user agents
2016-08-11 09:25:49 +02:00
04baeb73e7
Added rake task to count package visits from Nginx log files
...
Example call:
rake debshots:accesslog2visits['cache-access-example.log']
2016-08-10 18:59:59 +02:00
ff254f8e00
Typo fixed
2016-06-22 18:10:43 +02:00
7914d09676
Dealing with empty/nil version/description fields properly.
2016-06-22 18:09:41 +02:00
b947de24f3
Rake task set_empty_screenshot_version_to_zero added
2016-06-21 17:23:24 +02:00
3eeb9a63dc
Using created_at instead of legacy 'uploaddatetime' field
2016-03-04 15:41:50 +01:00
c67f3062dc
Package importer fixed
2016-03-02 14:13:44 +01:00
39149c26ad
Adding :uploaddatetime because it is mentioned in the default scope
2016-02-29 15:14:28 +01:00
99059f54df
Typo fixed
2016-02-29 15:05:25 +01:00
0d10c8ef0a
Cruft removed
2016-02-26 17:33:40 +01:00
06f09c0486
Count updates/additions correctly. Add fields correctly. Various other fixes.
2015-06-28 15:12:43 +02:00
dade32145e
Using .new instead of .create
...
Otherwise .create() would fail instantly because it does not
populate the fields during the creation and can't create a
valid object.
2015-06-28 15:11:39 +02:00
8e890fbaa6
Actually updating package data.
...
Added debug printing which regexp matched.
2015-06-27 00:15:32 +02:00
6ef32e4bea
Screenshot/Paperclip migration Rake task checks for validation errors
2015-06-26 21:18:56 +02:00
806a7cbcee
Added rake task to remove orphaned screenshot records
2015-06-15 13:05:01 +02:00
019ff7c519
Changing Rake namespace to "debshots"
...
Let's group all debshots-related Rake tasks under a common namespace
2015-04-27 00:17:21 +02:00
2df1024b9b
Added Rake task to remove duplicate screenshots
2015-04-27 00:16:08 +02:00
9a0da2b396
Unused variable removed
2015-04-24 17:00:45 +02:00
da6309400c
Refactored check if a package name or section is blacklisted
2015-04-24 17:00:15 +02:00
7c6b5c7205
Removed component argument from DebImporter::Release.new
2015-04-24 16:59:47 +02:00
63e3c62356
Importer tries to read long descriptions from translations file. Still buggy.
...
The description text is not properly split after the first line.
2015-04-23 17:19:51 +02:00
c05b52895d
Parsing of i18n file added.
...
Allows us to read long descriptions and add them to the package information
2015-04-23 00:29:30 +02:00
beeb4cd37a
Stats counter added. Limiting to wanted archs.
2015-04-22 23:03:49 +02:00
8b8073bdd0
Added "debshots" namespace and list_deb_repos task
2015-04-22 21:45:36 +02:00
13218841f4
Optimisation: only query database if the package is not obviously blacklisted
...
Performance gain: 20x
2015-04-20 20:33:40 +02:00
e4e8c0c0db
Changed "puts" to proper logging
2015-01-04 14:20:54 +01:00
38df37057a
Added migration script to add screenshots to Paperclip
2015-01-04 14:20:31 +01:00
c4390af52a
Script tidied up
2014-12-07 22:49:37 +01:00
ef30db8b55
Added Rake task to import packages from Debian repositories
2014-12-05 01:23:45 +01:00
