MechaCat02 bde72e47f4 fix: batch and index the crawler_jobs retention reaper ...

reap_terminal was one unbatched DELETE with no updated_at index — a full scan and
long-held lock over a large backlog (audit M5). Migration 0040 adds a partial
index on (updated_at) WHERE state IN ('done','dead'); reap_terminal now deletes in
bounded 5k batches. Existing tests green.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-07-13 21:46:01 +02:00

..

0001_init.sql

chore: initial project scaffold

2026-05-16 21:05:16 +02:00

0002_auth.sql

feat: argon2id passwords, session cookies, bot bearer tokens

2026-05-16 22:04:25 +02:00

0003_pages.sql

feat: streaming files endpoint + reader pages + chapter pages metadata

2026-05-16 22:32:08 +02:00

0004_bookmarks_unique.sql

feat: bookmarks (CRUD + per-user listing + frontend toggle)

2026-05-16 22:40:27 +02:00

0005_search.sql

feat: pg_trgm search, sort options, populated total count

2026-05-16 22:46:16 +02:00

0006_username_case_insensitive.sql

bugfix: case-insensitive usernames, reject non-positive bookmark page

2026-05-16 23:27:19 +02:00

0007_drop_redundant_chapter_index.sql

chore: audit-flagged cleanups (no behaviour change)

2026-05-16 23:32:02 +02:00

0008_user_preferences.sql

feat: continuous reader mode with persisted preference

2026-05-17 13:15:03 +02:00

0009_manga_metadata.sql

feat: manga metadata with status, authors, genres, tags, and search filters (0.15.0)

2026-05-17 14:32:03 +02:00

0010_collections.sql

feat: manga collections (0.17.0)

2026-05-17 17:43:06 +02:00

0011_history.sql

feat: read & upload history (0.19.0)

2026-05-17 18:19:52 +02:00

0012_crawler.sql

feat: crawler scaffold with chromium launcher (0.22.0)

2026-05-20 22:07:56 +02:00

0013_drop_chapters_unique_number.sql

feat: route reader by chapter id, allow duplicate-numbered chapters (0.24.0)

2026-05-22 23:37:07 +02:00

0014_crawler_jobs_dedup_index.sql

feat: crawler job queue ops and dedup index (0.27.0)

2026-05-25 19:59:09 +02:00

0015_crawler_state.sql

feat: in-process crawler daemon with cron and worker pool (0.28.0)

2026-05-25 20:32:02 +02:00

0016_crawler_jobs_drop_failed_state.sql

chore: drop dead 'failed' branch from crawler_jobs partial index

2026-05-28 20:24:05 +02:00

0017_chapter_sources_per_manga.sql

fix(crawler): scope chapter_sources lookup per-manga (0.35.5)

2026-05-29 20:43:08 +02:00

0018_admin_role.sql

feat(auth): admin role with cookie-only RequireAdmin extractor (0.37.0)

2026-05-30 21:26:26 +02:00

0019_admin_audit.sql

feat(api): admin user management endpoints with audit log (0.38.0)

2026-05-30 21:35:35 +02:00

0020_admin_jobs_payload_index.sql

feat(api): admin manga/chapter overview with derived sync state (0.39.0)

2026-05-30 21:41:09 +02:00

0021_chapter_source_index.sql

feat(chapter): preserve source-site order in chapter list (0.52.0)

2026-06-03 07:25:09 +02:00

0022_crawler_observability_indexes.sql

feat(admin): crawler observability dashboard + reliability hardening (0.55.0)

2026-06-06 18:49:56 +02:00

0023_page_collections_and_tags.sql

feat(search): tag-based page search surface + per-page tags & collections

2026-06-13 15:51:38 +02:00

0024_normalize_page_tags.sql

feat(page-tags): normalize page_tags onto the shared tags table

2026-06-13 17:44:38 +02:00

0025_page_analysis.sql

feat(analysis): page-analysis schema, domain types, and analyze_page job kind

2026-06-13 18:27:08 +02:00

0026_app_settings.sql

feat(admin): runtime-editable crawler & analysis config in the dashboard

2026-06-14 13:32:20 +02:00

0027_storage_sizes.sql

feat(storage): admin storage-usage stats + per-manga/chapter sizes

2026-06-15 20:18:41 +02:00

0028_operation_metrics.sql

feat(admin): observability — job history, live now-analyzing, durations & metrics (0.84.0) (#6)

2026-06-16 12:21:13 +00:00

0029_crawler_jobs_sync_chapter_list_index.sql

perf(admin): fix O(mangas x jobs) overview query that pinned Postgres (0.85.1)

2026-06-17 17:05:40 +02:00

0030_page_analysis_analyzed_at_index.sql

feat(admin): time-series trend charts on the metrics tabs (0.87.0)

2026-06-19 11:48:56 +02:00

0031_crawler_jobs_analyze_page_dedup.sql

fix(analyze-dedup): migration pre-dedup, force-collision upgrade, gate test (0.87.11)

2026-06-23 07:22:20 +02:00

0032_crawler_jobs_lease_generation.sql

fix(jobs): per-lease generation token closes the ack-from-dead-lease race (0.87.26)

2026-06-24 20:05:55 +02:00

0033_mangas_updated_at_index.sql

feat(mangas): per-field sort options + direction toggle on the catalog (0.88.0)

2026-06-25 07:15:51 +02:00

0034_api_tokens_expires_at.sql

feat(auth): support optional expiry for bot API tokens

2026-07-01 07:22:57 +02:00

0035_manga_reactions.sql

feat(reactions): per-user like/dislike on mangas

2026-07-05 16:54:11 +02:00

0036_manga_content_warnings.sql

perf: denormalize content-warning filter to manga_content_warnings

2026-07-11 14:24:31 +02:00

0037_mangas_sort_author.sql

perf: precompute mangas.sort_author for the author sort

2026-07-11 14:29:26 +02:00

0038_genres_name_lower_unique.sql

fix: enforce case-insensitive genre uniqueness

2026-07-13 21:25:46 +02:00

0039_crawler_jobs_running_lease_idx.sql

fix: index the running/leased_until arm of the job-lease query

2026-07-13 21:43:33 +02:00

0040_crawler_jobs_terminal_reap_idx.sql

fix: batch and index the crawler_jobs retention reaper

2026-07-13 21:46:01 +02:00