myrmidex
  • Joined on 2026-02-08
myrmidex closed issue lvl0/trove#4 2026-04-26 03:53:25 +02:00
URL Discovery and Storage
myrmidex created branch release/0.1.0 in lvl0/trove 2026-04-26 03:53:09 +02:00
myrmidex pushed to release/0.1.0 at lvl0/trove 2026-04-26 03:53:09 +02:00
6b610b699e 4 - Drop status promotion in UrlDiscoveredListener; defer to keywords listener
3ad473f4a1 4 - Add UrlDiscoveredListener wiring fediverse polling to pages graph
424ad2ff78 4 - Add Page and PageLink models with factories and unit tests
bc535c8c0b 4 - Add pages and page_links migrations with PageStatusEnum
ec2113710a 3 - Harden fediverse polling: timeouts, error handling, payload fields
Compare 10 commits »
myrmidex opened issue lvl0/trove#19 2026-04-26 01:26:44 +02:00
Run the Laravel scheduler in production (start.sh)
myrmidex opened issue lvl0/trove#18 2026-04-26 01:26:43 +02:00
Switch poll loop to per-instance dispatched jobs
myrmidex opened issue lvl0/trove#17 2026-04-26 01:26:42 +02:00
Tighten URL extraction regex for parens-bearing URLs
myrmidex opened issue lvl0/trove#16 2026-04-26 01:26:41 +02:00
LemmyClient: page-walking via page=N until cursor reached
myrmidex opened issue lvl0/trove#15 2026-04-26 01:25:39 +02:00
Per-instance interval gating in the polling loop
myrmidex closed issue lvl0/trove#3 2026-04-26 01:20:12 +02:00
Fediverse Polling
myrmidex closed issue lvl0/trove#2 2026-04-24 20:17:16 +02:00
Instance configuration
myrmidex commented on issue lvl0/trove#2 2026-04-24 20:17:14 +02:00
Instance configuration

Shipped across 5 commits on release/0.1.0. Field-name drift vs ticket wording (all intentional):

  • fedisearch_instancesfedi_discover_instances — project was renamed.
  • Schema…
myrmidex closed issue lvl0/trove#1 2026-04-23 20:14:40 +02:00
Foundation
myrmidex opened issue lvl0/trove#14 2026-04-23 02:29:51 +02:00
Crawler: Queue worker
myrmidex opened issue lvl0/trove#13 2026-04-23 02:29:21 +02:00
Crawler: Language detection
myrmidex opened issue lvl0/trove#12 2026-04-23 02:28:58 +02:00
Crawler: HTTP fetcher and content extraction
myrmidex opened issue lvl0/trove#11 2026-04-23 02:28:41 +02:00
Crawler: Per-domain politeness
myrmidex opened issue lvl0/trove#10 2026-04-23 02:28:23 +02:00
Crawler: User agent and /bot page
myrmidex opened issue lvl0/trove#9 2026-04-23 02:28:07 +02:00
Crawler: robots.txt handling
myrmidex opened issue lvl0/trove#8 2026-04-23 02:27:44 +02:00
Crawler: Queue population
myrmidex opened issue lvl0/trove#7 2026-04-23 02:27:23 +02:00
Crawler Data Model