Commit graph

25 commits

Author SHA1 Message Date
6ab175a466 6 - Send ntfy alert when poll failures cross threshold 2026-04-29 21:25:11 +02:00
f9cebe5bae 6 - Add admin instances page and PollAlertService failure tracking 2026-04-28 23:33:32 +02:00
257dbfcf5f chore - remove example tests 2026-04-28 19:51:42 +02:00
6e097acf88 6 - Add admin instances page listing url and last poll 2026-04-28 18:52:09 +02:00
a59c086da2 13 - Make page language sticky across re-crawls when new fetch returns null 2026-04-28 01:32:38 +02:00
1cba8f3fc9 13 - Persist detected language and confidence on Page after successful fetch 2026-04-28 01:20:13 +02:00
81b3c7f70b 13 - Wire LanguageDetectionService into FetchPageAction with lang attr fallback 2026-04-28 01:09:18 +02:00
cda1414cd8 9 - Add robots.txt handling with cache and politeness integration
Some checks failed
CI / ci (push) Failing after 3h0m1s
CI / ci (pull_request) Has been cancelled
2026-04-27 23:53:52 +02:00
1538ceeb6e 11 - Gate ProcessCrawlJob with per-domain politeness lock 2026-04-27 01:25:46 +02:00
69aa5d9d3e 10 - Add /bot page with crawler identity and opt-out instructions 2026-04-27 00:41:12 +02:00
c80be24e6e chore - Extract mockFetchPageAction helper in ProcessCrawlJobTest 2026-04-27 00:24:38 +02:00
3297c4bb3b 14 - Fix ProcessCrawlJob outcome write and status mapping bugs 2026-04-27 00:18:34 +02:00
720e4bcc1f 14 - Implement ProcessCrawlJob orchestration with retry logic 2026-04-26 23:50:57 +02:00
2a586ecac4 14 - Add PageCrawlObserver and ProcessCrawlJob skeleton 2026-04-26 21:15:07 +02:00
118de0023a 14 - Simplify page_crawls schema (queue moves to Redis) 2026-04-26 20:58:07 +02:00
6c0e1fe12d chore - Simplify call-site tests now that RegisterDiscoveredPageAction is unit-tested 2026-04-26 20:22:24 +02:00
dda5b0f770 12 - Apply pr-reviewer follow-ups: validation, link filters, readonly VO, docs 2026-04-26 19:49:08 +02:00
35e1147823 12 - Add HTML content extraction (title, text, links, word count) 2026-04-26 19:35:04 +02:00
1b7fbbfd0c 12 - Add FetchPageAction with Http::fake-driven outcome paths 2026-04-26 17:56:13 +02:00
6f75be7328 8 - Tighten UrlService validation and add observer integration tests 2026-04-26 16:09:28 +02:00
de14ae3ad4 8 - Wire PageObserver to enqueue page_crawls on Page creation 2026-04-26 15:56:38 +02:00
43837a99db 5 - Add UrlSubmissionForm Livewire component with rate limiting 2026-04-26 11:58:51 +02:00
6b610b699e 4 - Drop status promotion in UrlDiscoveredListener; defer to keywords listener
Some checks failed
CI / ci (push) Failing after 3h0m0s
2026-04-26 03:52:12 +02:00
3ad473f4a1 4 - Add UrlDiscoveredListener wiring fediverse polling to pages graph 2026-04-26 03:31:32 +02:00
1fe6ae5cff 1 - Install Laravel 13 with Livewire 2026-04-23 03:13:33 +02:00