|
|
8d063a8262
|
6 - Add PollFailed event to FediDiscover package
|
2026-04-29 21:15:11 +02:00 |
|
|
|
bbd74c1954
|
6 - Reset consecutive_poll_failures on successful poll
|
2026-04-29 21:09:44 +02:00 |
|
|
|
920985eec8
|
6 - Convert blade views to layouts/app inheritance
|
2026-04-29 21:07:43 +02:00 |
|
|
|
f9cebe5bae
|
6 - Add admin instances page and PollAlertService failure tracking
|
2026-04-28 23:33:32 +02:00 |
|
|
|
257dbfcf5f
|
chore - remove example tests
|
2026-04-28 19:51:42 +02:00 |
|
|
|
6e097acf88
|
6 - Add admin instances page listing url and last poll
|
2026-04-28 18:52:09 +02:00 |
|
|
|
9cecc47b8b
|
6 - Log structured success entry on PollFediverseAction with url count and duration
|
2026-04-28 18:47:04 +02:00 |
|
|
|
a59c086da2
|
13 - Make page language sticky across re-crawls when new fetch returns null
|
2026-04-28 01:32:38 +02:00 |
|
|
|
1cba8f3fc9
|
13 - Persist detected language and confidence on Page after successful fetch
|
2026-04-28 01:20:13 +02:00 |
|
|
|
81b3c7f70b
|
13 - Wire LanguageDetectionService into FetchPageAction with lang attr fallback
|
2026-04-28 01:09:18 +02:00 |
|
|
|
cb83b0df90
|
13 - Add language and languageConfidence fields to FetchResult
|
2026-04-28 00:38:46 +02:00 |
|
|
|
829ce04282
|
13 - Add LanguageDetectionService wrapping patrickschur/language-detection
|
2026-04-28 00:32:54 +02:00 |
|
|
|
a37b1da145
|
13 - Add language_confidence column and Page model cast
|
2026-04-28 00:13:14 +02:00 |
|
|
|
cda1414cd8
|
9 - Add robots.txt handling with cache and politeness integration
CI / ci (push) Failing after 3h0m1s
CI / ci (pull_request) Has been cancelled
|
2026-04-27 23:53:52 +02:00 |
|
|
|
264180cd36
|
chore - Move outcome → status mapping into CrawlOutcomeEnum methods
CI / ci (push) Failing after 3h0m1s
|
2026-04-27 01:36:37 +02:00 |
|
|
|
1538ceeb6e
|
11 - Gate ProcessCrawlJob with per-domain politeness lock
|
2026-04-27 01:25:46 +02:00 |
|
|
|
7171348370
|
11 - Add PolitenessService and crawler delay config
|
2026-04-27 00:59:45 +02:00 |
|
|
|
69aa5d9d3e
|
10 - Add /bot page with crawler identity and opt-out instructions
|
2026-04-27 00:41:12 +02:00 |
|
|
|
c80be24e6e
|
chore - Extract mockFetchPageAction helper in ProcessCrawlJobTest
|
2026-04-27 00:24:38 +02:00 |
|
|
|
3297c4bb3b
|
14 - Fix ProcessCrawlJob outcome write and status mapping bugs
|
2026-04-27 00:18:34 +02:00 |
|
|
|
e8a935ea31
|
14 - Document queue worker container in deployment README
|
2026-04-26 23:54:40 +02:00 |
|
|
|
720e4bcc1f
|
14 - Implement ProcessCrawlJob orchestration with retry logic
|
2026-04-26 23:50:57 +02:00 |
|
|
|
2a586ecac4
|
14 - Add PageCrawlObserver and ProcessCrawlJob skeleton
|
2026-04-26 21:15:07 +02:00 |
|
|
|
118de0023a
|
14 - Simplify page_crawls schema (queue moves to Redis)
|
2026-04-26 20:58:07 +02:00 |
|
|
|
6c0e1fe12d
|
chore - Simplify call-site tests now that RegisterDiscoveredPageAction is unit-tested
|
2026-04-26 20:22:24 +02:00 |
|
|
|
649aeb3627
|
chore - Extract RegisterDiscoveredPageAction for shared Page::firstOrCreate logic
|
2026-04-26 20:18:18 +02:00 |
|
|
|
dda5b0f770
|
12 - Apply pr-reviewer follow-ups: validation, link filters, readonly VO, docs
|
2026-04-26 19:49:08 +02:00 |
|
|
|
35e1147823
|
12 - Add HTML content extraction (title, text, links, word count)
|
2026-04-26 19:35:04 +02:00 |
|
|
|
3e2fd0d2c4
|
chore - Add dev-composer command
|
2026-04-26 18:13:39 +02:00 |
|
|
|
1b7fbbfd0c
|
12 - Add FetchPageAction with Http::fake-driven outcome paths
|
2026-04-26 17:56:13 +02:00 |
|
|
|
bb7906e193
|
12 - Make FetchResult fields nullable and add missing crawler config
|
2026-04-26 16:50:43 +02:00 |
|
|
|
a9f2d689ae
|
12 - Add crawler config and FetchResult value object
|
2026-04-26 16:45:07 +02:00 |
|
|
|
abbcedf2e7
|
12 - Add Rejected case to CrawlOutcomeEnum and PageStatusEnum
|
2026-04-26 16:35:46 +02:00 |
|
|
|
6f75be7328
|
8 - Tighten UrlService validation and add observer integration tests
|
2026-04-26 16:09:28 +02:00 |
|
|
|
de14ae3ad4
|
8 - Wire PageObserver to enqueue page_crawls on Page creation
|
2026-04-26 15:56:38 +02:00 |
|
|
|
81209125a1
|
8 - Add UrlService with host extraction method
|
2026-04-26 14:52:40 +02:00 |
|
|
|
f2c1fab4e4
|
7 - Add int casts on PageCrawl and tests for cascade-delete + pending scope
|
2026-04-26 14:23:13 +02:00 |
|
|
|
fe8ca7fc10
|
7 - Add page_crawls migration, PageCrawl model, factory, and Page relationships
|
2026-04-26 14:15:49 +02:00 |
|
|
|
9dd6d84d65
|
7 - Add CrawlOutcomeEnum for crawl attempt outcomes
|
2026-04-26 13:06:22 +02:00 |
|
|
|
b1b7adeacd
|
7 - Add language column to pages for crawler-detected language
|
2026-04-26 12:53:21 +02:00 |
|
|
|
43837a99db
|
5 - Add UrlSubmissionForm Livewire component with rate limiting
|
2026-04-26 11:58:51 +02:00 |
|
|
|
b0a4102637
|
5 - Trust forwarded headers behind reverse proxy for real client IP
|
2026-04-26 11:56:39 +02:00 |
|
|
|
0f14c66c34
|
5 - Publish Livewire config with class-based components and no emoji
|
2026-04-26 11:54:23 +02:00 |
|
|
|
6b610b699e
|
4 - Drop status promotion in UrlDiscoveredListener; defer to keywords listener
CI / ci (push) Failing after 3h0m0s
|
2026-04-26 03:52:12 +02:00 |
|
|
|
3ad473f4a1
|
4 - Add UrlDiscoveredListener wiring fediverse polling to pages graph
|
2026-04-26 03:31:32 +02:00 |
|
|
|
424ad2ff78
|
4 - Add Page and PageLink models with factories and unit tests
|
2026-04-26 02:51:49 +02:00 |
|
|
|
bc535c8c0b
|
4 - Add pages and page_links migrations with PageStatusEnum
|
2026-04-26 02:48:39 +02:00 |
|
|
|
ec2113710a
|
3 - Harden fediverse polling: timeouts, error handling, payload fields
|
2026-04-26 01:15:35 +02:00 |
|
|
|
2cb86f3337
|
3 - Schedule fedi-discover:poll every minute
|
2026-04-26 00:46:59 +02:00 |
|
|
|
1b713e3539
|
3 - Add LemmyClient with FediverseClientFactory dispatch
|
2026-04-26 00:42:21 +02:00 |
|
