lvl0/trove
1
0
Fork 0
Code Issues 11 Pull requests Projects Releases Packages Wiki Activity Actions
56 commits 1 branch 1 tag 493 KiB
Commit graph

6 commits

Author SHA1 Message Date
myrmidex
cda1414cd8 9 - Add robots.txt handling with cache and politeness integration
Some checks failed
CI / ci (push) Failing after 3h0m1s
Details
CI / ci (pull_request) Has been cancelled
Details
2026-04-27 23:53:52 +02:00
myrmidex
264180cd36 chore - Move outcome → status mapping into CrawlOutcomeEnum methods
Some checks failed
CI / ci (push) Failing after 3h0m1s
Details
2026-04-27 01:36:37 +02:00
myrmidex
1538ceeb6e 11 - Gate ProcessCrawlJob with per-domain politeness lock 2026-04-27 01:25:46 +02:00
myrmidex
3297c4bb3b 14 - Fix ProcessCrawlJob outcome write and status mapping bugs 2026-04-27 00:18:34 +02:00
myrmidex
720e4bcc1f 14 - Implement ProcessCrawlJob orchestration with retry logic 2026-04-26 23:50:57 +02:00
myrmidex
2a586ecac4 14 - Add PageCrawlObserver and ProcessCrawlJob skeleton 2026-04-26 21:15:07 +02:00