lvl0/trove
1
0
Fork 0
Code Issues 11 Pull requests Projects Releases Packages Wiki Activity Actions
78 commits 1 branch 1 tag 493 KiB
Commit graph

3 commits

Author SHA1 Message Date
myrmidex
cda1414cd8 9 - Add robots.txt handling with cache and politeness integration
Some checks failed
CI / ci (push) Failing after 3h0m1s
Details
CI / ci (pull_request) Has been cancelled
Details
2026-04-27 23:53:52 +02:00
myrmidex
7171348370 11 - Add PolitenessService and crawler delay config 2026-04-27 00:59:45 +02:00
myrmidex
bb7906e193 12 - Make FetchResult fields nullable and add missing crawler config 2026-04-26 16:50:43 +02:00