lvl0/trove
1
0
Fork 0
Code Issues 11 Pull requests Projects Releases Packages Wiki Activity Actions

Crawler: Queue population #8

New issue
Closed
opened 2026-04-23 02:27:44 +02:00 by myrmidex · 0 comments
myrmidex commented 2026-04-23 02:27:44 +02:00
Owner
Copy link

Job that moves new discovered_urls rows into crawl_queue with basic priority (form > fediverse > discovered-links). Skip URLs already in crawled_pages within recrawl threshold (30d default).

Job that moves new discovered_urls rows into crawl_queue with basic priority (form > fediverse > discovered-links). Skip URLs already in crawled_pages within recrawl threshold (30d default).
myrmidex added this to the v0.1 milestone 2026-04-23 02:27:44 +02:00
myrmidex added the
enhancement
 label 2026-04-26 01:28:09 +02:00
myrmidex self-assigned this 2026-04-26 16:09:22 +02:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
v0.1.0
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No labels
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No milestone
v0.1
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
myrmidex
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lvl0/trove#8
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?