Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature request] Skip getting rest of pages once a page consists solely of posts that were already downloaded. #42

Open
realwumbl3 opened this issue Feb 2, 2025 · 0 comments
Open

[feature request] Skip getting rest of pages once a page consists solely of posts that were already downloaded. #42

realwumbl3 opened this issue Feb 2, 2025 · 0 comments

Comments

@realwumbl3
Copy link

Perhaps add a checkbox that will make the crawler stop once it scans a page that only has posts that were already downloaded instead of getting all pages and then skipping already downloaded posts afterwards.
@realwumbl3 realwumbl3 changed the title [feature request] Skip getting pages once a page only contained posts that were already downloaded. [feature request] Skip getting rest of pages once a page contains solely of posts that were already downloaded. Feb 2, 2025
@realwumbl3 realwumbl3 changed the title [feature request] Skip getting rest of pages once a page contains solely of posts that were already downloaded. [feature request] Skip getting rest of pages once a page consists solely of posts that were already downloaded. Feb 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@realwumbl3