Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Add backend endpoint to list/search pages #2353

Closed
tw4l opened this issue Jan 30, 2025 · 0 comments · Fixed by #2354
Closed

[Feature]: Add backend endpoint to list/search pages #2353

tw4l opened this issue Jan 30, 2025 · 0 comments · Fixed by #2354
Assignees
@tw4l
Labels
enhancement New feature or request

Comments

@tw4l
Copy link
Member

tw4l commented Jan 30, 2025

What change would you like to see?

It would be helpful to have a backend endpoint that lists the pages in a collection, with support for filtering by url or url prefix.

Context

Related to #2347 and #2348, this will help us (among other things) quickly determine which WACZ a page is in within a collection.
@tw4l tw4l added the enhancement New feature or request label Jan 30, 2025
@tw4l tw4l self-assigned this Jan 30, 2025
@tw4l tw4l moved this from Triage to Ready in Webrecorder Projects Jan 30, 2025
@ikreymer ikreymer moved this from Ready to Todo in Webrecorder Projects Jan 30, 2025
@tw4l tw4l moved this from Todo to Implementing in Webrecorder Projects Jan 30, 2025
@tw4l tw4l mentioned this issue Jan 30, 2025
Merged
@tw4l tw4l moved this from Implementing to In Review in Webrecorder Projects Jan 30, 2025
ikreymer pushed a commit that referenced this issue Feb 11, 2025
@tw4l
Add collection page list/search endpoint (#2354)
98a45b0 
Fixes #2353

Adds a new endpoint to list pages in a collection, with filtering
available on `url` (exact match), `ts`, `urlPrefix`, `isSeed`, and
`depth`, as well as accompanying tests. Additional sort options have
been added as well.

These same filters and sort options have also been added to the crawl
pages endpoint.

Also fixes an issue where `isSeed` wasn't being set in the database when
false but only added on serialization, which was preventing filtering
from working as expected.
@github-project-automation github-project-automation bot moved this from In Review to Done! in Webrecorder Projects Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tw4l tw4l

Labels
enhancement New feature or request
Projects
Webrecorder Projects
Status: Done!
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add collection page list/search endpoint webrecorder/browsertrix
1 participant
@tw4l