You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
The crawler and underlying recipe-scrapers codebases will evolve over time, and as with any software project, bugs may be introduced or fixed over time.
In addition, the content of recipe websites may change over time too, as websites decide to reformat their contents or rebrand their page look-and-feel.
It would be useful to continuously track the performance of scraper versions against real recipe website content.
Describe the solution you'd like
It should be possible to record historical statistics regarding the success/failure rate of recipe content crawling.
It should be possible to break this down by crawler version, by recipe-scrapers version, by website and also by time interval.
This data should be exposed via the diagnostics service and made available via the corresponding diagnostics component of the frontend application.
Describe alternatives you've considered
Real-time alerting on crawler failures (per-domain and overall) could also be beneficial, but is a slightly different use case and can be considered separately.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
The
crawler
and underlyingrecipe-scrapers
codebases will evolve over time, and as with any software project, bugs may be introduced or fixed over time.In addition, the content of recipe websites may change over time too, as websites decide to reformat their contents or rebrand their page look-and-feel.
It would be useful to continuously track the performance of scraper versions against real recipe website content.
Describe the solution you'd like
It should be possible to record historical statistics regarding the success/failure rate of recipe content crawling.
It should be possible to break this down by
crawler
version, byrecipe-scrapers
version, by website and also by time interval.This data should be exposed via the
diagnostics
service and made available via the corresponding diagnostics component of thefrontend
application.Describe alternatives you've considered
Real-time alerting on crawler failures (per-domain and overall) could also be beneficial, but is a slightly different use case and can be considered separately.
The text was updated successfully, but these errors were encountered: