Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update config.yaml #5

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Update config.yaml #5

wants to merge 2 commits into from

Conversation

policybot2020
Copy link
Collaborator

@SarahWagner

I have finished mapping the 16 sources into the Yaml config file. In addition, I have updated the DB mapping with an extra field called "author" , maybe this is the wrong place to add. Please advise, if it's false.

Jian

@policybot2020 policybot2020 self-assigned this Nov 15, 2024
@SarahWagner
Copy link
Contributor

The field "author" is not present as "author" in any of the feeds. I've seen it in a couple, but it's called differently.
We can leave it but it will be empty without mapping beforehand. Also there are still 404 pages in the list of feeds (https://www.telesurenglish.net/pages/rss.html, https://www.news24.com/World/Rss). @policybot2020 Can you please check and fix?

@arunge We will need to make a mapping to normalize the field names. For example the article text is not always called the same, this might also apply to other fields.

Copy link
Contributor

@SarahWagner SarahWagner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please check the feeds to be valid and not causing 404 errors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants