Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add weights for specific entities in the model?? #125

Open
KarlosMuradyan opened this issue Oct 18, 2018 · 0 comments
Open

Add weights for specific entities in the model?? #125

KarlosMuradyan opened this issue Oct 18, 2018 · 0 comments

Comments

@KarlosMuradyan
Copy link

If there is some way, how the code should be modified to give some specific entities more weights than the others?
The thing that I want to do is giving more loss to 0 entities (Entities that are not labeled in the training set) than the others in order to predict more entities for the input. The reason for this is that lots of entities in the training set are not labeled, so for example if "Google" is not labeled, model may not know that it should be labeled as an "Organization". Therefore I am trying to give more loss to the words without labels in order it tend to predict something.
The inspiration came from this:
https://www.tensorflow.org/api_docs/python/tf/losses/softmax_cross_entropy
that uses weights to regulate it. I tried to change some things but it didn't work.

Thanks in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant