Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to change Rouge parameters? #120

Open
jamal833 opened this issue Jan 30, 2019 · 3 comments
Open

How to change Rouge parameters? #120

jamal833 opened this issue Jan 30, 2019 · 3 comments
Assignees
Labels

Comments

@jamal833
Copy link

jamal833 commented Jan 30, 2019

In command sumy_eval random modsum/some_name.2.txt --language=english --file=docs/text.txt --format=plaintext How I can change different parameters of Rouge evaluation like -a -c 95 -b 665 -m -n 4 -w 1.2?

@miso-belica miso-belica self-assigned this May 19, 2019
@miso-belica
Copy link
Owner

Hi @jamal833, I am afraid you can't change them. I don't know where your args -a -c 95 -b 665 -m -n 4 -w 1.2 come from but feel free to define such functionality here and maybe create PR but I am afraid that because there are many evaluation methods this would lead to really many parameters. Maybe you can use the evaluation algorithms from Python script with your own tweaks.

@miso-belica miso-belica assigned jamal833 and unassigned miso-belica May 19, 2019
@deepaksinghtopwal
Copy link

@miso-belica How can i evaluate the quality of summary (i.e. Rouge score etc.) if i am using Sumy an Non CLI command(i.e. sumy_test.py and ren running the script)?

@miso-belica
Copy link
Owner

Not sure what you are asking precisely but you can see examples in https://github.com/miso-belica/sumy/blob/master/sumy/evaluation/__main__.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants