Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task] Opensource the RAGEval Pipeline #1

Open
Kunlun-Zhu opened this issue Aug 31, 2024 · 9 comments
Open

[Task] Opensource the RAGEval Pipeline #1

Kunlun-Zhu opened this issue Aug 31, 2024 · 9 comments
Assignees

Comments

@Kunlun-Zhu
Copy link
Collaborator

Kunlun-Zhu commented Aug 31, 2024

  1. opensource the article generation pipeline —— Yifan Luo
  2. opensource the QAR & keypoint generation pipeline —— Dingling Xu
  3. opensource the evaluation framework —— Kunlun Zhu
@Kunlun-Zhu Kunlun-Zhu changed the title Opensource the RAGEval Pipeline [TaskOpensource the RAGEval Pipeline Aug 31, 2024
@Kunlun-Zhu Kunlun-Zhu changed the title [TaskOpensource the RAGEval Pipeline [Task] Opensource the RAGEval Pipeline Aug 31, 2024
@bhugueney
Copy link

Hi,
Thank you for this most interesting project !

Readme says :

The Usage and the remaining code is coming soon

I'm really looking forward to be able to use your pipeline.

Thank you.

@Kunlun-Zhu
Copy link
Collaborator Author

@bhugueney Thanks for your interest. We have released our data and evaluation framework. The generation framework will be released this week.

@Kunlun-Zhu
Copy link
Collaborator Author

Sorry for the late release, we are currently still fixing our pipeline

@Kunlun-Zhu
Copy link
Collaborator Author

@bhugueney Sorry for the wait, you can refer to our recent update

@mamba824824
Copy link

@Kunlun-Zhu Did you have any video introduction for this project. I think that is better for new users.

@Kunlun-Zhu
Copy link
Collaborator Author

Hi @mamba824824, We currently don't have a video introduction plan. However, feel free to contact us if anything is unclear in our code or readme.

@YeFD
Copy link

YeFD commented Oct 23, 2024

@Kunlun-Zhu Hi, could you upload retrieval and generation pipelines for different retrievers and LLMs?

@Kunlun-Zhu
Copy link
Collaborator Author

@YeFD Hi, Thanks for the suggestion. We use the same RAG pipeline opensource in https://github.com/RUC-NLPIR/FlashRAG

@YeFD
Copy link

YeFD commented Oct 23, 2024

Got it. Thanks for your reply.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants