Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Any results about direct fine-tuning on the journey learning data? #2

Open
tongyx361 opened this issue Oct 9, 2024 · 1 comment
Open

Comments

@tongyx361
Copy link

It's possible that, like LIMA, direct fine-tuning on the high-quality journey learning data might produce competitive performance.

@john1226966735
Copy link

It's possible that, like LIMA, direct fine-tuning on the high-quality journey learning data might produce competitive performance.

It seems that in "6.8 Q8: How to Train our Models?" of the paper, the authors just apply SFT to finetune the model with journey learning data? Is that the same with your "direct fine-tuning on the journey learning data"?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants