Code Dataset

[mtasic85]

Hi there, great work!

Do you have plans for code datatset, and if yes when can we expect it?

[koalazf99]

Hi @mtasic85, thank you for your interest in ProX!
We will try it on code data in the coming days; however, I can't confirm the exact timeline yet. Unlike our web and math data which largely come from web documents, code data mainly comes from GitHub, which involves a different approach for downloading, organizing and training. We're still figuring out how to conduct some initial experiments.