Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

大佬help me #1

Open
huguangcheng opened this issue Mar 20, 2024 · 5 comments
Open

大佬help me #1

huguangcheng opened this issue Mar 20, 2024 · 5 comments

Comments

@huguangcheng
Copy link

大佬,你好,请问下

@huguangcheng
Copy link
Author

1.你这个模型可以拿去作图片文本检索任务吗
2.你这个模型数据需要预处理吗?我该咋处理呀
3.大佬可否指点一下,提供一个训练好的权重model,让我直接推理测试一下我的数据集呢?
谢谢大佬,,帮帮我

@huguangcheng
Copy link
Author

请问下,如果仅仅推理和微调的话,在3090卡上是否可行呀?

@lerogo
Copy link
Owner

lerogo commented Mar 20, 2024

1.你这个模型可以拿去作图片文本检索任务吗 2.你这个模型数据需要预处理吗?我该咋处理呀 3.大佬可否指点一下,提供一个训练好的权重model,让我直接推理测试一下我的数据集呢? 谢谢大佬,,帮帮我

  1. 这个模型是基于clip模型实现的,就是专门做图文检索任务的,具体你可以查看paper
  2. 数据处理部分都放在了readme中,如果你在处理过程有问题,欢迎联系
  3. checkpoint太大了(主要是之前的ck都删了),等我有时间重新跑一个发给你(估计得ACM MM之后),可以保持联系

@lerogo
Copy link
Owner

lerogo commented Mar 20, 2024

请问下,如果仅仅推理和微调的话,在3090卡上是否可行呀?

如果是微调clip-b32模型,那估计是可以的,但是可能有点慢。推理的话,应该没问题。

@huguangcheng
Copy link
Author

好的,谢谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants