Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some questions about Multiple identities #1

Open
Daming-TF opened this issue Dec 6, 2023 · 3 comments
Open

Some questions about Multiple identities #1

Daming-TF opened this issue Dec 6, 2023 · 3 comments

Comments

@Daming-TF
Copy link

Hello this is great work!!how do you feed Multiple identities into the attention module when obtaining multiple id tokens through id extractor in multiple identities applications? concat directly behind prompt embeds?

@AMEERAZAM08
Copy link

@icoz69 @xyynafc Yes Please Release Code .

@novicemm
Copy link

Great work!
Let me know when you will release code.
Thanks

@NormXU
Copy link

NormXU commented Dec 17, 2023

@Daming-TF Here is my guess: During training, they used raw images with the face region masked out as the stylized human image, while the cropped face from the same image acts as the identity input.
We can follow the same method for inference: Suppose we want to put the faces of individuals A and B on C and D within a reference image respectively. First, we use an instance segmentation model to create a mask for C in the reference image. Then, we used the facial features of individual A as a guiding reference.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants