AI images of yourself in LESS THAN 10 seconds Similar to InstantID (but it’s FLUX) PuLID: Pure and Lightning ID Customization via Contrastive Alignment
Introduction
PuLID is an innovative tuning-free ID customization method designed for text-to-image generation. By incorporating a Lightning T2I branch alongside a standard diffusion one, PuLID introduces both contrastive alignment loss and accurate ID loss, minimizing disruption to the original model and ensuring high ID fidelity. Experiments demonstrate that PuLID achieves superior performance in both ID fidelity and editability. Additionally, a notable feature of PuLID is that the image elements (e.g., background, lighting, composition, and style) remain as consistent as possible before and after ID insertion.
Try PuLID para FLUX Free
Whats happenning on the twitter about Pulid Flux?
🚀Project Number 1 – PuLID-FLUX🔥
— ManuAGI 🤖 – ( ManuIn ) (@ManuAGI01) September 17, 2024
'A Personalized Identity Customization Tool'#AI #HuggingFace #TechInnovation #AIArt #DiffusionModel #FLUXModel #AICoding #CreativeAI #PuLIDFLUX pic.twitter.com/DxpZNEXZ4v
PULID for Flux:https://t.co/eejy2TeMZ3 https://t.co/XUc2HTm2sj pic.twitter.com/G35Zibt2Vn
— Luis C (@lucataco93) September 13, 2024
PuLID-FLUX-v0.9.0 update ⚙️.
— Hare AI (@harecrypta_ai) September 18, 2024
Screwed a new PuLID personalizer to #Flux 🧬.
Looks so amazing 🤩 pic.twitter.com/9e09lffXBk
It's now possible to generate character consistency from just a single image using Flux Pulid. You can generate images of a character in completely different clothing and lighting scenarios. I'll show you the pro's and cons. https://t.co/vEHbnKPTbh Enjoy! #AI #Flux #FluxPulid pic.twitter.com/I5G5gsqmml
— Travis Davids (@MrDavids1) September 17, 2024
「PuLID with FLUX」イケメンのランサーVer
— Maki@Sunwood AI Labs. (@hAru_mAki_ch) 16 de septiembre de 2024
—-
A handsome lancer from a dark fantasy world, captured in a 35mm film style. The lancer stands confidently with a mysterious aura, clad in dark, intricate armor with a long lance at his side. His face is strikingly handsome, with sharp… pic.twitter.com/XnLCAXudkV
PuLID para FLUX
— Gradio (@Gradio) September 17, 2024
🔥It provides a tuning-free ID customization solution using FLUX-dev.
This Gradio-first project has been trending on GitHub! Congratulations to Yanze Wu and team 👏
Learn how to play with the Pulid-FLUX model locally: https://t.co/5wgANTxhLa
Play with the… pic.twitter.com/ADjZDCtWMT
PuLID的Flux版本,人脸还原效果还挺不错。
— Gorden Sun (@Gorden_Sun) September 13, 2024
Github:https://t.co/S1XAzReW24、
在线使用:https://t.co/4bq73kk8rK
图1是原图,234是生成的 pic.twitter.com/qln6TDFHt2
Methods
- Contrastive Alignment: Through contrastive alignment loss and ID loss, PuLID inserts ID information without affecting the original model’s behavior.
- Lightning T2I Branch: Introduces a Lightning T2I branch that uses fast sampling techniques to generate high-quality images from pure noise.
- Optimizing ID Loss: Optimizes ID loss in a more accurate setting to enhance ID similarity.
Experiments
- Quantitative Comparison: Evaluates ID fidelity using ID cosine similarity, showing that PuLID outperforms existing methods across all test sets and base models.
- Qualitative Comparison: PuLID achieves high ID similarity while causing less disruption to the original model, accurately reproducing the original model’s lighting, style, and layout.
Contributions
- Proposes a tuning-free method, PuLID, which preserves high ID similarity while mitigating the impact on the original model’s behavior.
- Introduces a Lightning T2I branch alongside the regular diffusion branch, incorporating contrastive alignment loss and ID loss to minimize the contamination of ID information on the original model while ensuring fidelity.
- Experiments show that PuLID achieves state-of-the-art performance in terms of both ID fidelity and editability and is less invasive to the model, making it more flexible for practical applications.