I would train a LoRA, here's a guide (also has links to other guides at the bottom)
this post was submitted on 19 Aug 2023
9 points (90.9% liked)
Stable Diffusion
4309 readers
2 users here now
Discuss matters related to our favourite AI Art generation technology
Also see
Other communities
founded 1 year ago
MODERATORS
Ok . . . so I have a Mac M2. And have been using Diffusion Bee to avoid the terminal. But I'll see if I can figure it out.
Much simpler way, even if not as cool: try https://apps.apple.com/app/id6444050820 that is free and great. First download a model, if you already have one you like just use the Civitai.com link, otherwise there's a selection of them and I'd try... Realistic Visions? The 8 bit one saves you a little space. Then use the photo icon in the bottom to import a photo, you want something with the face clearly visible. Use the eraser to get rid of everything other than the face. Now try prompting for an astronaut! Should work already but you can try adding Controls: Tile, Inpainting and Pose specifically.
Performance wise you can go at the bottom of the left side, click on the cpu looking icon and select (if it's not selected already) Use CoreML: Yes and for the CoreML compute units go with All.
My M2 Mini takes a dozen seconds for a normal generation like that. With the Control modules and Inpainting is going to be a little slower obviously but hey, it's a fast app.
The easiest way is take a picture of your son and "inpaint" the parts that are not him with the style you want. The more difficult way would be to train a LORA. Here is a blog by someone who did exactly that. https://www.shruggingface.com/blog/self-portraits-with-stable-diffusion-and-lora
In-painting. You can selectively generate some parts of an image. So you can take pics of your son and generate the parts he isn't in.
Roop is what you are looking for. MUCH simpler than creating a LORA. https://youtu.be/8SWon8erHZw?si=XKFDvXh0sJhF6I1D
And if you haven't subscribed to Olivio Sarikas's YouTube channel, you should