Happy Birthday, H.P. Lovecraft! My present this year is a ‘Lovecraft’s likeness’ add-on for guiding AI image generation. Specifically, my Lovecraft SDXL character LoRA. Included is a workflow that also does automatic facefix at a higher resolution, useful for when he’s in the middle-distance of an image. As you can see below, a middle-distance Lovecraft (that looks at bit more like William Burroughs) becomes more Lovecraft-like and especially so around the eyes. Not perfect, but better.

The middle-distance fix-up is achieved by an ‘automatic facefix’, which re-renders the face at a higher resolution then seamlessly patches it in. My supplied workflow gives you the auto-facefix plus a Controlnet which can process using either MistoLine (extract lineart as a guide to the image generation) or OpenPose (extract a posed figure as a guide). Above you see an old Sherlock Holmes film-still guiding the image via a MistoLine Controlnet, along with the Lovecraft LoRA. The head is angled, to show that angles are possible. Emotions can also be prompted for.

Note that making the workflow functional will require the host software ComfyUI, plus several ‘custom nodes’ and models. The ComfyUI workflow has the details of these. Of course one also requires a good NVIDIA graphics card in the PC, with a 3060 12Gb being generally regarded as the base entry-level.

Change the image-generation prompt to do things like having 18th century clothes and settings…

Include hpl in the prompt to trigger the LoRA into action.

Enjoy!