Successful test – the ‘proof of workflow’

Here’s a follow on from last night’s Successful test – Poser to Stable Diffusion enhancement, a proof-of-concept (or perhaps more accurately proof-of-workflow for the compositing. It’s crude, and he’s meant to be on an airship which isn’t shown, but it shows it can all work.

1. Rerender the Poser Firefly line-art at 4 x the original 768px (i.e. 3027px square) as a .PNG file.

2. In Photoshop I then run this render through GMIC and a custom filter for line-art (very similar to Dynamic AutoPainter’s Comic filter, but free). This turns the thin lines into chunkier ‘inked’ lines. Takes about 40 seconds, but does the job.

3. Size the GMIC result back to 1024px and place it over our final 1024px outcome from the successful test. Set the new layer to Multiply blending mode, and adjust opacity to suit. Flatten, and then select and cut out the figure from the white background. Defringe. Then have Photoshop add a thick ‘holding-line’ around the figure’s outline (Stroke 5px, black). This latter item helps subtly isolate the figure from the background it’s going to be pasted onto.

4. Reselect the resulting cutout figure and drop over a suitable backdrop. Here for speed I’ve merely selected a SD landscape experiment and given it a very crude tooning effect via a Photoshop filter — a final frame would have a much better lineart background. But it serves for now. Make a white layer behind, and fade the background a little by simply opacity-blending it with the white. This is why, ideally, you want figures and backgrounds as separate elements.

5. Colour balance the figure with the background. Flatten layers, tweak the Curves in Photoshop to add contrast and ‘pop’ (without things getting all ‘black on black’). Slot into the page-layout’s frame and add a text box. You’re done.

The demo is very basic and crude, especially the pose and background. But it proves that one can go from a Poser render to a finished comics panel and have it look somewhat acceptable for storytelling purposes. Especially considering the start point was this…

The workflow may sound fiddly, but once nailed down a Poser Python script could handle the renders in one click. Then a set of custom Photoshop Actions would handle much of the rest. Regrettably Stable Diffusion software, despite being built on Python, omitted to add Python scripting for UI and rendering automation.