I have found consistent character models to be hard to get right, and really sensitive to certain configurations. Try with different checkpoints, CFG, clip skip. Also some loras respond better with additional trigger words - maybe the model you have is documented.

Most of what I have learned has been from looking at examples and then using the PNG info to attempt to recreate it exactly with all the same model SHAs