Generating realistic and detailed facial expressions is one of the most popular applications of AI image generation models like Stable Diffusion. Carefully crafted prompts can help guide the model to create stunning portraits that capture a wide range of emotions and moods.
Basics of Prompting for Faces
When creating AI-generated portraits, start by establishing the basic facial features and proportions you want the model to render.
portrait of a beautiful woman with long wavy blonde hair, sharp focus, vibrant colors, detailed eyes, smooth skin
Then build on that foundation by adding prompts focused on lighting, angle, background, and other stylistic elements. Always include some guidance on the overall facial expression.
3/4 profile view, Rembrandt lighting, out of focus green forest background, smiling happily with teeth showing
Enhancing Specific Facial Features
Target parts of the face like eyes, mouth, or eyebrows to dial in more nuanced expressions.
friendly smiling woman making eye contact, eyes slightly squinted, detailed laugh lines around the eyes
Use comparative prompts to morph facial features towards your artistic vision.
Keira Knightley's smile, Natalie Portman's eyes, Emma Stone's eyebrows
Directing Complex Emotions
Prompt explicitly for complex emotions like joy, sadness, anger or surprise to capture more dramatic expressions.
an old man crying with tears running down his cheeks, devastated expression, eyes closed, furrowed brow, frowning mouth
Describe associated body language and environmental cues that match the desired feeling.
woman screaming angrily with fists clenched, red enraged face, shouting at someone out of frame
Enhancing Expressiveness
Employ descriptive language focused on muscle movements to increase expressiveness.
exaggerated grin with laugh lines around eyes and mouth, flared nostrils, raised eyebrows
Use comparative prompts to emulate styles of portrait artists renowned for their emotional range.
rembrandt lighting, textured impasto brush strokes in the style of van Gogh, wide excited eyes like a Frida Kahlo self-portrait
Negative Prompts
Add negative prompts to reduce unwanted artifacts and distortions to faces.
no extra limbs, no mutations, no deformities, anatomically correct human
Prevent changes to key facial features between generations with fixed prompts.
the same female with consistent identity across images, the same face
Experimenting with Styles
Explore mixing different art movements and mediums to find your aesthetic.
glamorous pop art woman in a colorful Lichtenstein comic style, waving hand animated
Leverage master artists as inspiration for new interpretations.
girl with pearl earring in the style of Johannes Vermeer, photo realistic oil painting
The key is creating a clear vision through your prompts, then iteratively refining based on the model’s output. With practice, you’ll be able to dial in stunning, emotionally expressive portraits.
Useful Resources
- Facial Expression Prompt Guide – Curated prompts for emotions
- Portrait Prompting Wiki – Examples and tutorials
- This Person Does Not Exist – Practice generating original faces
The field of AI facial generation is rapidly evolving. Using the fundamental techniques outlined here as a starting point, you’ll be able to craft prompts that bring your unique artistic vision to life.