Text Prompt for Stable Diffusion

Stable Diffusion is a powerful AI system for generating images from text descriptions. Crafting effective prompts is key to getting good results. This guide will provide prompt examples and tips to help you create stunning AI art with Stable Diffusion.

What is Stable Diffusion?

Stable Diffusion is an open-source AI system released in 2022 that uses diffusion model technology to convert text to photorealistic images. Developed by researchers from CompVis and Stability AI, it builds on ideas like denoising autoencoders.

The model is trained on massive datasets to understand visual concepts. By entering a descriptive text prompt, Stable Diffusion can generate a unique image matching the description. The quality depends heavily on how well the prompt is written.

Elements of Effective Prompts

An effective Stable Diffusion prompt should:

  • Clearly describe the desired image content
  • Provide relevant context and style details
  • Use clear language and avoid ambiguity
  • Be an appropriate length to fully describe the image

Prompt Structure

A good prompt structure includes:

  • Subject – The main focus of the image
  • Style/medium – The visual style or medium (painting, drawing etc.)
  • Details – Descriptions of lighting, color, background etc.
  • Modifiers – Terms to enhance or reduce certain elements

Here is an example prompt breakdown:

[Subject] A still life painting of a bowl of fruit
[Style] in impressionist style like Claude Monet 
[Details] with soft lighting coming from the left, vibrant colors, and a dark background
[Modifiers] very detailed, award-winning

Prompt Length

Prompts should be around 1-3 sentences or 50-100 words. Too short and there aren’t enough details. Too long can overwhelm the AI and result in unclear images.

Using Modifiers

Special terms called modifiers fine-tune the image:

  • extremely detailed – Add more fine details
  • lowres – Generate lower resolution images
  • masterpiece – Boost overall quality

Here is an example with modifiers:

An oil painting portrait of a wizard with a long white beard wearing purple robes and holding a staff, extremely detailed fantasy illustration, digital art

Avoiding Bias

Be cautious of perpetuating harmful stereotypes in the prompts. For example, prompts that associate certain races with violence should be avoided.

Stable Diffusion Prompt Examples

Here are some prompt examples to showcase different styles and approaches:

Realistic Portrait Painting

An intimate portrait painting of a beautiful young woman with long dark hair, warm lighting, vignette effect

Futuristic Cityscape

A futuristic neon cityscape with flying cars, towering skyscrapers, and trains running between buildings, dynamic lighting, volumetric fog, cinematic composition

Whimsical Landscape

A whimsical fantasy landscape with a cottage next to a lake, big mushrooms and tiny fairy villages scattered across grassy hills, intricate details, in the style of a children's book illustration

Still Life Photography

Photorealistic still life image of various fruit in a bowl with drapes and sunlight in the background, soft shadows, detailed, depth of field

Advanced Prompting Techniques

To take prompts to the next level, try these advanced techniques:

Seeding

Use an existing image as the “seed” instead of a text prompt. Stable Diffusion will generate images with similar visual style or content to the seed image.

Image-to-Image

Feed an existing image into Stable Diffusion and add text prompts to transform the image by changing the style, adding/removing elements etc.

Prompt Weighting

Put important parts of a prompt in brackets to tell the AI to focus more on those elements. For example:

[A close-up portrait] of an elderly man with [a bushy white mustache] wearing an aviator hat and goggles, [detailed facial features]

Prompt Chaining

Break a complex prompt into steps using --- between prompts. The AI will build off previous steps.

Useful Stable Diffusion Resources

With the right prompts, Stable Diffusion allows anyone to generate stunning AI art. Use these examples and techniques to craft prompts that produce professional quality images.