Stable Diffusion Prompt Book

Stable Diffusion is a popular AI image generation model that creates images from text prompts. Writing effective prompts is key to generating high-quality images in Stable Diffusion. This skill is known as prompt engineering.

In this article, we will provide an overview of prompt engineering for Stable Diffusion and share examples of prompts you can use to create your own AI art.

What is Prompt Engineering?

Prompt engineering refers to the practice of carefully crafting the text prompts fed into AI systems like Stable Diffusion. The goal is to guide the model to produce the desired output by providing the right instructions and context.

Some key aspects of good prompt engineering include:

• Using clear, detailed language
• Leveraging the model’s training data and capabilities
• Specifying visual aspects like style, composition, lighting etc.
• Excluding undesired elements via negative prompts

Through iterative refinement, you can learn to write prompts that reliably generate images matching your creative vision.

Stable Diffusion Prompt Structure

A typical Stable Diffusion prompt has a few key components:

• Subject – The main focus of the image
• Style – Artistic style, aesthetics, mood
• Details – Granular descriptors about visual elements
• Negative prompt – Elements to exclude

Here is an example prompt breakdown:

A scenic landscape painting by Claude Monet, in a glowing golden hour lighting, vivid fall colors in the trees, highly detailed, 8k resolution

Subject: Scenic landscape
Style: Painting by Claude Monet
Details: Golden hour lighting, fall colors, highly detailed, 8k resolution
Negative prompt: None

Understanding this anatomical structure will help you compose better prompts.

Prompt Engineering Tips

Here are some tips to write effective prompts for Stable Diffusion:

Be Specific

Using descriptive, unambiguous language is vital for prompting properly. For example, “a tall tower” is vague, whereas “an ornate baroque clock tower” specifies the exact visual.

Limit Variation

Narrow down elements that can vary wildly, like facial features of a portrait subject. For example, “a photo of Emma Watson from the shoulders up, facing left, with hazel eyes and straight brown hair”.

Use Reference Images

Provide a URL to a reference image for the model to closely replicate visual aspects. Useful for matching a specific style.

Try Associative Effects

Mention related contexts and elements to influence the image. Like “cyberpunk” and “neon” together will likely yield a futuristic neon cityscape.

Iterate on Prompts

Progressively modify prompts based on results to hone in on your vision. Tweak descriptors, add negatives, adjust emphasis etc.

Stable Diffusion Prompt Examples

Here are some examples of Stable Diffusion prompts you can try:

Landscape Photography

An extreme wide angle photograph of a colorful autumn landscape in Banff National Park, dawn sunlight creating a dramatic scene, cinematic mood, by Peter McKinnon

Anime Character Portrait

Portrait of an anime girl with long pink hair, big green eyes, wearing steampunk goggles, intricate costume details, intricate lighting, sharp focus, illustration by Artgerm and Ross Tran

Astronaut Sighting Bigfoot

An astronaut in a red spacesuit floating above Earth's atmosphere stares in disbelief at Bigfoot standing on the moon surface, digital art trending on ArtStation 

Still Life Painting

A muted color palette still life oil painting by Claude Monet of a vase with pink roses and leaves, rendered in thick, visible brushstrokes, soft lighting coming from the side, high amount of detail

Take these examples and modify or build upon them further as per your creative needs. With some practice, you’ll be able to reliably generate images matching your artistic vision.

Resources for Stable Diffusion Prompts

Here are some handy sites to discover new prompts and ideas:

• PromptHero – Searchable database of top community prompts
• Stable Diffusion Notebook – Official prompt notebook from Stability AI
• Stable Diffusion Subreddit – See prompts shared by users and artists

Bookmark these resources to stay inspired and continue refining your prompt writing skills.

With the right prompts, Stable Diffusion offers endless creative potential for generating beautiful AI art. Master prompt engineering to unlock the model’s capabilities and bring your artistic imagination to life.