Mastering Prompt Engineering for AI Image Generation with SeaArt AI

A well-structured prompt with the correct order and categorization of terms is vital for AI image generation. While terms might seem similar, their placement significantly impacts the output. A general guideline for Stable Diffusion prompt order includes: View/Shot, Subject (with details), Media, Resolution/Detail terms, Style references (including artist references), Additional details (background, environment, etc.), Main color theme, Lighting/Shadows, and Quality terms (e.g., 'best image:1.5'). While this order can vary by model, these guidelines are broadly applicable. Not all categories need to be used in every prompt. It is beneficial to categorize each term within the prompt, for instance, by specifying 'subject, face details, body details, clothing details' rather than a jumbled list. This structured approach helps reduce incorrect generations.

Prompt weighting is a powerful feature in Stable Diffusion that allows for fine-grained control over generated images. It involves assigning a 'factor' to a 'term' to increase or decrease its prominence in the image. The 'term' refers to any element within the prompt you wish to modify, while the 'factor' controls the scale of this modification. While factors can technically range from 0.01 to 100, such extreme values can lead to image distortion. Generally, a recommended scale for weighting is between 0.5 and 1.5. Some models can handle weights up to 2, but it's advisable to stay within the recommended range for optimal results.

Let's illustrate prompt creation with a step-by-step example using the DreamShaper v8 model, known for its flexibility and beginner-friendliness. The following settings were used for all generated images: Sampler: DPM++ 2M KARRAS, CFG: 9, Sampling Steps: 30. **Step 1: Subject and Main Theme Selection** To create an illustration of a girl in space, we start with a basic prompt: 'illustration, 1girl, space'. This forms the initial output. **Step 2: Negative Prompts and Embeddings** To maintain quality, we add negative prompts and embeddings. For this example, we use basic negative prompts and DreamShaper embeddings: * **Positive Prompt:** `illustration, 1girl, space` * **Negative Prompt:** `BadDream, (UnrealisticDream:1.3), low res, NSFW, grayscale, monochrome, astronaut suit, nude, child, kid` **Step 3: Adding Media and Perspective** Once the quality is acceptable, we add media and perspective terms for consistency. We opt for digital art and watercolor ink, incorporating 'mixed media' for blending. A 'bust shot' provides a good perspective. * **Positive Prompt:** `bust shot illustration, 1girl, (digital art), watercolor ink, space, mixed media` **Step 4: Quality Improvement** To enhance the base image, we add quality-boosting terms. * **Positive Prompt:** `bust shot illustration, 1girl, (digital art), watercolor ink, (masterpiece:1.3), best quality, high detail, HDR, 8K, space, mixed media` **Step 5: Adding Styles and References** We reference two artists, Charlie Bowater for portraits and Maciej Kuciara for sci-fi characters, and introduce 'science fiction' and 'abstract art' as themes. * **Positive Prompt:** `bust shot illustration, 1girl, (digital art), watercolor ink, (masterpiece:1.3), best quality, high detail, HDR, 8K, abstract art, (by Charlie Bowater:0.9), (style of Maciej Kuciara), sci-fi, space, mixed media` **Step 6: Adding Details and Colors** We add specific details to the subject and background, choosing red and black as the main colors. To ensure the face is visible, 'helmet' is added to the negative prompt. * **Positive Prompt:** `bust shot illustration, 1girl, black hair, bob cut, futuristic spacesuit, (digital art), watercolor ink, (masterpiece:1.3), best quality, high detail, HDR, 8K, abstract art, (by Charlie Bowater:0.9), (style of Maciej Kuciara), sci-fi, fractal stars, space, stunning space background, red theme, black theme, mixed media` * **Negative Prompt:** `BadDream, (UnrealisticDream:1.3), low res, NSFW, grayscale, monochrome, astronaut suit, nude, child, kid, helmet` **Step 7: Lighting and Finishes** Finally, we add terms for focus, lighting, shadows, and quality finishes. Additional negative prompts are included for better facial generation. * **Positive Prompt:** `bust shot illustration, portrait, 1girl, black hair, bob cut, futuristic spacesuit, (digital art), watercolor ink, (masterpiece:1.3), best quality, high detail, HDR, 8K, abstract art, (by Charlie Bowater:0.9), (style of Maciej Kuciara), sci-fi, fractal stars, space, stunning space background, red theme, black theme, (depth of field), sharp focus, volumetric lighting, rim lighting, soft shadows, mixed media, trending on deviantart, award winning` * **Negative Prompt:** `BadDream, (UnrealisticDream:1.3), (deformed eyes:1.3), ugly, low res, NSFW, grayscale, monochrome, astronaut suit, nude, child, kid, helmet`

To imbue the generated image with a specific artistic flair, referencing styles and artists is highly effective. You can include terms like 'abstract art' or 'science fiction' to set a thematic tone. Furthermore, mentioning artists whose work you admire, such as 'by Charlie Bowater' or 'style of Maciej Kuciara', allows the AI to draw inspiration from their techniques and aesthetics. Using weighting, like `(by Charlie Bowater:0.9)`, can fine-tune the influence of these references.

By following these structured guidelines for prompt creation, users can significantly improve the quality and relevance of their AI-generated images. Understanding the interplay of subject, media, style, details, and lighting, along with the strategic use of negative prompts and weighting, empowers users to achieve remarkable results. The SeaArt community encourages users to apply these techniques, create art, and share their creations.