20

LLM pretraining data-mixture sankey
Enlarge

LLM pretraining data-mixture sankey

Prompt
Landscape 16:9 sankey diagram of a pretraining data mixture, three stages with translucent colored ribbons.

LEFT (8 source blocks, heights proportional to tokens): "Common Crawl (web) 540B" (muted navy, largest), "arXiv papers 180B" (dusty teal), "GitHub code 160B" (slate gray), "Wikipedia 40B" (soft terracotta), "StackExchange QA 30B" (warm copper), "Books (public domain) 25B" (pale olive), "Patents 18B" (pale navy), "Curated news & forums 15B" (dusty teal).

MIDDLE (3 processing blocks, stacked): "Deduplicated (MinHash + exact)", "Quality-filtered (classifier + heuristics)", "PII-scrubbed (regex + NER)".

RIGHT (3 final splits): "Pretraining set 1.4T tokens" (largest), "Instruction-tune pool 12B tokens", "RLHF preference pool 3B tokens".

Flow ribbons inherit source color with mid-labels showing token counts ("85B", "320B", "44B"). Legend strip at bottom.

Title: "LLM pretraining data mixture and downstream splits". Subtitle: "token counts after deduplication and quality filtering; ribbon thickness ∝ token flow."
Category
Charts & Infographics
Model
GPT Image 2
Creator
wuyoscar
Views3
Source ID
086

Guide

About "LLM pretraining data-mixture sankey"

What is this prompt for?

"LLM pretraining data-mixture sankey" AI image prompt for GPT Image 2 (Charts & Infographics). Landscape 16:9 sankey diagram of a pretraining data mixture, thr…

The full copyable prompt and example visuals above are ready for AI image generation or one-click recreate in Picva.

How to use this prompt

  1. Step 1

    Open the prompt detail

    Review the example visuals, category, and full prompt text for "LLM pretraining data-mixture sankey".

  2. Step 2

    Copy the prompt

    Copy the prompt body from this page, or load it directly in Studio.

  3. Step 3

    Pick a model (GPT Image 2)

    Prefer GPT Image 2. If you switch models, keep subject and composition and tweak style terms.

  4. Step 4

    Generate and export

    Recreate the look in Picva, or export into your workflow for editing and publishing.

FAQ

What is the "LLM pretraining data-mixture sankey" prompt?
It is an AI image-generation prompt for GPT Image 2 in the Charts & Infographics category. This page includes the full prompt text, example visuals, and a one-click recreate path in Picva.
How do I use this prompt to generate an image?
Copy the prompt from this page, or use Generate / Studio. Paste it into a compatible image model, or recreate the look in Picva with optional reference images.
Which model is this prompt for?
This page lists GPT Image 2. Most descriptive prompts also transfer to nearby image models such as GPT Image, Flux, or Midjourney with light style tweaks.
Can I use the result commercially?
You can usually copy the prompt for creation, but commercial use of the final image depends on the model terms, reference-image rights, and the generated content. Follow the source author and platform rules.