Disco AI

↝      Year

2022

↝      Description

Note: These experiments were done a few years before AI image generation really took off.

Exploring and experimenting with OpenAI unconditional diffusion models, mainly using Disco Diffusion. Thank you to the DElab of the Hasso Plattner Institute for letting me use the power of a few A100 GPUs.
It was incredibly interesting to learn more and more of how the AI interprets the input, both the prompt as well as all the other parameters, and getting better at formulating of what I want the AI to do. In the midst of exploring, I followed the development of StabilityAI's Stable Diffusion, which blew these models out of the water in terms of coherency and speed. Feel free to see my experiments with Stable Diffusion here →

You may notice the number of iterations for each image; to get the results I had in mind, I had to fiddle around a lot with the parameters of the generation as well as the prompt formulation. Nth iteration means that this was the nth image generated from the same conceptual idea. If you are interested in the nitty gritty details, an example prompt can be found at the bottom of this page.

↝      Tools used

Disco Diffusion     
Python     
Photoshop
flamingo39th iteration
tucan21st iteration
robo battle of colors211th iteration
temple of petra182nd iteration
nepal218th iteration
royal portrait14th iteration
bratty portrait9th iteration
samurai portrait3rd iteration

 

sunflower portrait8th iteration
overgrown battlefield137th iteration
vision of ecstasy6th iteration

 

alien plant still life46th iteration

 

pastel rock waterfall11th iteration
holographic ocean cliff34th iteration
robotvs                                     robotvs                                      ╭─────────────────────────┬────────────────────────────────────────────────────╮ │               Argument│Value                                             │ ├─────────────────────────┼────────────────────────────────────────────────────┤ │             batch_name│None│ │             batch_size│1│ │             clamp_grad│True│ │clamp_max*│0.08│ │          clip_denoised│False│ │clip_guidance_scale*│16000│ │clip_models*│['ViT-B-32::openai', 'ViT-B-16::openai',          │ ││'ViT-L-14-336::openai', 'RN101::openai',          │ ││'RN50x4::openai']│ │  clip_models_schedules│None│ │cut_ic_pow*│5.0│ │           cut_icgray_p│[0.2]*400+[0]*600│ │cut_innercut*│[2]*200+[4]*200+[12]*200+[18]*200+[20]*200│ │cut_overview*│[18]*200+[16]*200+[8]*200+[2]*200+[0]*200│ │    cut_schedules_group│None│ │           cutn_batches│4│ │        diffusion_model│512x512_diffusion_uncond_finetune_008100          │ │ diffusion_model_config│None│ │diffusion_sampling_mode│ddim                                              │ │display_rate*│80│ │eta*│-0.8│ │           fuzzy_prompt│False│ │             init_image│None│ │             init_scale│1000│ │n_batches*│5│ │name_docarray*│robotvs                                           │ │    on_misspelled_token│ignore                                            │ │perlin_init*│True│ │            perlin_mode│mixed                                             │ │               rand_mag│0.05│ │        randomize_class│True│ │range_scale*│20000│ │sat_scale*│75000│ │seed*│3674016269│ │              skip_augs│False│ │skip_steps*│20│ │steps*│500│ │text_prompts*│['Big robot mechs fight against each other in a │ ││white desert with colorful powder explosions in │ ││the environment, by Emmanuel Shiu and Raphael │ ││Lacoste:10', 'colorful, epic, atmospheric, action,│ ││Titanfall mech, Real Steel Mech, Transformers, │ ││Pacific Rim titans, ultra detailed, trending on │ ││artstation, 4k resolution:8', 'blurry:-2']│ │ transformation_percent│[0.09]│ │tv_scale*│1000│ │use_horizontal_symmetry│False│ │    use_secondary_model│True│ │  use_vertical_symmetry│False│ │width_height*│[1024, 576]│ ╰─────────────────────────┴────────────────────────────────────────────────────╯                  showing all args (bold * args are non-default)                 
Example prompt with parameters

←      Go Back