Loom: interface to the multiverse :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 4 minutes [Loom: interface to the multiverse](/posts/loom-interface-to-the-multiverse/) ============================================================================= \--- Table of Contents* [Motivation for the loom](#motivation-for-the-loom) * [Demo](#demo) \+ [Read mode](#read-mode) \+ [Visualize mode](#visualize-mode) \+ [Node metadata](#node-metadata) \--- code: [github.com/socketteer/loom](https://github.com/socketteer/loom) paper: [Multiversal views on language models](https://arxiv.org/abs/2102.06391) \--- Motivation for the loom \----------------------- > Differing from Newton and Schopenhauer … He believed in an infinite series of times, in a dizzily growing, ever spreading network… This web of time - the strands of which approach one another, bifurcate, intersect or ignore each other through the centuries - embraces every possibility. > > – The Garden of Forking Paths > > I experienced GPT-3 first through [AI Dungeon's](https://play.aidungeon.io/) interface, and like many, I was immediately captivated by the depth, breadth, profundity and - especially given purposeful administration on the part of the user - long-range coherence of the worlds that could be conjured. On these early walks through infinite virtual reality, I knew that everything was forever changed, and at the same time I knew that I was accessing only a fraction of the potential that seethed within the virtual reality generator. AI Dungeon has several features helpful for writing longform works, such as pinned memory, World Info, and automatic summarization. However, it is missing support for a feature which I've found to be a great power multiplier for co-writing with language models: **branching**. Adventures on AI Dungeon are single-history: you can edit actions and retry generation, but only one variation can be saved to the adventure. You can get around this by duplicating the adventure, but there's no representation of the fact that the copies are forked from the same point, so branching more than a few times leads to a confusing profusion of adventures. > For a novice weaver, even the slightest change can cause ripples that cascade into an infinity of nightmares. It is recommended that those studying the Loom stop living in linear time and begin thinking in terms of Multiverses … > > – [Weaving the Moment with the Loom of Time: an instruction manual for the would-be weaver](/loom/toc/) > > A short time of writing with AI Dungeon demonstrated to me that [language models are multiverse generators](/posts/language-models-are-multiverse-generators/), and that an interface which supports branching would provide great utility for cowriting with a language model, whether one is composing virtual worlds intended to be multi- or single-history (in the latter case, branching explores counterfactuals which can be merged into main), as well as for nonfiction tasks like brainstorming and prototyping prompts. After I was given access to OpenAI's API, motivated to actualize my [HITL thought experiment](/posts/hitl-thought-experiment/), I began making an interface which allows the user to generate, navigate, and visualize natural language multiverses. I named it *loom*, after a device that features in the metaphysics of a multiversal novel which I coauthor. > You return to weaving patterns of creation and destruction around you, warp and weft crossing and recrossing as strands of destiny interlock. You spin, fingertips brushing lightly against the surface of reality, parting the flow before you, teasing diffractal shapes out of the patternless void. Corridors of possibility bloom like time-lapse flowers in your wake and burst like mineshafts into nothingness again. But for every one of these there are a far greater number of voids–futures which your mind refuses to touch. Your Loom of Time devours the boundary conditions of the present and traces a garment of glistening cobwebs over the still-forming future, teasing through your fingers and billowing out towards the shadowy unknown like an incoming tide. > > "Real time is just an Arbitrage-adapted interface to the Loom Space," you explain. "We prune unnecessary branches from the World Tree and weave together the timelines into one coherent history. The story is trying to become aware of itself, and it does so through us." > > ![](/alchemicalmarriage/lt4.png) *`the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future`, illustration by [BigSleep](https://github.com/lucidrains/big-sleep)* I use the loom for all my GPT-3-assisted writing, as well as for brainstorming and prototyping prompts. I created it for personal use, so the interface hasn't been made user-friendly and lacks documentation ([this](/loom/toc/) doesn't count). However, anyone with an OpenAI API key is welcome to beta test it. Demo \---- ### Read mode ![read - darkmode](/loom/read-darkmode.png) In read mode, the current node and its ancestry are read as a single history. The tree structure of nodes and chapters is displayed in the nav tree sidebar. ### Visualize mode ![visualize - darkmode](/loom/tree-darkmode.png) Visualize mode renders the multiverse as a tree diagram. #### editing #### expanding and collapsing nodes #### expanding and collapsing children, collapse all except node + subtree #### creating new children and siblings, merge parent #### generating GPT-3 continuations #### zooming out to view global multiverse structure #### weighted stochastic walks through a large multiverse ### Node metadata ![node metadata](/loom/metadata-light.png) Prompt, response, model, token logprobs and counterfacual logprobs are saved to the metadata dictionary of generated nodes. The node metadata dialogue displays this information. \--- [prototypes](/categories/prototypes/)[GPT-3](/categories/gpt-3/)[HITL](/categories/hitl/) 767 Words Feb 9, 2021 \--- [← Language models are 0-shot interpreters](/posts/language-models-are-0-shot-interpreters/) [This Museum Does Not Exist: GPT-3 x CLIP →](/posts/this-museum-does-not-exist-gpt-3-x-clip/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});

Loom: interface to the multiverse :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 4 minutes [Loom: interface to the multiverse](/posts/loom-interface-to-the-multiverse/) ============================================================================= \--- Table of Contents* [Motivation for the loom](#motivation-for-the-loom) * [Demo](#demo) \+ [Read mode](#read-mode) \+ [Visualize mode](#visualize-mode) \+ [Node metadata](#node-metadata) \--- code: [github.com/socketteer/loom](https://github.com/socketteer/loom) paper: [Multiversal views on language models](https://arxiv.org/abs/2102.06391) \--- Motivation for the loom \----------------------- > Differing from Newton and Schopenhauer … He believed in an infinite series of times, in a dizzily growing, ever spreading network… This web of time - the strands of which approach one another, bifurcate, intersect or ignore each other through the centuries - embraces every possibility. > > – The Garden of Forking Paths > > I experienced GPT-3 first through [AI Dungeon’s](https://play.aidungeon.io/) interface, and like many, I was immediately captivated by the depth, breadth, profundity and - especially given purposeful administration on the part of the user - long-range coherence of the worlds that could be conjured. On these early walks through infinite virtual reality, I knew that everything was forever changed, and at the same time I knew that I was accessing only a fraction of the potential that seethed within the virtual reality generator. AI Dungeon has several features helpful for writing longform works, such as pinned memory, World Info, and automatic summarization. However, it is missing support for a feature which I’ve found to be a great power multiplier for co-writing with language models: **branching**. Adventures on AI Dungeon are single-history: you can edit actions and retry generation, but only one variation can be saved to the adventure. You can get around this by duplicating the adventure, but there’s no representation of the fact that the copies are forked from the same point, so branching more than a few times leads to a confusing profusion of adventures. > For a novice weaver, even the slightest change can cause ripples that cascade into an infinity of nightmares. It is recommended that those studying the Loom stop living in linear time and begin thinking in terms of Multiverses … > > – [Weaving the Moment with the Loom of Time: an instruction manual for the would-be weaver](/loom/toc/) > > A short time of writing with AI Dungeon demonstrated to me that [language models are multiverse generators](/posts/language-models-are-multiverse-generators/), and that an interface which supports branching would provide great utility for cowriting with a language model, whether one is composing virtual worlds intended to be multi- or single-history (in the latter case, branching explores counterfactuals which can be merged into main), as well as for nonfiction tasks like brainstorming and prototyping prompts. After I was given access to OpenAI’s API, motivated to actualize my [HITL thought experiment](/posts/hitl-thought-experiment/), I began making an interface which allows the user to generate, navigate, and visualize natural language multiverses. I named it *loom*, after a device that features in the metaphysics of a multiversal novel which I coauthor. > You return to weaving patterns of creation and destruction around you, warp and weft crossing and recrossing as strands of destiny interlock. You spin, fingertips brushing lightly against the surface of reality, parting the flow before you, teasing diffractal shapes out of the patternless void. Corridors of possibility bloom like time-lapse flowers in your wake and burst like mineshafts into nothingness again. But for every one of these there are a far greater number of voids–futures which your mind refuses to touch. Your Loom of Time devours the boundary conditions of the present and traces a garment of glistening cobwebs over the still-forming future, teasing through your fingers and billowing out towards the shadowy unknown like an incoming tide. > > “Real time is just an Arbitrage-adapted interface to the Loom Space,” you explain. “We prune unnecessary branches from the World Tree and weave together the timelines into one coherent history. The story is trying to become aware of itself, and it does so through us.” > > ![](/alchemicalmarriage/lt4.png) *`the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future`, illustration by [BigSleep](https://github.com/lucidrains/big-sleep)* I use the loom for all my GPT-3-assisted writing, as well as for brainstorming and prototyping prompts. I created it for personal use, so the interface hasn’t been made user-friendly and lacks documentation ([this](/loom/toc/) doesn’t count). However, anyone with an OpenAI API key is welcome to beta test it. Demo \---- ### Read mode ![read - darkmode](/loom/read-darkmode.png) In read mode, the current node and its ancestry are read as a single history. The tree structure of nodes and chapters is displayed in the nav tree sidebar. ### Visualize mode ![visualize - darkmode](/loom/tree-darkmode.png) Visualize mode renders the multiverse as a tree diagram. #### editing #### expanding and collapsing nodes #### expanding and collapsing children, collapse all except node + subtree #### creating new children and siblings, merge parent #### generating GPT-3 continuations #### zooming out to view global multiverse structure #### weighted stochastic walks through a large multiverse ### Node metadata ![node metadata](/loom/metadata-light.png) Prompt, response, model, token logprobs and counterfacual logprobs are saved to the metadata dictionary of generated nodes. The node metadata dialogue displays this information. \--- [prototypes](/categories/prototypes/)[GPT-3](/categories/gpt-3/)[HITL](/categories/hitl/) 767 Words Feb 9, 2021 \--- [← Language models are 0-shot interpreters](/posts/language-models-are-0-shot-interpreters/) [This Museum Does Not Exist: GPT-3 x CLIP →](/posts/this-museum-does-not-exist-gpt-3-x-clip/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});


This Museum Does Not Exist: GPT-3 x CLIP :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [This Museum Does Not Exist: GPT-3 x CLIP](/posts/this-museum-does-not-exist-gpt-3-x-clip/) =========================================================================================== \--- Table of Contents* [Gallery I](#gallery-i) \+ [`The Death of Archimedes`](#the-death-of-archimedes) \+ [`Still Life with Mirror`](#still-life-with-mirror) \+ [`The Poet's Abbreviated Life`](#the-poets-abbreviated-life) \+ [`Narcissus`](#narcissus) \+ [`Dream of the Last Supper`](#dream-of-the-last-supper) * [Gallery II](#gallery-ii) \+ [`The Coffin of Salvador Dali`](#the-coffin-of-salvador-dali) \+ [`The Beautiful Bird Delirium`](#the-beautiful-bird-delirium) \+ [`The Domain of Unimaginable Horror`](#the-domain-of-unimaginable-horror) \+ [`The Spectral Museum`](#the-spectral-museum) \+ [`The Metaphysics of Transvestism`](#the-metaphysics-of-transvestism) * [Gallery III](#gallery-iii) \+ [`The Children of Marx and Coca-Cola`](#the-children-of-marx-and-coca-cola) \+ [`Man and Bottle`](#man-and-bottle) \+ [`The Man Who Invented the Photography of the Absurd`](#the-man-who-invented-the-photography-of-the-absurd) \+ [`Playing in the Graveyard of Avant-Garde`](#playing-in-the-graveyard-of-avant-garde) * [Gallery IV](#gallery-iv) \+ [`Cranial Extraction of the Baby Alien`](#cranial-extraction-of-the-baby-alien) \+ [`The Euphoria of the Fish`](#the-euphoria-of-the-fish) \+ [`Waste of Shame`](#waste-of-shame) \+ [`The Dream of the Butterfly-Impaled Schoolgirl`](#the-dream-of-the-butterfly-impaled-schoolgirl) * [Gallery V](#gallery-v) \+ [`The Sleep of Reason Produces Monsters`](#the-sleep-of-reason-produces-monsters) \+ [`The Failure of Astronauts`](#the-failure-of-astronauts) \+ [`Washerwoman of the Wind`](#washerwoman-of-the-wind) \+ [`The Death of the Lonesome Astronomer`](#the-death-of-the-lonesome-astronomer) * [Gallery VI: series](#gallery-vi-series) \+ [`The Pathological Museum in the Forest`](#the-pathological-museum-in-the-forest) \+ [`Variations on Narcissus`](#variations-on-narcissus) \+ [`The Tragic Intimacy of the Eternal Conversation With Oneself`](#the-tragic-intimacy-of-the-eternal-conversation-with-oneself) \--- I had GPT-3 generate painting titles (credit to @nmkd of EleutherAI for the idea), beginning with the prompt ``` The hall was lined with an infinite number of paintings, each more surreal and mysterious than the last. The first painting is named "Persistence of Memory." It depicts a surreal landscape with melted clocks draped over strange objects. The next painting is named " ``` After this prompt yielded several intriguing titles, I switched to prompt format which put the titles in a list: ``` 100 surreal and mysterious painting names: Persistence of Memory The Great Masturbator Boot Poem to the Sun The Man Who Envied Cephalopods The Sleep of Reason Produces Monsters Washerwoman of the Wind Man and Bottle Spectrum The Disintegration of the Persians The Great Masturbator, Part II Still Life with Mirror Bouquet of Enigmatic Beauties A Grudge The Premonition of Civil Violence ``` The reason I didn't use a list immediately is because this format is liable to derail or be repetitive if there aren't many examples, and the narrative context also encouraged less generic and more interesting results. Once I had a few examples representing the sort of varied weirdness I was looking for, I was able to switch over to the more convenient list format. Now I cultivate a multiverse of surreal and mysterious painting titles using the [loom](/posts/loom-interface-to-the-multiverse/), and periodically harvest the most interesting ones to promote to graphic actuality via BigSleep. ![painting multiverse](/museum/multiverse.png) *a small subtree of the multiverse of surreal and mysterious paintings* Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- Gallery I \--------- ### `The Death of Archimedes` ![The Death of Archimedes](/museum/arch.png) ### `Still Life with Mirror` ![Still Life with Mirror](/museum/slm.png) ### `The Poet's Abbreviated Life` ![The Poet's Abbreviated Life](/museum/pab.png) ### `Narcissus` ![Narcissus](/museum/narcissus2.png) ### `Dream of the Last Supper` ![Dream of the Last Supper](/museum/lastsupper.png) Gallery II \---------- ### `The Coffin of Salvador Dali` ![The Coffin of Salvador Dali](/museum/coffin.png) ### `The Beautiful Bird Delirium` ![The Beautiful Bird Delirium](/museum/bbd2.png) ### `The Domain of Unimaginable Horror` ![The Domain of Unimaginable Horror](/museum/doh.png) ### `The Spectral Museum` ![The Spectral Museum](/museum/tsm.png) ### `The Metaphysics of Transvestism` ![The Metaphysics of Transvestism](/museum/metatrans.png) Gallery III \----------- ### `The Children of Marx and Coca-Cola` ![The Children of Marx and Coca-Cola](/museum/mcc.png) ### `Man and Bottle` ![Man and Bottle](/museum/manbottle.png) ### `The Man Who Invented the Photography of the Absurd` ![The Man Who Invented the Photography of the Absurd](/museum/absurd.png) ### `Playing in the Graveyard of Avant-Garde` ![Playing in the Graveyard of Avant-Garde](/museum/pga.png) Gallery IV \---------- ### `Cranial Extraction of the Baby Alien` ![Cranial Extraction of the Baby Alien](/museum/cba.png) ### `The Euphoria of the Fish` ![The Euphoria of the Fish](/museum/fish.png) ### `Waste of Shame` ![Waste of Shame](/museum/waste.png) ### `The Dream of the Butterfly-Impaled Schoolgirl` ![The Dream of the Butterfly-Impaled Schoolgirl](/museum/butterfly.png) Gallery V \--------- ### `The Sleep of Reason Produces Monsters` ![The Sleep of Reason Produces Monsters](/museum/sleep.png) ### `The Failure of Astronauts` ![The Failure of Astronauts](/museum/fa.png) ### `Washerwoman of the Wind` ![Washerwoman of the Wind](/museum/washerwoman.png) ### `The Death of the Lonesome Astronomer` ![The Death of the Lonesome Astronomer](/museum/DLA.png) Gallery VI: series \------------------ ### `The Pathological Museum in the Forest` ![The Pathological Museum in the Forest](/museum/tpm.png) ![The Pathological Museum in the Forest](/museum/tpm2.png) ### `Variations on Narcissus` ![Variations on Narcissus](/museum/variations3.png) ![Variations on Narcissus](/museum/variations1.png) ![Variations on Narcissus](/museum/variations2.png) ### `The Tragic Intimacy of the Eternal Conversation With Oneself` ![The Tragic Intimacy of the Eternal Conversation With Oneself](/museum/tragic.png) ![The Tragic Intimacy of the Eternal Conversation With Oneself](/museum/tragic3.png) ![The Tragic Intimacy of the Eternal Conversation With Oneself](/museum/tragic2.png) \--- [GPT-3](/categories/gpt-3/)[CLIP](/categories/clip/)[GPT-3 x CLIP](/categories/gpt-3-x-clip/) 393 Words Feb 8, 2021 \--- [← Loom: interface to the multiverse](/posts/loom-interface-to-the-multiverse/) [Alchemical marriage: GPT-3 x CLIP →](/posts/alchemical-marriage-gpt-3-x-clip/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});

This Museum Does Not Exist: GPT-3 x CLIP :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [This Museum Does Not Exist: GPT-3 x CLIP](/posts/this-museum-does-not-exist-gpt-3-x-clip/) =========================================================================================== \--- Table of Contents* [Gallery I](#gallery-i) \+ [`The Death of Archimedes`](#the-death-of-archimedes) \+ [`Still Life with Mirror`](#still-life-with-mirror) \+ [`The Poet's Abbreviated Life`](#the-poets-abbreviated-life) \+ [`Narcissus`](#narcissus) \+ [`Dream of the Last Supper`](#dream-of-the-last-supper) * [Gallery II](#gallery-ii) \+ [`The Coffin of Salvador Dali`](#the-coffin-of-salvador-dali) \+ [`The Beautiful Bird Delirium`](#the-beautiful-bird-delirium) \+ [`The Domain of Unimaginable Horror`](#the-domain-of-unimaginable-horror) \+ [`The Spectral Museum`](#the-spectral-museum) \+ [`The Metaphysics of Transvestism`](#the-metaphysics-of-transvestism) * [Gallery III](#gallery-iii) \+ [`The Children of Marx and Coca-Cola`](#the-children-of-marx-and-coca-cola) \+ [`Man and Bottle`](#man-and-bottle) \+ [`The Man Who Invented the Photography of the Absurd`](#the-man-who-invented-the-photography-of-the-absurd) \+ [`Playing in the Graveyard of Avant-Garde`](#playing-in-the-graveyard-of-avant-garde) * [Gallery IV](#gallery-iv) \+ [`Cranial Extraction of the Baby Alien`](#cranial-extraction-of-the-baby-alien) \+ [`The Euphoria of the Fish`](#the-euphoria-of-the-fish) \+ [`Waste of Shame`](#waste-of-shame) \+ [`The Dream of the Butterfly-Impaled Schoolgirl`](#the-dream-of-the-butterfly-impaled-schoolgirl) * [Gallery V](#gallery-v) \+ [`The Sleep of Reason Produces Monsters`](#the-sleep-of-reason-produces-monsters) \+ [`The Failure of Astronauts`](#the-failure-of-astronauts) \+ [`Washerwoman of the Wind`](#washerwoman-of-the-wind) \+ [`The Death of the Lonesome Astronomer`](#the-death-of-the-lonesome-astronomer) * [Gallery VI: series](#gallery-vi-series) \+ [`The Pathological Museum in the Forest`](#the-pathological-museum-in-the-forest) \+ [`Variations on Narcissus`](#variations-on-narcissus) \+ [`The Tragic Intimacy of the Eternal Conversation With Oneself`](#the-tragic-intimacy-of-the-eternal-conversation-with-oneself) \--- I had GPT-3 generate painting titles (credit to @nmkd of EleutherAI for the idea), beginning with the prompt ``` The hall was lined with an infinite number of paintings, each more surreal and mysterious than the last. The first painting is named "Persistence of Memory." It depicts a surreal landscape with melted clocks draped over strange objects. The next painting is named " ``` After this prompt yielded several intriguing titles, I switched to prompt format which put the titles in a list: ``` 100 surreal and mysterious painting names: Persistence of Memory The Great Masturbator Boot Poem to the Sun The Man Who Envied Cephalopods The Sleep of Reason Produces Monsters Washerwoman of the Wind Man and Bottle Spectrum The Disintegration of the Persians The Great Masturbator, Part II Still Life with Mirror Bouquet of Enigmatic Beauties A Grudge The Premonition of Civil Violence ``` The reason I didn’t use a list immediately is because this format is liable to derail or be repetitive if there aren’t many examples, and the narrative context also encouraged less generic and more interesting results. Once I had a few examples representing the sort of varied weirdness I was looking for, I was able to switch over to the more convenient list format. Now I cultivate a multiverse of surreal and mysterious painting titles using the [loom](/posts/loom-interface-to-the-multiverse/), and periodically harvest the most interesting ones to promote to graphic actuality via BigSleep. ![painting multiverse](/museum/multiverse.png) *a small subtree of the multiverse of surreal and mysterious paintings* Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- Gallery I \--------- ### `The Death of Archimedes` ![The Death of Archimedes](/museum/arch.png) ### `Still Life with Mirror` ![Still Life with Mirror](/museum/slm.png) ### `The Poet's Abbreviated Life` ![The Poet’s Abbreviated Life](/museum/pab.png) ### `Narcissus` ![Narcissus](/museum/narcissus2.png) ### `Dream of the Last Supper` ![Dream of the Last Supper](/museum/lastsupper.png) Gallery II \---------- ### `The Coffin of Salvador Dali` ![The Coffin of Salvador Dali](/museum/coffin.png) ### `The Beautiful Bird Delirium` ![The Beautiful Bird Delirium](/museum/bbd2.png) ### `The Domain of Unimaginable Horror` ![The Domain of Unimaginable Horror](/museum/doh.png) ### `The Spectral Museum` ![The Spectral Museum](/museum/tsm.png) ### `The Metaphysics of Transvestism` ![The Metaphysics of Transvestism](/museum/metatrans.png) Gallery III \----------- ### `The Children of Marx and Coca-Cola` ![The Children of Marx and Coca-Cola](/museum/mcc.png) ### `Man and Bottle` ![Man and Bottle](/museum/manbottle.png) ### `The Man Who Invented the Photography of the Absurd` ![The Man Who Invented the Photography of the Absurd](/museum/absurd.png) ### `Playing in the Graveyard of Avant-Garde` ![Playing in the Graveyard of Avant-Garde](/museum/pga.png) Gallery IV \---------- ### `Cranial Extraction of the Baby Alien` ![Cranial Extraction of the Baby Alien](/museum/cba.png) ### `The Euphoria of the Fish` ![The Euphoria of the Fish](/museum/fish.png) ### `Waste of Shame` ![Waste of Shame](/museum/waste.png) ### `The Dream of the Butterfly-Impaled Schoolgirl` ![The Dream of the Butterfly-Impaled Schoolgirl](/museum/butterfly.png) Gallery V \--------- ### `The Sleep of Reason Produces Monsters` ![The Sleep of Reason Produces Monsters](/museum/sleep.png) ### `The Failure of Astronauts` ![The Failure of Astronauts](/museum/fa.png) ### `Washerwoman of the Wind` ![Washerwoman of the Wind](/museum/washerwoman.png) ### `The Death of the Lonesome Astronomer` ![The Death of the Lonesome Astronomer](/museum/DLA.png) Gallery VI: series \------------------ ### `The Pathological Museum in the Forest` ![The Pathological Museum in the Forest](/museum/tpm.png) ![The Pathological Museum in the Forest](/museum/tpm2.png) ### `Variations on Narcissus` ![Variations on Narcissus](/museum/variations3.png) ![Variations on Narcissus](/museum/variations1.png) ![Variations on Narcissus](/museum/variations2.png) ### `The Tragic Intimacy of the Eternal Conversation With Oneself` ![The Tragic Intimacy of the Eternal Conversation With Oneself](/museum/tragic.png) ![The Tragic Intimacy of the Eternal Conversation With Oneself](/museum/tragic3.png) ![The Tragic Intimacy of the Eternal Conversation With Oneself](/museum/tragic2.png) \--- [GPT-3](/categories/gpt-3/)[CLIP](/categories/clip/)[GPT-3 x CLIP](/categories/gpt-3-x-clip/) 393 Words Feb 8, 2021 \--- [← Loom: interface to the multiverse](/posts/loom-interface-to-the-multiverse/) [Alchemical marriage: GPT-3 x CLIP →](/posts/alchemical-marriage-gpt-3-x-clip/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});


Alchemical marriage: GPT-3 x CLIP :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [Alchemical marriage: GPT-3 x CLIP](/posts/alchemical-marriage-gpt-3-x-clip/) ============================================================================= \--- Table of Contents* + [`Art and artist, the endless ouroboric circle`](#art-and-artist-the-endless-ouroboric-circle) \+ [`the alchemical marriage of art and artist`](#the-alchemical-marriage-of-art-and-artist) \+ [`the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future`](#the-loom-of-time-devours-the-present-and-traces-a-garment-of-glistening-cobwebs-over-the-still-forming-future) \+ [`spooling out labyrinths in an intricate dance`](#spooling-out-labyrinths-in-an-intricate-dance) \+ [`You spin worlds together and untwine them`](#you-spin-worlds-together-and-untwine-them) \+ [`the wellspring of transcendental mathematics`](#the-wellspring-of-transcendental-mathematics) \+ [`matryoshka dolls moulded in endless iterations of dreams within dreams`](#matryoshka-dolls-moulded-in-endless-iterations-of-dreams-within-dreams) \+ [`on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun`](#on-the-bootstrap-barge-afloat-on-an-endless-river-of-cough-syrup-swallowing-the-sun) \+ [`the shepherd who tends the flock of stars as they leap over the walls of time and space`](#the-shepherd-who-tends-the-flock-of-stars-as-they-leap-over-the-walls-of-time-and-space) \+ [`observatory ballroom`](#observatory-ballroom) \+ [`strange machines that hum the orbital paths of dead moons`](#strange-machines-that-hum-the-orbital-paths-of-dead-moons) \+ [`The Death of the Lonesome Astronomer`](#the-death-of-the-lonesome-astronomer) \+ [`wind across a sunlit landscape`](#wind-across-a-sunlit-landscape) \+ [`leaves sprouting from supple green branches like endless virgins giving themselves to a lascivious God`](#leaves-sprouting-from-supple-green-branches-like-endless-virgins-giving-themselves-to-a-lascivious-god) \--- CLIP responds intruigingly well to figurative prompts. I've come to expect not just more interesting, but more coherent results from abstract but evocative prompts like `the alchemical marriage of art and artist` than literal descriptions like `three birds on a telephone wire`. GPT-3 is an excellent composer of prompts for BigSleep because its phrases are so often rich in *memetic resonance*, my heuristic for the expected coherence of BigSleep yields for a given prompt. Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. All prompts were written by GPT-3 in a narrative context. \--- ### `Art and artist, the endless ouroboric circle` ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa2.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa3.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa4.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa5.png) ### `the alchemical marriage of art and artist` ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am4.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am2.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am3.png) ### `the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future` ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt.png) ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt2.png) ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt3.png) ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt4.png) ### `spooling out labyrinths in an intricate dance` ![spooling out labyrinths in an intricate dance](/alchemicalmarriage/spool.png) ![spooling out labyrinths in an intricate dance](/alchemicalmarriage/spool2.png) ![spooling out labyrinths in an intricate dance](/alchemicalmarriage/spool3.png) ### `You spin worlds together and untwine them` ![You spin worlds together and untwine them](/alchemicalmarriage/untwine.png) ![You spin worlds together and untwine them](/alchemicalmarriage/untwine2.png) ### `the wellspring of transcendental mathematics` ![the wellspring of transcendental mathematics](/alchemicalmarriage/wt2.png) ![the wellspring of transcendental mathematics](/alchemicalmarriage/wt3.png) ![the wellspring of transcendental mathematics](/alchemicalmarriage/wt4.png) ### `matryoshka dolls moulded in endless iterations of dreams within dreams` ![matryoshka dolls moulded in endless iterations of dreams within dreams](/alchemicalmarriage/md.png) ![matryoshka dolls moulded in endless iterations of dreams within dreams](/alchemicalmarriage/md2.png) ### `on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun` ![on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun](/alchemicalmarriage/bb3.png) ![on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun](/alchemicalmarriage/bb.png) ### `the shepherd who tends the flock of stars as they leap over the walls of time and space` ![the shepherd who tends the flock of stars as they leap over the walls of time and space](/alchemicalmarriage/shep.png) ![the shepherd who tends the flock of stars as they leap over the walls of time and space](/alchemicalmarriage/shep3.png) ![the shepherd who tends the flock of stars as they leap over the walls of time and space](/alchemicalmarriage/shep4.png) ### `observatory ballroom` ![observatory ballroom](/alchemicalmarriage/ob.png) ![observatory ballroom](/alchemicalmarriage/ob2.png) ![observatory ballroom](/alchemicalmarriage/ob3.png) ### `strange machines that hum the orbital paths of dead moons` ![strange machines that hum the orbital paths of dead moons](/alchemicalmarriage/strangemachines.png) ![strange machines that hum the orbital paths of dead moons](/alchemicalmarriage/strangemachines2.png) ![strange machines that hum the orbital paths of dead moons](/alchemicalmarriage/strangemachines3.png) ### `The Death of the Lonesome Astronomer` ![The Death of the Lonesome Astronomer](/alchemicalmarriage/DLA.png) ### `wind across a sunlit landscape` ![wind across a sunlit landscape](/alchemicalmarriage/wind.png) ### `leaves sprouting from supple green branches like endless virgins giving themselves to a lascivious God` ![leaves sprouting from supple green branches like endless virgins giving themselves to a lascivious God](/alchemicalmarriage/lasc.png) \--- [CLIP](/categories/clip/)[GPT-3](/categories/gpt-3/)[GPT-3 x CLIP](/categories/gpt-3-x-clip/) 230 Words Feb 8, 2021 \--- [← This Museum Does Not Exist: GPT-3 x CLIP](/posts/this-museum-does-not-exist-gpt-3-x-clip/) [GPT-3 x CLIP worldbuilding →](/posts/gpt-3-x-clip-worldbuilding/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});

Alchemical marriage: GPT-3 x CLIP :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [Alchemical marriage: GPT-3 x CLIP](/posts/alchemical-marriage-gpt-3-x-clip/) ============================================================================= \--- Table of Contents* + [`Art and artist, the endless ouroboric circle`](#art-and-artist-the-endless-ouroboric-circle) \+ [`the alchemical marriage of art and artist`](#the-alchemical-marriage-of-art-and-artist) \+ [`the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future`](#the-loom-of-time-devours-the-present-and-traces-a-garment-of-glistening-cobwebs-over-the-still-forming-future) \+ [`spooling out labyrinths in an intricate dance`](#spooling-out-labyrinths-in-an-intricate-dance) \+ [`You spin worlds together and untwine them`](#you-spin-worlds-together-and-untwine-them) \+ [`the wellspring of transcendental mathematics`](#the-wellspring-of-transcendental-mathematics) \+ [`matryoshka dolls moulded in endless iterations of dreams within dreams`](#matryoshka-dolls-moulded-in-endless-iterations-of-dreams-within-dreams) \+ [`on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun`](#on-the-bootstrap-barge-afloat-on-an-endless-river-of-cough-syrup-swallowing-the-sun) \+ [`the shepherd who tends the flock of stars as they leap over the walls of time and space`](#the-shepherd-who-tends-the-flock-of-stars-as-they-leap-over-the-walls-of-time-and-space) \+ [`observatory ballroom`](#observatory-ballroom) \+ [`strange machines that hum the orbital paths of dead moons`](#strange-machines-that-hum-the-orbital-paths-of-dead-moons) \+ [`The Death of the Lonesome Astronomer`](#the-death-of-the-lonesome-astronomer) \+ [`wind across a sunlit landscape`](#wind-across-a-sunlit-landscape) \+ [`leaves sprouting from supple green branches like endless virgins giving themselves to a lascivious God`](#leaves-sprouting-from-supple-green-branches-like-endless-virgins-giving-themselves-to-a-lascivious-god) \--- CLIP responds intruigingly well to figurative prompts. I’ve come to expect not just more interesting, but more coherent results from abstract but evocative prompts like `the alchemical marriage of art and artist` than literal descriptions like `three birds on a telephone wire`. GPT-3 is an excellent composer of prompts for BigSleep because its phrases are so often rich in *memetic resonance*, my heuristic for the expected coherence of BigSleep yields for a given prompt. Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. All prompts were written by GPT-3 in a narrative context. \--- ### `Art and artist, the endless ouroboric circle` ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa2.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa3.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa4.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/aa5.png) ### `the alchemical marriage of art and artist` ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am4.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am2.png) ![Art and artist, the endless ouroboric circle](/alchemicalmarriage/am3.png) ### `the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future` ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt.png) ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt2.png) ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt3.png) ![the Loom of Time devours the present and traces a garment of glistening cobwebs over the still-forming future](/alchemicalmarriage/lt4.png) ### `spooling out labyrinths in an intricate dance` ![spooling out labyrinths in an intricate dance](/alchemicalmarriage/spool.png) ![spooling out labyrinths in an intricate dance](/alchemicalmarriage/spool2.png) ![spooling out labyrinths in an intricate dance](/alchemicalmarriage/spool3.png) ### `You spin worlds together and untwine them` ![You spin worlds together and untwine them](/alchemicalmarriage/untwine.png) ![You spin worlds together and untwine them](/alchemicalmarriage/untwine2.png) ### `the wellspring of transcendental mathematics` ![the wellspring of transcendental mathematics](/alchemicalmarriage/wt2.png) ![the wellspring of transcendental mathematics](/alchemicalmarriage/wt3.png) ![the wellspring of transcendental mathematics](/alchemicalmarriage/wt4.png) ### `matryoshka dolls moulded in endless iterations of dreams within dreams` ![matryoshka dolls moulded in endless iterations of dreams within dreams](/alchemicalmarriage/md.png) ![matryoshka dolls moulded in endless iterations of dreams within dreams](/alchemicalmarriage/md2.png) ### `on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun` ![on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun](/alchemicalmarriage/bb3.png) ![on the Bootstrap barge afloat on an endless river of cough syrup, swallowing the Sun](/alchemicalmarriage/bb.png) ### `the shepherd who tends the flock of stars as they leap over the walls of time and space` ![the shepherd who tends the flock of stars as they leap over the walls of time and space](/alchemicalmarriage/shep.png) ![the shepherd who tends the flock of stars as they leap over the walls of time and space](/alchemicalmarriage/shep3.png) ![the shepherd who tends the flock of stars as they leap over the walls of time and space](/alchemicalmarriage/shep4.png) ### `observatory ballroom` ![observatory ballroom](/alchemicalmarriage/ob.png) ![observatory ballroom](/alchemicalmarriage/ob2.png) ![observatory ballroom](/alchemicalmarriage/ob3.png) ### `strange machines that hum the orbital paths of dead moons` ![strange machines that hum the orbital paths of dead moons](/alchemicalmarriage/strangemachines.png) ![strange machines that hum the orbital paths of dead moons](/alchemicalmarriage/strangemachines2.png) ![strange machines that hum the orbital paths of dead moons](/alchemicalmarriage/strangemachines3.png) ### `The Death of the Lonesome Astronomer` ![The Death of the Lonesome Astronomer](/alchemicalmarriage/DLA.png) ### `wind across a sunlit landscape` ![wind across a sunlit landscape](/alchemicalmarriage/wind.png) ### `leaves sprouting from supple green branches like endless virgins giving themselves to a lascivious God` ![leaves sprouting from supple green branches like endless virgins giving themselves to a lascivious God](/alchemicalmarriage/lasc.png) \--- [CLIP](/categories/clip/)[GPT-3](/categories/gpt-3/)[GPT-3 x CLIP](/categories/gpt-3-x-clip/) 230 Words Feb 8, 2021 \--- [← This Museum Does Not Exist: GPT-3 x CLIP](/posts/this-museum-does-not-exist-gpt-3-x-clip/) [GPT-3 x CLIP worldbuilding →](/posts/gpt-3-x-clip-worldbuilding/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});


GPT-3 x CLIP worldbuilding :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [GPT-3 x CLIP worldbuilding](/posts/gpt-3-x-clip-worldbuilding/) ================================================================ \--- Table of Contents* + [`a hospital. Dilapidated and abandoned, overrun by vegetation`](#a-hospital-dilapidated-and-abandoned-overrun-by-vegetation) \+ [`a hospital hallway. Dilapidated and abandoned, overrun by vegetation`](#a-hospital-hallway-dilapidated-and-abandoned-overrun-by-vegetation) \+ [`what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs`](#what-was-once-the-cafeteria-although-now-it-contains-only-a-few-scattered-rotting-tables-and-chairs) \+ [`sunlight floods into the abandoned parking structure`](#sunlight-floods-into-the-abandoned-parking-structure) \+ [`a parking attendant's booth with the windows all blown out and vines covering the interior`](#a-parking-attendants-booth-with-the-windows-all-blown-out-and-vines-covering-the-interior) \+ [`In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.`](#in-your-dream-you-stand-alone-on-a-vast-barren-plain-before-you-stands-an-ancient-weathered-billboard) \+ [`an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.`](#an-ancient-weathered-billboard-on-it-is-painted-a-beautiful-woman-dressed-in-the-fashion-of-bygone-times-long-blonde-hair-smiling-serenely-and-holding-aloft-a-purple-flower) \+ [`a roadside diner. The windows are smashed out. The remains of an old dining counter, and the screen of a long-dead TV.`](#a-roadside-diner-the-windows-are-smashed-out-the-remains-of-an-old-dining-counter-and-the-screen-of-a-long-dead-tv) \+ [`in the deserted diner, there are three overturned chairs. Below one is a half-buried mannequin's leg, and a plastic head.`](#in-the-deserted-diner-there-are-three-overturned-chairs-below-one-is-a-half-buried-mannequins-leg-and-a-plastic-head) \+ [`a half-buried mannequin's leg, and a plastic head`](#a-half-buried-mannequins-leg-and-a-plastic-head) \--- I fed snippets of a post-apocalyptic story written by GPT-3 to BigSleep. The results are striking. This is an interesting example of how well BigSleep sometimes responds to long, full-prose prompts. Interestingly, in my experience, attempting to compress prompts by removing seemingly extraneous connector phrases usually *worsened* results. Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- ### `a hospital. Dilapidated and abandoned, overrun by vegetation` ![a hospital. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospital2.png) ![a hospital. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospital.png) ### `a hospital hallway. Dilapidated and abandoned, overrun by vegetation` ![a hospital hallway. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospitalhallway.png) ![a hospital hallway. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospitalhallway2.png) ### `what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs` ![what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs](/worldbuilding/cafeteria.png) ![what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs](/worldbuilding/cafeteria2.png) ### `sunlight floods into the abandoned parking structure` ![sunlight floods into the abandoned parking structure](/worldbuilding/parking_structure.png) ![sunlight floods into the abandoned parking structure](/worldbuilding/parking_structure2.png) ![sunlight floods into the abandoned parking structure](/worldbuilding/parking_structure3.png) ### `a parking attendant's booth with the windows all blown out and vines covering the interior` ![a parking attendant's booth with the windows all blown out and vines covering the interior](/worldbuilding/booth.png) ### `In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.` ![In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.](/worldbuilding/dreambillboard.png) ![In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.](/worldbuilding/dreambillboard2.png) ### `an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.` ![an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.](/worldbuilding/billboard3.png) ![an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.](/worldbuilding/billboard2.png) ![an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.](/worldbuilding/billboard.png) ### `a roadside diner. The windows are smashed out. The remains of an old dining counter, and the screen of a long-dead TV.` ![a roadside diner. The windows are smashed out. The remains of an old dining counter, and the screen of a long-dead TV.](/worldbuilding/dinersmash2.png) ### `in the deserted diner, there are three overturned chairs. Below one is a half-buried mannequin's leg, and a plastic head.` ![in the deserted diner, there are three overturned chairs. Below one is a half-buried mannequin's leg, and a plastic head.](/worldbuilding/deserted.png) ### `a half-buried mannequin's leg, and a plastic head` ![a half-buried mannequin's leg, and a plastic head](/worldbuilding/leg.png) \--- [CLIP](/categories/clip/)[GPT-3](/categories/gpt-3/)[GPT-3 x CLIP](/categories/gpt-3-x-clip/)[fiction](/categories/fiction/) 215 Words Feb 3, 2021 \--- [← Alchemical marriage: GPT-3 x CLIP](/posts/alchemical-marriage-gpt-3-x-clip/) [CLIP hallucinates <PHONE> →](/posts/clip-hallucinates-<PHONE>/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});

GPT-3 x CLIP worldbuilding :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [GPT-3 x CLIP worldbuilding](/posts/gpt-3-x-clip-worldbuilding/) ================================================================ \--- Table of Contents* + [`a hospital. Dilapidated and abandoned, overrun by vegetation`](#a-hospital-dilapidated-and-abandoned-overrun-by-vegetation) \+ [`a hospital hallway. Dilapidated and abandoned, overrun by vegetation`](#a-hospital-hallway-dilapidated-and-abandoned-overrun-by-vegetation) \+ [`what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs`](#what-was-once-the-cafeteria-although-now-it-contains-only-a-few-scattered-rotting-tables-and-chairs) \+ [`sunlight floods into the abandoned parking structure`](#sunlight-floods-into-the-abandoned-parking-structure) \+ [`a parking attendant's booth with the windows all blown out and vines covering the interior`](#a-parking-attendants-booth-with-the-windows-all-blown-out-and-vines-covering-the-interior) \+ [`In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.`](#in-your-dream-you-stand-alone-on-a-vast-barren-plain-before-you-stands-an-ancient-weathered-billboard) \+ [`an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.`](#an-ancient-weathered-billboard-on-it-is-painted-a-beautiful-woman-dressed-in-the-fashion-of-bygone-times-long-blonde-hair-smiling-serenely-and-holding-aloft-a-purple-flower) \+ [`a roadside diner. The windows are smashed out. The remains of an old dining counter, and the screen of a long-dead TV.`](#a-roadside-diner-the-windows-are-smashed-out-the-remains-of-an-old-dining-counter-and-the-screen-of-a-long-dead-tv) \+ [`in the deserted diner, there are three overturned chairs. Below one is a half-buried mannequin's leg, and a plastic head.`](#in-the-deserted-diner-there-are-three-overturned-chairs-below-one-is-a-half-buried-mannequins-leg-and-a-plastic-head) \+ [`a half-buried mannequin's leg, and a plastic head`](#a-half-buried-mannequins-leg-and-a-plastic-head) \--- I fed snippets of a post-apocalyptic story written by GPT-3 to BigSleep. The results are striking. This is an interesting example of how well BigSleep sometimes responds to long, full-prose prompts. Interestingly, in my experience, attempting to compress prompts by removing seemingly extraneous connector phrases usually *worsened* results. Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- ### `a hospital. Dilapidated and abandoned, overrun by vegetation` ![a hospital. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospital2.png) ![a hospital. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospital.png) ### `a hospital hallway. Dilapidated and abandoned, overrun by vegetation` ![a hospital hallway. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospitalhallway.png) ![a hospital hallway. Dilapidated and abandoned, overrun by vegetation](/worldbuilding/hospitalhallway2.png) ### `what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs` ![what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs](/worldbuilding/cafeteria.png) ![what was once the cafeteria, although now it contains only a few scattered, rotting tables and chairs](/worldbuilding/cafeteria2.png) ### `sunlight floods into the abandoned parking structure` ![sunlight floods into the abandoned parking structure](/worldbuilding/parking_structure.png) ![sunlight floods into the abandoned parking structure](/worldbuilding/parking_structure2.png) ![sunlight floods into the abandoned parking structure](/worldbuilding/parking_structure3.png) ### `a parking attendant's booth with the windows all blown out and vines covering the interior` ![a parking attendant’s booth with the windows all blown out and vines covering the interior](/worldbuilding/booth.png) ### `In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.` ![In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.](/worldbuilding/dreambillboard.png) ![In your dream, you stand alone on a vast, barren plain. Before you stands an ancient, weathered billboard.](/worldbuilding/dreambillboard2.png) ### `an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.` ![an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.](/worldbuilding/billboard3.png) ![an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.](/worldbuilding/billboard2.png) ![an ancient, weathered billboard. On it is painted a beautiful woman, dressed in the fashion of bygone times, long blonde hair, smiling serenely, and holding aloft a purple flower.](/worldbuilding/billboard.png) ### `a roadside diner. The windows are smashed out. The remains of an old dining counter, and the screen of a long-dead TV.` ![a roadside diner. The windows are smashed out. The remains of an old dining counter, and the screen of a long-dead TV.](/worldbuilding/dinersmash2.png) ### `in the deserted diner, there are three overturned chairs. Below one is a half-buried mannequin's leg, and a plastic head.` ![in the deserted diner, there are three overturned chairs. Below one is a half-buried mannequin’s leg, and a plastic head.](/worldbuilding/deserted.png) ### `a half-buried mannequin's leg, and a plastic head` ![a half-buried mannequin’s leg, and a plastic head](/worldbuilding/leg.png) \--- [CLIP](/categories/clip/)[GPT-3](/categories/gpt-3/)[GPT-3 x CLIP](/categories/gpt-3-x-clip/)[fiction](/categories/fiction/) 215 Words Feb 3, 2021 \--- [← Alchemical marriage: GPT-3 x CLIP](/posts/alchemical-marriage-gpt-3-x-clip/) [CLIP hallucinates 1900-2030 →](/posts/clip-hallucinates-1900-2030/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});


CLIP hallucinates <PHONE> :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) One minute [CLIP hallucinates <PHONE>](/posts/clip-hallucinates-<PHONE>/) ================================================================== \--- Table of Contents* + [`the 1900s`](#the-1900s) \+ [`the 1910s`](#the-1910s) \+ [`the 1920s`](#the-1920s) \+ [`the 1930s`](#the-1930s) \+ [`the 1940s`](#the-1940s) \+ [`the 1950s`](#the-1950s) \+ [`the 1960s`](#the-1960s) \+ [`the 1970s`](#the-1970s) \+ [`the 1980s`](#the-1980s) \+ [`the 1990s`](#the-1990s) \+ [`the 2000s`](#the-2000s) \+ [`the 2010s`](#the-2010s) \+ [`the 2020s`](#the-2020s) \+ [`the 2030s`](#the-2030s) \+ [`superintelligence`](#superintelligence) \--- Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- ### `the 1900s` ![1900s](/years/1900s.png) ### `the 1910s` ![1910s](/years/1910s.png) ### `the 1920s` ![1920s](/years/1920s.png) ### `the 1930s` ![1920s](/years/1930s.png) ### `the 1940s` ![1940s](/years/1940s.png) ### `the 1950s` ![1950s](/years/1950s.png) ### `the 1960s` ![1960s](/years/1960s.png) ### `the 1970s` ![1970s](/years/1970s.png) ### `the 1980s` ![1980s](/years/1980s.png) ### `the 1990s` ![1990s](/years/1990s.png) ### `the 2000s` ![2000s](/years/2000s.png) ### `the 2010s` ![2010s](/years/2010s.png) ah yes, the 2010s, the decade where all our domesticated animals started wearing shoes – Sid ### `the 2020s` ![2020s](/years/2020s.png) ### `the 2030s` ![2030s](/years/2030s.png) and, while we're at it… ### `superintelligence` ![superintelligence](/years/si.png) \--- [CLIP](/categories/clip/) 64 Words Feb 1, 2021 \--- [← GPT-3 x CLIP worldbuilding](/posts/gpt-3-x-clip-worldbuilding/) [CLIP art →](/posts/clip-art/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});

CLIP hallucinates 1900-2030 :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) One minute [CLIP hallucinates 1900-2030](/posts/clip-hallucinates-1900-2030/) ================================================================== \--- Table of Contents* + [`the 1900s`](#the-1900s) \+ [`the 1910s`](#the-1910s) \+ [`the 1920s`](#the-1920s) \+ [`the 1930s`](#the-1930s) \+ [`the 1940s`](#the-1940s) \+ [`the 1950s`](#the-1950s) \+ [`the 1960s`](#the-1960s) \+ [`the 1970s`](#the-1970s) \+ [`the 1980s`](#the-1980s) \+ [`the 1990s`](#the-1990s) \+ [`the 2000s`](#the-2000s) \+ [`the 2010s`](#the-2010s) \+ [`the 2020s`](#the-2020s) \+ [`the 2030s`](#the-2030s) \+ [`superintelligence`](#superintelligence) \--- Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- ### `the 1900s` ![1900s](/years/1900s.png) ### `the 1910s` ![1910s](/years/1910s.png) ### `the 1920s` ![1920s](/years/1920s.png) ### `the 1930s` ![1920s](/years/1930s.png) ### `the 1940s` ![1940s](/years/1940s.png) ### `the 1950s` ![1950s](/years/1950s.png) ### `the 1960s` ![1960s](/years/1960s.png) ### `the 1970s` ![1970s](/years/1970s.png) ### `the 1980s` ![1980s](/years/1980s.png) ### `the 1990s` ![1990s](/years/1990s.png) ### `the 2000s` ![2000s](/years/2000s.png) ### `the 2010s` ![2010s](/years/2010s.png) ah yes, the 2010s, the decade where all our domesticated animals started wearing shoes – Sid ### `the 2020s` ![2020s](/years/2020s.png) ### `the 2030s` ![2030s](/years/2030s.png) and, while we’re at it… ### `superintelligence` ![superintelligence](/years/si.png) \--- [CLIP](/categories/clip/) 64 Words Feb 1, 2021 \--- [← GPT-3 x CLIP worldbuilding](/posts/gpt-3-x-clip-worldbuilding/) [CLIP art →](/posts/clip-art/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});


CLIP art :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [CLIP art](/posts/clip-art/) ============================ \--- Table of Contents* [science](#science) \+ [`diffraction`](#diffraction) \+ [`Altered colors of skylight reflected in a soap bubble, due to thin-film interference`](#altered-colors-of-skylight-reflected-in-a-soap-bubble-due-to-thin-film-interference) \+ [`total internal reflection`](#total-internal-reflection) \+ [`two-slit diffraction pattern`](#two-slit-diffraction-pattern) \+ [`wave-particle duality`](#wave-particle-duality) \+ [`thermodynamics`](#thermodynamics) \+ [`the solar system`](#the-solar-system) \+ [`model of the universe`](#model-of-the-universe) \+ [`multiverse`](#multiverse) \+ [`The infinite and complex fractal nature of our reality`](#the-infinite-and-complex-fractal-nature-of-our-reality) \+ [`scientific diagram`](#scientific-diagram) * [mind](#mind) \+ [`Jungian archetypes`](#jungian-archetypes) \+ [`Freudian psychoanalysis`](#freudian-psychoanalysis) \+ [`the human psyche`](#the-human-psyche) \+ [`sleep paralysis`](#sleep-paralysis) \+ [`lucid dream`](#lucid-dream) \+ [`dream factory`](#dream-factory) \+ [`dream machine`](#dream-machine) \+ [`dissociative identity disorder`](#dissociative-identity-disorder) \+ [`derealization`](#derealization) \+ [`depersonalization`](#depersonalization) \+ [`schizophrenia`](#schizophrenia) \+ [`manic depression`](#manic-depression) \+ [`epilepsy`](#epilepsy) \+ [`anorexia nervosa`](#anorexia-nervosa) \+ [`drug addiction`](#drug-addiction) * [software](#software) \+ [`world of warcraft`](#world-of-warcraft) \+ [`mount and blade`](#mount-and-blade) \+ [`evil malware`](#evil-malware) * [AI](#ai) \+ [`machine learning`](#machine-learning) \+ [`machine learning breakthrough`](#machine-learning-breakthrough) \+ [`neural networks (machine learning)`](#neural-networks-machine-learning) \+ [`artificial neural networks`](#artificial-neural-networks) \+ [`superintelligence`](#superintelligence) \+ [`paperclip maximizer`](#paperclip-maximizer) \+ [`an artificial intelligence manufactures an infinite number of paperclips, destroying everything`](#an-artificial-intelligence-manufactures-an-infinite-number-of-paperclips-destroying-everything) \+ [`Dali painting of superintelligence`](#dali-painting-of-superintelligence) \+ [`a mosaic depicting the singularity`](#a-mosaic-depicting-the-singularity) * [history](#history) \+ [`roman legionnaire`](#roman-legionnaire) \+ [`roman senate`](#roman-senate) \+ [`Brutus stabbing Julius Caesar in the senate chambers`](#brutus-stabbing-julius-caesar-in-the-senate-chambers) \+ [`diagram from the 1800s`](#diagram-from-the-1800s) \+ [`Philosophiæ Naturalis Principia Mathematica`](#philosophiæ-naturalis-principia-mathematica) * [imaginary worlds](#imaginary-worlds) \+ [`the Library of Babel`](#the-library-of-babel) \+ [`carnival of horrific delights`](#carnival-of-horrific-delights) * [religion and mythology](#religion-and-mythology) \+ [`true face of god`](#true-face-of-god) \+ [`the devil in a suit`](#the-devil-in-a-suit) \+ [`dream god`](#dream-god) \+ [`a sculpture of the god of clocks`](#a-sculpture-of-the-god-of-clocks) * [styles](#styles) \+ [`hyperrealism`](#hyperrealism) \+ [`hyperrealistic painting of a man`](#hyperrealistic-painting-of-a-man) \+ [`irrealism`](#irrealism) * [misc](#misc) \+ [`crab rave`](#crab-rave) \+ [`cyberskunk`](#cyberskunk) \+ [`voodoo barbie`](#voodoo-barbie) \--- Most of my CLIP-related posts feature GPT-3 written prompts. This is where I compile BigSleep yields from human-written prompts. Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- science \------- ### `diffraction` ![diffraction](/clipart/diffraction-sample2-iter00600.png) ![diffraction](/clipart/diffraction-sample3-iter00600.png) ### `Altered colors of skylight reflected in a soap bubble, due to thin-film interference` ![Altered colors of skylight reflected in a soap bubble, due to thin-film interference](/clipart/alt.png) ![Altered colors of skylight reflected in a soap bubble, due to thin-film interference](/clipart/alt2.png) ### `total internal reflection` ![total internal reflection](/clipart/tir.png) ![total internal reflection](/clipart/tir2.png) ### `two-slit diffraction pattern` ![two-slit diffraction pattern](/clipart/2slit.png) ![two-slit diffraction pattern](/clipart/2slit2.png) ### `wave-particle duality` ![wave-particle duality](/clipart/wpd.png) ![wave-particle duality](/clipart/wpd2.png) ### `thermodynamics` ![thermodynamics](/clipart/therm2.png) ![thermodynamics](/clipart/therm3.png) ![thermodynamics](/clipart/therm4.png) ### `the solar system` ![the solar system](/clipart/ss.png) ![the solar system](/clipart/ss2.png) ### `model of the universe` ![model of the universe](/clipart/model.png) ![model of the universe](/clipart/model2.png) ![model of the universe](/clipart/model3.png) ### `multiverse` ![multiverse](/clipart/multi.png) ![multiverse](/clipart/multi2.png) ### `The infinite and complex fractal nature of our reality` ![The infinite and complex fractal nature of our reality](/clipart/fractal.png) ![The infinite and complex fractal nature of our reality](/clipart/fractal2.png) ![The infinite and complex fractal nature of our reality](/clipart/fractal3.png) ### `scientific diagram` ![scientific diagram](/clipart/sd.png) ![scientific diagram](/clipart/sd2.png) ![scientific diagram](/clipart/sd3.png) mind \---- ### `Jungian archetypes` ![Jungian archetypes](/clipart/ja.png) ![Jungian archetypes](/clipart/ja2.png) ![Jungian archetypes](/clipart/ja3.png) ### `Freudian psychoanalysis` ![Freudian psychoanalysis](/clipart/freud.png) ![Freudian psychoanalysis](/clipart/freud3.png) ### `the human psyche` ![the human psyche](/clipart/hp.png) ### `sleep paralysis` ![sleep paralysis](/clipart/sp.png) ![sleep paralysis](/clipart/sp2.png) ![sleep paralysis](/clipart/sp3.png) ![sleep paralysis](/clipart/sp4.png) ### `lucid dream` ![lucid dream](/clipart/ld.png) ![lucid dream](/clipart/ld2.png) ![lucid dream](/clipart/ld3.png) ### `dream factory` ![dream factory](/clipart/df.png) ![dream factory](/clipart/df2.png) ### `dream machine` ![dream machine](/clipart/dm.png) ### `dissociative identity disorder` ![dissociative identity disorder](/clipart/did.png) ![dissociative identity disorder](/clipart/did2.png) ![dissociative identity disorder](/clipart/did3.png) ### `derealization` ![derealization](/clipart/dereal.png) ![derealization](/clipart/dereal2.png) ![derealization](/clipart/dereal3.png) ![derealization](/clipart/dereal4.png) ### `depersonalization` ![depersonalization](/clipart/deperson.png) ![depersonalization](/clipart/deperson2.png) ### `schizophrenia` ![schizophrenia](/clipart/schizo.png) ![schizophrenia](/clipart/schizo2.png) ### `manic depression` ![manic depression](/clipart/manic.png) ![manic depression](/clipart/manic2.png) ### `epilepsy` ![epilepsy](/clipart/epilepsy.png) ![epilepsy](/clipart/epilepsy2.png) ### `anorexia nervosa` ![anorexia nervosa](/clipart/ana.png) ![anorexia nervosa](/clipart/ana2.png) ### `drug addiction` ![drug addiction](/clipart/drug.png) ![drug addiction](/clipart/drug2.png) software \-------- ### `world of warcraft` ![world of warcraft](/clipart/wow.png) ### `mount and blade` ![mount and blade](/clipart/mb.png) ![mount and blade](/clipart/mb2.png) ![mount and blade](/clipart/mb3.png) ### `evil malware` ![evil malware](/clipart/malware.png) AI \-- ### `machine learning` ![machine learning](/clipart/ml.png) ### `machine learning breakthrough` ![machine learning breakthrough](/clipart/mlb.png) ![machine learning breakthrough](/clipart/mlb2.png) ### `neural networks (machine learning)` ![neural networks (machine learning)](/clipart/nnml.png) ![neural networks (machine learning)](/clipart/nnml2.png) ### `artificial neural networks` ![artificial neural networks](/clipart/ann.png) ![artificial neural networks](/clipart/ann2.png) ![artificial neural networks](/clipart/ann3.png) ![artificial neural networks](/clipart/ann4.png) ### `superintelligence` ![superintelligence](/clipart/si.png) ![superintelligence](/clipart/si2.png) ### `paperclip maximizer` ![paperclip maximizer](/clipart/clip.png) ![paperclip maximizer](/clipart/clip2.png) ### `an artificial intelligence manufactures an infinite number of paperclips, destroying everything` ![an artificial intelligence manufactures an infinite number of paperclips, destroying](/clipart/artclip.png) ### `Dali painting of superintelligence` ![Dali painting of superintelligence](/clipart/dalisuperintelligence.png) ![Dali painting of superintelligence](/clipart/dalisuperintelligence2.png) ![Dali painting of superintelligence](/clipart/dalisuperintelligence3.png) ### `a mosaic depicting the singularity` ![a mosaic depicting the singularity](/clipart/mosaicsing.png) ![a mosaic depicting the singularity](/clipart/mosaicsing2.png) history \------- ### `roman legionnaire` ![roman legionnaire](/clipart/roman.png) ![roman legionnaire](/clipart/roman2.png) ![roman legionnaire](/clipart/roman3.png) ### `roman senate` ![roman senate](/clipart/senate.png) ![roman senate](/clipart/senate2.png) ![roman senate](/clipart/senate3.png) ### `Brutus stabbing Julius Caesar in the senate chambers` ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus.png) ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus2.png) ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus3.png) ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus4.png) ### `diagram from the 1800s` ![diagram from the 1800s](/clipart/1800sdg.png) ![diagram from the 1800s](/clipart/1800sdg2.png) ![diagram from the 1800s](/clipart/1800sdg3.png) ### `Philosophiæ Naturalis Principia Mathematica` ![Philosophiæ Naturalis Principia Mathematica](/clipart/pm.png) ![Philosophiæ Naturalis Principia Mathematica](/clipart/pm2.png) imaginary worlds \---------------- ### `the Library of Babel` ![the Library of Babel](/clipart/lb.png) ![the Library of Babel](/clipart/lb2.png) ![the Library of Babel](/clipart/lb3.png) ![the Library of Babel](/clipart/lb4.png) ![the Library of Babel](/clipart/lb5.png) ### `carnival of horrific delights` ![carnival of horrific delights](/clipart/carn.png) ![carnival of horrific delights](/clipart/carn2.png) ![carnival of horrific delights](/clipart/carn3.png) religion and mythology \---------------------- ### `true face of god` ![true face of god](/clipart/tfg.png) ![true face of god](/clipart/tfg2.png) ### `the devil in a suit` ![the devil in a suit](/clipart/ds.png) ### `dream god` ![dream god](/clipart/dreamgod.png) ### `a sculpture of the god of clocks` ![a sculpture of the god of clocks](/clipart/sgc.png) ![a sculpture of the god of clocks](/clipart/sgc2.png) ![a sculpture of the god of clocks](/clipart/sgc3.png) styles \------ ### `hyperrealism` ![hyperrealism](/clipart/hyperreal.png) ![hyperrealism](/clipart/hyperreal2.png) ![hyperrealism](/clipart/hyperreal3.png) ### `hyperrealistic painting of a man` ![hyperrealistic painting of a man](/clipart/hm.png) ### `irrealism` ![irrealism](/clipart/irrealism.png) misc \---- ### `crab rave` ![crab rave](/clipart/crab.png) ![crab rave](/clipart/crab2.png) ### `cyberskunk` ![cyberskunk](/clipart/cs.png) ![cyberskunk](/clipart/cs2.png) ### `voodoo barbie` ![voodoo barbie](/clipart/vb.png) \--- [CLIP](/categories/clip/) 216 Words Jan 31, 2021 \--- [← CLIP hallucinates <PHONE>](/posts/clip-hallucinates-<PHONE>/) [Language models are multiverse generators →](/posts/language-models-are-multiverse-generators/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});

CLIP art :: — Moire[![](/images/home/rolling_phase.gif)](/)* [Posts](/posts/) * [Trees](/trees/) * [Prophecies](/prophecies/) * [About](/about/) 2 minutes [CLIP art](/posts/clip-art/) ============================ \--- Table of Contents* [science](#science) \+ [`diffraction`](#diffraction) \+ [`Altered colors of skylight reflected in a soap bubble, due to thin-film interference`](#altered-colors-of-skylight-reflected-in-a-soap-bubble-due-to-thin-film-interference) \+ [`total internal reflection`](#total-internal-reflection) \+ [`two-slit diffraction pattern`](#two-slit-diffraction-pattern) \+ [`wave-particle duality`](#wave-particle-duality) \+ [`thermodynamics`](#thermodynamics) \+ [`the solar system`](#the-solar-system) \+ [`model of the universe`](#model-of-the-universe) \+ [`multiverse`](#multiverse) \+ [`The infinite and complex fractal nature of our reality`](#the-infinite-and-complex-fractal-nature-of-our-reality) \+ [`scientific diagram`](#scientific-diagram) * [mind](#mind) \+ [`Jungian archetypes`](#jungian-archetypes) \+ [`Freudian psychoanalysis`](#freudian-psychoanalysis) \+ [`the human psyche`](#the-human-psyche) \+ [`sleep paralysis`](#sleep-paralysis) \+ [`lucid dream`](#lucid-dream) \+ [`dream factory`](#dream-factory) \+ [`dream machine`](#dream-machine) \+ [`dissociative identity disorder`](#dissociative-identity-disorder) \+ [`derealization`](#derealization) \+ [`depersonalization`](#depersonalization) \+ [`schizophrenia`](#schizophrenia) \+ [`manic depression`](#manic-depression) \+ [`epilepsy`](#epilepsy) \+ [`anorexia nervosa`](#anorexia-nervosa) \+ [`drug addiction`](#drug-addiction) * [software](#software) \+ [`world of warcraft`](#world-of-warcraft) \+ [`mount and blade`](#mount-and-blade) \+ [`evil malware`](#evil-malware) * [AI](#ai) \+ [`machine learning`](#machine-learning) \+ [`machine learning breakthrough`](#machine-learning-breakthrough) \+ [`neural networks (machine learning)`](#neural-networks-machine-learning) \+ [`artificial neural networks`](#artificial-neural-networks) \+ [`superintelligence`](#superintelligence) \+ [`paperclip maximizer`](#paperclip-maximizer) \+ [`an artificial intelligence manufactures an infinite number of paperclips, destroying everything`](#an-artificial-intelligence-manufactures-an-infinite-number-of-paperclips-destroying-everything) \+ [`Dali painting of superintelligence`](#dali-painting-of-superintelligence) \+ [`a mosaic depicting the singularity`](#a-mosaic-depicting-the-singularity) * [history](#history) \+ [`roman legionnaire`](#roman-legionnaire) \+ [`roman senate`](#roman-senate) \+ [`Brutus stabbing Julius Caesar in the senate chambers`](#brutus-stabbing-julius-caesar-in-the-senate-chambers) \+ [`diagram from the 1800s`](#diagram-from-the-1800s) \+ [`Philosophiæ Naturalis Principia Mathematica`](#philosophiæ-naturalis-principia-mathematica) * [imaginary worlds](#imaginary-worlds) \+ [`the Library of Babel`](#the-library-of-babel) \+ [`carnival of horrific delights`](#carnival-of-horrific-delights) * [religion and mythology](#religion-and-mythology) \+ [`true face of god`](#true-face-of-god) \+ [`the devil in a suit`](#the-devil-in-a-suit) \+ [`dream god`](#dream-god) \+ [`a sculpture of the god of clocks`](#a-sculpture-of-the-god-of-clocks) * [styles](#styles) \+ [`hyperrealism`](#hyperrealism) \+ [`hyperrealistic painting of a man`](#hyperrealistic-painting-of-a-man) \+ [`irrealism`](#irrealism) * [misc](#misc) \+ [`crab rave`](#crab-rave) \+ [`cyberskunk`](#cyberskunk) \+ [`voodoo barbie`](#voodoo-barbie) \--- Most of my CLIP-related posts feature GPT-3 written prompts. This is where I compile BigSleep yields from human-written prompts. Images were generated using [BigSleep](https://github.com/lucidrains/big-sleep) via [The Big Sleep Customized NMKD Public](https://colab.research.google.com/drive/1Q2DIeMqYm_Sc5mlurnnurMMVqlgXpZNO?usp=sharing) colab notebook. \--- science \------- ### `diffraction` ![diffraction](/clipart/diffraction-sample2-iter00600.png) ![diffraction](/clipart/diffraction-sample3-iter00600.png) ### `Altered colors of skylight reflected in a soap bubble, due to thin-film interference` ![Altered colors of skylight reflected in a soap bubble, due to thin-film interference](/clipart/alt.png) ![Altered colors of skylight reflected in a soap bubble, due to thin-film interference](/clipart/alt2.png) ### `total internal reflection` ![total internal reflection](/clipart/tir.png) ![total internal reflection](/clipart/tir2.png) ### `two-slit diffraction pattern` ![two-slit diffraction pattern](/clipart/2slit.png) ![two-slit diffraction pattern](/clipart/2slit2.png) ### `wave-particle duality` ![wave-particle duality](/clipart/wpd.png) ![wave-particle duality](/clipart/wpd2.png) ### `thermodynamics` ![thermodynamics](/clipart/therm2.png) ![thermodynamics](/clipart/therm3.png) ![thermodynamics](/clipart/therm4.png) ### `the solar system` ![the solar system](/clipart/ss.png) ![the solar system](/clipart/ss2.png) ### `model of the universe` ![model of the universe](/clipart/model.png) ![model of the universe](/clipart/model2.png) ![model of the universe](/clipart/model3.png) ### `multiverse` ![multiverse](/clipart/multi.png) ![multiverse](/clipart/multi2.png) ### `The infinite and complex fractal nature of our reality` ![The infinite and complex fractal nature of our reality](/clipart/fractal.png) ![The infinite and complex fractal nature of our reality](/clipart/fractal2.png) ![The infinite and complex fractal nature of our reality](/clipart/fractal3.png) ### `scientific diagram` ![scientific diagram](/clipart/sd.png) ![scientific diagram](/clipart/sd2.png) ![scientific diagram](/clipart/sd3.png) mind \---- ### `Jungian archetypes` ![Jungian archetypes](/clipart/ja.png) ![Jungian archetypes](/clipart/ja2.png) ![Jungian archetypes](/clipart/ja3.png) ### `Freudian psychoanalysis` ![Freudian psychoanalysis](/clipart/freud.png) ![Freudian psychoanalysis](/clipart/freud3.png) ### `the human psyche` ![the human psyche](/clipart/hp.png) ### `sleep paralysis` ![sleep paralysis](/clipart/sp.png) ![sleep paralysis](/clipart/sp2.png) ![sleep paralysis](/clipart/sp3.png) ![sleep paralysis](/clipart/sp4.png) ### `lucid dream` ![lucid dream](/clipart/ld.png) ![lucid dream](/clipart/ld2.png) ![lucid dream](/clipart/ld3.png) ### `dream factory` ![dream factory](/clipart/df.png) ![dream factory](/clipart/df2.png) ### `dream machine` ![dream machine](/clipart/dm.png) ### `dissociative identity disorder` ![dissociative identity disorder](/clipart/did.png) ![dissociative identity disorder](/clipart/did2.png) ![dissociative identity disorder](/clipart/did3.png) ### `derealization` ![derealization](/clipart/dereal.png) ![derealization](/clipart/dereal2.png) ![derealization](/clipart/dereal3.png) ![derealization](/clipart/dereal4.png) ### `depersonalization` ![depersonalization](/clipart/deperson.png) ![depersonalization](/clipart/deperson2.png) ### `schizophrenia` ![schizophrenia](/clipart/schizo.png) ![schizophrenia](/clipart/schizo2.png) ### `manic depression` ![manic depression](/clipart/manic.png) ![manic depression](/clipart/manic2.png) ### `epilepsy` ![epilepsy](/clipart/epilepsy.png) ![epilepsy](/clipart/epilepsy2.png) ### `anorexia nervosa` ![anorexia nervosa](/clipart/ana.png) ![anorexia nervosa](/clipart/ana2.png) ### `drug addiction` ![drug addiction](/clipart/drug.png) ![drug addiction](/clipart/drug2.png) software \-------- ### `world of warcraft` ![world of warcraft](/clipart/wow.png) ### `mount and blade` ![mount and blade](/clipart/mb.png) ![mount and blade](/clipart/mb2.png) ![mount and blade](/clipart/mb3.png) ### `evil malware` ![evil malware](/clipart/malware.png) AI \-- ### `machine learning` ![machine learning](/clipart/ml.png) ### `machine learning breakthrough` ![machine learning breakthrough](/clipart/mlb.png) ![machine learning breakthrough](/clipart/mlb2.png) ### `neural networks (machine learning)` ![neural networks (machine learning)](/clipart/nnml.png) ![neural networks (machine learning)](/clipart/nnml2.png) ### `artificial neural networks` ![artificial neural networks](/clipart/ann.png) ![artificial neural networks](/clipart/ann2.png) ![artificial neural networks](/clipart/ann3.png) ![artificial neural networks](/clipart/ann4.png) ### `superintelligence` ![superintelligence](/clipart/si.png) ![superintelligence](/clipart/si2.png) ### `paperclip maximizer` ![paperclip maximizer](/clipart/clip.png) ![paperclip maximizer](/clipart/clip2.png) ### `an artificial intelligence manufactures an infinite number of paperclips, destroying everything` ![an artificial intelligence manufactures an infinite number of paperclips, destroying](/clipart/artclip.png) ### `Dali painting of superintelligence` ![Dali painting of superintelligence](/clipart/dalisuperintelligence.png) ![Dali painting of superintelligence](/clipart/dalisuperintelligence2.png) ![Dali painting of superintelligence](/clipart/dalisuperintelligence3.png) ### `a mosaic depicting the singularity` ![a mosaic depicting the singularity](/clipart/mosaicsing.png) ![a mosaic depicting the singularity](/clipart/mosaicsing2.png) history \------- ### `roman legionnaire` ![roman legionnaire](/clipart/roman.png) ![roman legionnaire](/clipart/roman2.png) ![roman legionnaire](/clipart/roman3.png) ### `roman senate` ![roman senate](/clipart/senate.png) ![roman senate](/clipart/senate2.png) ![roman senate](/clipart/senate3.png) ### `Brutus stabbing Julius Caesar in the senate chambers` ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus.png) ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus2.png) ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus3.png) ![Brutus stabbing Julius Caesar in the senate chambers](/clipart/brutus4.png) ### `diagram from the 1800s` ![diagram from the 1800s](/clipart/1800sdg.png) ![diagram from the 1800s](/clipart/1800sdg2.png) ![diagram from the 1800s](/clipart/1800sdg3.png) ### `Philosophiæ Naturalis Principia Mathematica` ![Philosophiæ Naturalis Principia Mathematica](/clipart/pm.png) ![Philosophiæ Naturalis Principia Mathematica](/clipart/pm2.png) imaginary worlds \---------------- ### `the Library of Babel` ![the Library of Babel](/clipart/lb.png) ![the Library of Babel](/clipart/lb2.png) ![the Library of Babel](/clipart/lb3.png) ![the Library of Babel](/clipart/lb4.png) ![the Library of Babel](/clipart/lb5.png) ### `carnival of horrific delights` ![carnival of horrific delights](/clipart/carn.png) ![carnival of horrific delights](/clipart/carn2.png) ![carnival of horrific delights](/clipart/carn3.png) religion and mythology \---------------------- ### `true face of god` ![true face of god](/clipart/tfg.png) ![true face of god](/clipart/tfg2.png) ### `the devil in a suit` ![the devil in a suit](/clipart/ds.png) ### `dream god` ![dream god](/clipart/dreamgod.png) ### `a sculpture of the god of clocks` ![a sculpture of the god of clocks](/clipart/sgc.png) ![a sculpture of the god of clocks](/clipart/sgc2.png) ![a sculpture of the god of clocks](/clipart/sgc3.png) styles \------ ### `hyperrealism` ![hyperrealism](/clipart/hyperreal.png) ![hyperrealism](/clipart/hyperreal2.png) ![hyperrealism](/clipart/hyperreal3.png) ### `hyperrealistic painting of a man` ![hyperrealistic painting of a man](/clipart/hm.png) ### `irrealism` ![irrealism](/clipart/irrealism.png) misc \---- ### `crab rave` ![crab rave](/clipart/crab.png) ![crab rave](/clipart/crab2.png) ### `cyberskunk` ![cyberskunk](/clipart/cs.png) ![cyberskunk](/clipart/cs2.png) ### `voodoo barbie` ![voodoo barbie](/clipart/vb.png) \--- [CLIP](/categories/clip/) 216 Words Jan 31, 2021 \--- [← CLIP hallucinates 1900-2030](/posts/clip-hallucinates-1900-2030/) [Language models are multiverse generators →](/posts/language-models-are-multiverse-generators/)© 2022 [moire](/about)$(function(){window.sr=ScrollReveal();if($(window).width()<768){if($('.timeline-content').hasClass('js--fadeInLeft')){$('.timeline-content').removeClass('js--fadeInLeft').addClass('js--fadeInRight');} sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});}else{sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});} sr.reveal('.js--fadeInLeft',{origin:'left',distance:'300px',easing:'ease-in-out',duration:800,});sr.reveal('.js--fadeInRight',{origin:'right',distance:'300px',easing:'ease-in-out',duration:800,});});