{"id":1495129,"date":"2026-06-30T15:15:04","date_gmt":"2026-06-30T13:15:04","guid":{"rendered":"https:\/\/www.ie.edu\/insights\/?post_type=articles&p=1495129"},"modified":"2026-06-30T15:15:04","modified_gmt":"2026-06-30T13:15:04","slug":"from-prompt-to-image-the-literary-implications-of-text-to-image-ai","status":"publish","type":"articles","link":"https:\/\/www.ie.edu\/insights\/articles\/from-prompt-to-image-the-literary-implications-of-text-to-image-ai\/","title":{"rendered":"From Prompt to Image: The Literary Implications of Text-to-Image AI"},"featured_media":1495137,"template":"","meta":{"_has_post_settings":{"highlight_sharing":"default","image_sharing":"default","headline_sharing":"default"}},"schools":[],"areas":[508,719],"subjects":[421],"class_list":["post-1495129","articles","type-articles","status-publish","has-post-thumbnail","hentry","areas-artificial-intelligence","areas-arts","subjects-humanities"],"custom-fields":{"wpcf-article-leadin":["Text-to-image AI is transforming writing into a visual medium, expanding literature through interpretatoin, writes Ana Mar\u00eda Caballero."],"wpcf-article-body":["

Main Image:\r\nScylla<\/em>, Ana Mar\u00eda Caballero (2026).\r\nCourtesy of the artist.<\/p>\r\nText-to-image artificial intelligence is often described as a breakthrough in visual creativity. But at its core, it\u2019s a shift in language. Generative AI systems do not begin with images \u2013 they begin with words. And, in doing so, they are expanding what it means to write.\r\n\r\nAs prompts become images, writing becomes something more than text on a page. It becomes a way of generating visual worlds that are material and rooted in collectivity. This has significant implications for literature, where writers have always depended on readers\u2019 personal image banks \u2013 their imagination \u2013 to conjure visuals from poetic devices.\r\n\r\nI began my creative career as a writer, publishing multiple books before extending my practice into visual and digital forms. From the outset, my intention was clear: verse deserves to exist in the same plane as visual art \u2013 galleries, museums, and public installations \u2013 and I set out to position it there. The arrival of generative AI did not mark a departure from writing, but a continuation of it through another medium.\r\n\r\nMy interest has never been in AI-generated poetry. What\u2019s fascinating is not the idea of literate statistical models, but language itself as an instrument for generating images. In this sense, text-to-image AI represents a linguistic evolution \u2013 one we\u2019re only beginning to articulate.\r\n\r\nPrompting is a literary act. It requires precision, intuition, and a sensitivity to tone and association. Like poetry, it depends on selecting the right words and on revision. Prompts must be tested, adjusted, rewritten, and even redacted. Words are swapped, syntax is tightened, tone is recalibrated. Language must often be bent \u2013 sometimes forcefully \u2013 to produce a desired image.\r\n\r\nAnd yet, even at its most precise, language has limits. Though it\u2019s a system built on discrete unit \u2013 words, syntax, structure \u2013 it\u2019s open to personal interpretation, just like images. This tension reveals something important: prompting exists between two different systems of meaning \u2013 one textual, one visual.\r\n\r\nPioneering generative artist Mario Klingemann, known for his work with neural networks and projects such as Botto<\/a>, has long explored this boundary between human intention and machine interpretation. He notes: \u201cAs expressive and versatile as natural language seems to be, I find it often too \u2018quantized\u2019 to carry the full weight of my creative intent\u2014so I prefer to speak to machines in their native tongue, navigating latent space directly through tensors and embedding vectors, where meaning is more fluid and continuous rather than discrete.\u201d\r\n\r\nIf language is not enough, then prompting becomes something hybrid \u2013 part literary, part computational \u2013 where meaning is shaped both by what we say and by how systems interpret it.\r\n\r\nEqually important is selection. Generative systems produce variation; the artist defines meaning through choice, often rooting subsequent images in one that serves as an anchor. The act of selecting an output \u2013 deciding which image holds \u2013 is inseparable from authorship. Writing does not end with the prompt; it continues through curation.\r\n\r\nThe nuances between language, interpretation, and selection are central to my projects Paperwork<\/em><\/a> and <\/em>Speech Patterns<\/em><\/a>, where I incorporated individual audience responses to my performed poetry into a system where human readership produces the art. At various readings, attendees were invited to write down a single word \u2013 a distilled moment of connection to verse. These words became central to the inputs through which I summoned digital paper sculptures from latent space.\r\n\r\n\"\"<\/a>\r\n

\"Angustia<\/em>\" from Paperwork, Ana Mar\u00eda Caballero (2023).\r\nCourtesy of the artist.<\/p>\r\nWriters have always created visuals inside readers\u2019 minds. With both Paperwork<\/em> and Speech Patterns<\/em>, such images began to take form outside the mind \u2013 fixed, but never singular. Each word functioned as a fragment of interpretation \u2013 a reading made visible. In transforming these fragments into visual form, each response unfolded into something tactile, spatial, shared. The generated sculptures are a convergence of multiple possible readings, shaped by language and by the vast visual memories embedded within AI systems.\r\n\r\nThis process is part and parcel to what I think of as analog generativity<\/em>: the notion that readers and writers construct each other in an endlessly procreative process. Different words mean different things to different people. Text-to-image AI makes this process visible, rendering interpretation as output and turning something ephemeral into a shareable record.\r\n\r\nThe final work becomes less about a singular output and more about the process of its creation \u2013 an approach echoed in Fabiola Larios\u2019s Wild Wired World<\/em><\/a>, an AI-driven film that traces the evolution of the internet from its early utopian promise to its current entanglement with surveillance and data extraction. Drawing on vast digital archives, the work assembles a layered visual narrative that reflects how collective memory is not only stored but continuously rewritten. Reflecting on the omnipresence of these systems, Larios notes, \u201cAfter my mom told me God was always watching me, in my teenage years I thought about surveillance as omnipresent and always watching me, like God.\u201d\r\n\r\n\"\"<\/a>\r\n

Wild Wired World<\/em>, Fabiola Larios (2023). Installation view from the Perez Art Museum.\r\nCourtesy of the artist and Karli Evans.<\/p>\r\nIn a project titled Being Borges<\/em><\/a>, I approach prompting as a form of translation. I engage with The Book of Imaginary Beings<\/em> by Jorge Luis Borges and Margarita Guerrero, translating text into image across multiple layers. I begin with the original Spanish, generating a suite of images through prompting, then repeating the process using the English translation Borges himself supervised. Finally, I write my own poem \u2013 not a translation, but a recasting of the original through the lens of my own poetic interests.\r\n\r\nThese layers \u2013 Spanish, English, personal \u2013 are assembled alongside the images they produce. The compositions function as both translation and self-portrait. Like in Sophie Calle\u2019s Suite Venitienne<\/em>, when we describe our approach, we describe ourselves.\r\n\r\nThe project highlights both the potential and the limits of AI. Different languages produce different images because they\u2019re different systems of meaning. The gap between them isn\u2019t an error \u2013 it\u2019s the point, revealing the impossibility of translation. Indeed, Borges himself famously said: \u201cThe original is unfaithful to the translation.\u201d\r\n\r\nImages, too, are unstable \u2013 they shift according to context, memory and the viewer\u2019s gaze. In moving from text to image, we do not move from multiplicity to fixity, but from one kind of instability to another.\r\n\r\nIn Being Borges<\/em>, Borges\u2019s descriptions become prompts, but the resulting images are not definitive. They\u2019re placed alongside the texts that generated them, allowing meaning to emerge in the space between.\r\n\r\nProjects like Being Borges<\/em> invite viewers to also face their relationships with text vis \u00e0 vis images. Does a description of a Chinese unicorn allow our minds to wonder? Do we have a fixed notion of it? Or does the AI image \u2013 the translation \u2013 close doors within our imagination, anchoring us to fixed notions of what this creature might look like? Perhaps words are more open-ended than we allow.\r\n\r\nGenerative AI also opens new possibilities for rewriting narratives. Artist Danielle King\u2019s project Mother<\/em><\/a> examines how generative AI interprets and reconstructs motherhood, using transgressive literary texts on the subject to probe both the system and its deeply ingrained biases. By juxtaposing these narratives against the model\u2019s outputs, she reveals how such biases are not only reflected in language but embedded within the system itself, testing the limits of how motherhood can be represented and reimagined.\r\n\r\nKing reflects: \u201cWriters like Rachel Cusk, Anne Lamott, Olga Ravn and Kate Baer all write about motherhood with an unflinching honesty that our society routinely suppresses exposing the ambivalence and contradictions, detailing the body's transformation and scars, describing the sacred as well as the grotesque. Their work helped shape the language of my prompts, as I asked the machine to see what culture has trained it not to.\u201d\r\n\r\nThis aligns with literature\u2019s long-standing role in questioning dominant narratives. What changes with AI is the speed \u2013 and the fact that this rewriting can now occur visually as well as textually.\r\n\r\nAt the same time, these tools allow for preservation. In Pace<\/em><\/a>, I reconstructed a pharmacy in Madrid tied to personal memory, preserving it through AI after its physical disappearance. The result is neither document nor fiction, but a narrative that holds both memory and dream.\r\n\r\n\"\"<\/a>\r\n

Pace<\/em>, still image, Ana Mar\u00eda Caballero (2025).\r\nCourtesy of the artist.<\/p>\r\nThis impulse toward preservation is not isolated. Projects such as Holly Herndon and Mat Dryhurst\u2019s The Call<\/em><\/a>, developed with the Serpentine Galleries, similarly explore how AI can record and reanimate cultural memory \u2013 training models on collective vocal traditions to ensure they persist and evolve. As they note, the work is rooted in a desire to \u201cmake the full process of generative AI legible,\u201d transforming what is often abstract into something \u201cvisceral and emotional\u201d while foregrounding the human experience embedded in training data.\r\n\r\nWhat emerges is not a merging of disciplines, but an expansion of literature, giving rise to writing aimed less with description and more with activation.\r\n\r\nAnd yet, for all its novelty, this shift returns to something familiar. Literature already operates at the edge of reality. Text-to-image AI does not replace this \u2013 it sharpens it.\r\n\r\n \r\n\r\n\u00a9 IE Insights."],"wpcf-audio-article":["https:\/\/www.ie.edu\/insights\/wp-content\/uploads\/2026\/06\/Caballero-Audio-26.mp3"],"wpcf-article-extract":["Text-to-image AI is transforming writing into a visual medium, expanding literature through interpretatoin, writes Ana Mar\u00eda Caballero."],"wpcf-article-extract-enable":["1"]},"_links":{"self":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/articles\/1495129","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/articles"}],"about":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/types\/articles"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/media\/1495137"}],"wp:attachment":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/media?parent=1495129"}],"wp:term":[{"taxonomy":"schools","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/schools?post=1495129"},{"taxonomy":"areas","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/areas?post=1495129"},{"taxonomy":"subjects","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/subjects?post=1495129"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}