Poem2Pic Poetry and Art

Created by team Poetry and Art on July 22, 2023

Poetry is food for the soul. On the other hand, an image is worth a thousand words. With Poem2Pic, one blends poetry with art. Poem2Pic enables the generation of an image based on a poem. In particular, Flan-T5, a large language model (LLM), is used to generate a very short summary of an input poem. The summary is then fed to Stable Diffusion in order to generate an image. The final image is displayed to the user. The project used Langchain to interface with the LLM. The user interface is built using Streamlit. The source code and live demo are available at https://huggingface.co/spaces/barunsaha/poem2pic Poem2Pic is primarily aimed at having fun. However, it might find potential applications in the self-publishing industry, for example. In addition, artists as well as the vast poetry community on Twitter and Instagram might find it useful to.

Category tags:

"Great idea and great execution! I'm looking forward to trying Poem2Pic in the future. Good luck!"


Paulo Almeida

co-founder of Stunning Green

"i like that you combined 2 arts together and make a whole new visuals for poem. great work"


Walaa Nasr Elghitany

Lablab Head Judge