But this is the first time I’ve ever viewed a person of them made use of to flip comprehensive songs into pictures, and the results are so great that I’m persuaded that the true killer software for this technological know-how is sleeping inside David Bowie’s songs archive.
Don’t feel me? Here’s Bowie’s “Area Oddity,” produced by YouTube person aidontknow. Their process concerned typing the music lyrics into the AI prompt, verse by verse, to make each individual graphic for the video.
See what I suggest?
Sure, the likes of Midjourney, Dall-E, and Stable Fusion will a person working day go away the uncanny valley driving and provide a never-ending supply of perfect stock shots that will seem as convincing as the serious point. That is also a large downside to all this pleasurable: These equipment are primarily mining the existing operate of designers and photographers who obtain no AI licensing expenses in a rapidly evolving area that will have detrimental downstream results for the business.
But, correct now, this movie demonstrates that AI’s frequently otherworldly benefits are still minimal: well-suited for poetry and fantastic literature, but not everything much too literal. That looks to be the concept that moved aidontknow to switch some of Ziggy Stardust’s songs into tunes slideshows.
Aidontknow made use of the similar methodology inside of Midjourney to produce this rendition of “Starman.” The video clip description suggests that there are small variations and influence from the writer, which I uncovered to be required when I tried out to do the same utilizing Midjourney in Discord.
Sometimes a verse will use the word it to reference an object or particular person named earlier in the tune, for example, so I essential to swap it back again to the subject’s additional certain identify so that the AI could establish what “it” was.
I only tried using a couple of verses per tune to get an thought of how properly it labored with different tracks. But making use of Midjourney for the endeavor felt exhilarating: All I did was paste the lyrics, and the visuals slowly and gradually materialized in entrance of my eyes devoid of any other energy, like a genie pluming out of a lamp.
And in fact, I located out that there seems to be a very clear correlation in between magnificence and surrealism. The visuals for Tom Waits’s “Alice” (benefits pictured about this paragraph) were being as magical as the track itself:
It’s dreamy climate
We’re on [first image]
You waved your crooked wand
Together an icy pond
With a frozen moon [second image]
A murder of silhouette
Crows I noticed [third image]
And the tears on my encounter
And the skates on the pond
They spell Alice [fourth image]
I acquired similarly fantastical effects for the Beatles’ “Throughout the Universe” and the Rolling Stones’ “Gimme Shelter,” which also have very visually evocative lyrics. The magic also worked for the poppy R&B riffs in Snoop Dogg’s “Fall It Like It’s Incredibly hot.”
Often, the AI built some errors in the literal interpretation of the phrases. Like in Waits’s “Tom Traubert’s Blues,” the line “See ya tomorrow, hey Frank can I borrow/ A few of bucks from you?” turned funds into literal male deer. (A “buck” I guess.) Which, thoughts you, in fact provides to the lyricism of it all. Like Bob Ross would say: “There’s no mistakes. Just happy incidents.”
