Connect with us

Technology

People can’t tell the difference between human and AI-generated poetry – new study

Published

on

By Jon Stone, Anglia Ruskin University; The Conversation

Porter and Machery conclude that “the capabilities of generative AI models have outpaced people’s expectations of AI”. (File Photo: Andrea De Santis/Unsplash)

Has the bell finally tolled for Shakespeare and Byron? New research conducted by philosophers of science Brian Porter and Edouard Machery suggests that the latest AI-generated poetry is “indistinguishable from human-written poetry” and “rated more favourably”.

Ten poets, from the medieval Geoffrey Chaucer to modern writer Dorothea Lasky, were successfully impersonated by AI chatbots, with most of the 696 participants slightly preferring the imitation to the real thing.

Porter and Machery conclude that “the capabilities of generative AI models have outpaced people’s expectations of AI”. But they don’t say AI has been proven an adequate replacement for human poets – and rightly so, as such a conclusion would require a great deal more testing.

That the research participants were fooled is not particularly worrying. Porter and Machery set out to include a wide range of poem types, which meant choosing poets who mostly belong to ages past. In such cases, modern readers are likely to have a hard time looking past the obvious signs of antiquity – outdated diction, rigid formalism, and obscure cultural references. It’s not so hard to disguise yourself as someone when that person is chiefly known for the odd clothes they wear.


Looking for something good? Cut through the noise with a carefully curated selection of the latest releases, live events and exhibitions, straight to your inbox every fortnight, on Fridays. Sign up here.


But what about the matter of preference? As well as overall quality, the researchers asked participants to rate poems on a range of qualitative dimensions. How was the imagery, rhythm, sound or beauty? How “inspiring”, “lyrical”, “meaningful”, “moving”, “original”, “profound”, “witty” (and so on) was it? AI won out over Shakespeare and company in nearly every category.

Does this mean human poets have been supplanted? Not really. Participants in the research overall reported “a low level of experience with poetry”. Lack of familiarity with any artform severely limits our ability to get the most out of it. All the AI has to do is sand off the more challenging elements – ambiguity, wordplay, linguistic complexity – in order to produce a version which is more palatable to those with little interest in the art.

If that sounds snobbish, think of it this way: when we aren’t used to eating a foreign cuisine, most of us gravitate toward the blandly familiar end of the menu.

But poetry is not a medium many look to for instant gratification. The reason poets of the calibre of Byron and Walt Whitman (both of whom were included in this study) continue to command respect is because their poetry rewards extended, rather than cursory, attention. The report agrees on this point, noting that participants complained more often of the human-authored poems that they “don’t make sense”.

For now, then, poets have little reason to fret. Is it possible, though, that we aren’t too far off the point where seasoned readers of poetry are able to discover a richness and depth in AI poetry that outstrips similar efforts by humans? I think so – not least because a substantial contributor to the emotional and intellectual impact of a poem is the reader’s own imagination.

It is the reader who, through the act of reading, brings the words to life. For decades now, the concept of “found poetry” – as well as collage poetry and other related techniques – has rested on the fact that all language can be recontextualised as poetry, if arranged with care. For the skilled reader of poetry, the poem is a construction kit, or playground, for the mind to revel in.

But we must then ask, how many readers will choose to repeatedly commit the time and effort needed to draw meaning from AI-created texts? Is the pleasure of reading reward enough in itself?

For some, it will be. But I suspect for the majority, the real point of poetry is to put you in touch, in a very specific way, with other human minds. It is more social activity than technical feat.

In many cultures, the rituals that have grown around it are collaborative, participatory. Poetry is made not because we need poems to exist, but because we seek a keener, fuller awareness of each other – of the sense each of us makes of the world.

That does not mean AI won’t change poetry. Every recent generation of poets has been deeply interested in adapting and absorbing new technologies, along with shifts in cultural mood. Film poets continue to explore combinations of spoken word and moving image. Flarf poetry collected and reconfigured search engine detritus. And my own research into video game poetry has uncovered rapidly growing interest in a form of poetry that is restlessly interactive, playable, slippery.

Already, poets like Dan Power and Nick Flynn are collaborating in different ways with AI to uncover new avenues of possibility. And AI’s ability to approximate Shakespeare’s style is a technological marvel.

But art that merely imitates and iterates on what has come before is art at its most trivial. The goal of the poet is not to be mistaken for Shakespeare, but much the opposite: to make something never seen before.The Conversation

Jon Stone, Senior Lecturer in Creative Writing, Anglia Ruskin University

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Maria in Vancouver

Lifestyle4 days ago

Nobody Wants This…IRL (In Real Life)

Just like everyone else who’s binged on Netflix series, “Nobody Wants This” — a romcom about a newly single rabbi...

Lifestyle2 weeks ago

Family Estrangement: Why It’s Okay

Family estrangement is the absence of a previously long-standing relationship between family members via emotional or physical distancing to the...

Lifestyle2 months ago

Becoming Your Best Version

By Matter Laurel-Zalko As a woman, I’m constantly evolving. I’m constantly changing towards my better version each year. Actually, I’m...

Lifestyle2 months ago

The True Power of Manifestation

I truly believe in the power of our imagination and that what we believe in our lives is an actual...

Maria in Vancouver3 months ago

DECORATE YOUR HOME 101

By Matte Laurel-Zalko Our home interiors are an insight into our brains and our hearts. It is our own collaboration...

Maria in Vancouver3 months ago

Guide to Planning a Wedding in 2 Months

By Matte Laurel-Zalko Are you recently engaged and find yourself in a bit of a pickle because you and your...

Maria in Vancouver4 months ago

Staying Cool and Stylish this Summer

By Matte Laurel-Zalko I couldn’t agree more when the great late Ella Fitzgerald sang “Summertime and the livin’ is easy.”...

Maria in Vancouver5 months ago

Ageing Gratefully and Joyfully

My 56th trip around the sun is just around the corner! Whew. Wow. Admittedly, I used to be afraid of...

Maria in Vancouver5 months ago

My Love Affair With Pearls

On March 18, 2023, my article, The Power of Pearls was published. In that article, I wrote about the history...

Maria in Vancouver6 months ago

7 Creative Ways to Propose!

Sometime in April 2022, my significant other gave me a heads up: he will be proposing to me on May...