Songwriter Forum

General Category => AI (Artificial Intelligence) In Songwriting => Topic started by: icystorm on Nov 10, 2025, 05:10 PM

Title: Interesting new tools for detecting AI-generated songs
Post by: icystorm on Nov 10, 2025, 05:10 PM
A new song (in a music video) was recently posted to the forum in the SHOWCASE for Release Songs sub-forum and presented by a new member as their own work. Because I cannot prove that the piece is AI-generated, I chose not to state in that thread that the song is not original, nor am I naming it or the poster here. However, I tested my suspicion using a new online tool:

Sightengine AI‑Generated Music Detector: A commercial service/API that allows you to upload an audio file (MP3, WAV etc) and it outputs a probability that the track is AI-generated. It works with music generated by Suno, Udio, Riffusion, etc.

https://sightengine.com/detect-ai-generated-music

The site indicates that there is a 99% probability that the song in question was generated by AI.

A second site exists for the same purpose.

MatchTune: Has developed detection technology that can recognize music generated by Suno with ~95 % accuracy.

https://www.matchtune.com/

It's great to see new tools emerging to help identify fake or AI-generated content. ;D

My goal isn't to criticize people who use AI services to compose songs for their own amusement. If it's fun for you, go for it! :D But for those who attempt to deceive others by pretending or implying that they wrote a song that was actually generated by Suno or another AI service, it's encouraging to see new ways to spot that kind of fraud. I'm satisfied that my suspicions were essentially confirmed by the sightengine.com tool. ;D

Title: Re: Interesting new tools for detecting AI-generated songs
Post by: Elvis Nash on Nov 20, 2025, 08:02 AM
Quote from: icystorm on Nov 10, 2025, 05:10 PMA new song (in a music video) was recently posted to the forum in the SHOWCASE for Release Songs sub-forum and presented by a new member as their own work. Because I cannot prove that the piece is AI-generated, I chose not to state in that thread that the song is not original, nor am I naming it or the poster here. However, I tested my suspicion using a new online tool:

Sightengine AI‑Generated Music Detector: A commercial service/API that allows you to upload an audio file (MP3, WAV etc) and it outputs a probability that the track is AI-generated. It works with music generated by Suno, Udio, Riffusion, etc.

https://sightengine.com/detect-ai-generated-music

The site indicates that there is a 99% probability that the song in question was generated by AI.

A second site exists for the same purpose.

MatchTune: Has developed detection technology that can recognize music generated by Suno with ~95 % accuracy.

https://www.matchtune.com/

It's great to see new tools emerging to help identify fake or AI-generated content. ;D

My goal isn't to criticize people who use AI services to compose songs for their own amusement. If it's fun for you, go for it! :D But for those who attempt to deceive others by pretending or implying that they wrote a song that was actually generated by Suno or another AI service, it's encouraging to see new ways to spot that kind of fraud. I'm satisfied that my suspicions were essentially confirmed by the sightengine.com tool. ;D




It's pretty easy to spot a AI song . Now they have one that made the digital Billboard charts
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: icystorm on Nov 23, 2025, 10:12 PM
Quote from: Elvis Nash on Nov 20, 2025, 08:02 AMIt's pretty easy to spot a AI song . Now they have one that made the digital Billboard charts

AI-generated music should have its own genre so that people who don't like it can easily avoid it. A new term has emerged for AI-generated content across cyberspace: AI slop.

Recall the Star Wars scene at the Mos Eisley spaceport when the bartender booted C-3PO and R2-D2 from the cantina:

"Hey! We don't serve their kind here. Your 'droids—they'll have to wait outside. We don't want them here." LOL!!! 😂🤣


Title: Re: Interesting new tools for detecting AI-generated songs
Post by: JohnS on Nov 24, 2025, 04:52 PM
A recent survey, quoted by the BBC, found 97% of listeners couldn't tell ai songs from human songs. It also seems the majority of listeners don't care how the music was made, as long as it sounds good to them.
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: Elvis Nash on Nov 30, 2025, 06:30 AM
Quote from: JohnS on Nov 24, 2025, 04:52 PMA recent survey, quoted by the BBC, found 97% of listeners couldn't tell ai songs from human songs. It also seems the majority of listeners don't care how the music was made, as long as it sounds good to them.

Yup thats the deal , AI will get even better
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: ChrisPrice on Dec 06, 2025, 09:06 PM
This is interesting. I won't name anyone, but I just ran some lyrics through this :https://arting.ai/ai-detector ..and around 50% of the lyrics one person claimed to be their own work came back as most likely AI generated...which is pretty much as I suspected. I put several lyrics of mine to the test and nothing came back as AI. I would never accuse anyone as there's no way these detectors can be 100% accurate. But I just want people to be honest about how they create their music.
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: icystorm on Dec 06, 2025, 09:40 PM
Quote from: ChrisPrice on Dec 06, 2025, 09:06 PMThis is interesting. I won't name anyone, but I just ran some lyrics through this :https://arting.ai/ai-detector ..and around 50% of the lyrics one person claimed to be their own work came back as most likely AI generated...which is pretty much as I suspected. I put several lyrics of mine to the test and nothing came back as AI. I would never accuse anyone as there's no way these detectors can be 100% accurate. But I just want people to be honest about how they create their music.

Great points, Chris. There are now a lot of tools for detecting AI content (lyrics, music, art, pictures, videos, etc.) Another site that I like to use to detect fake lyrics is https://www.grammarly.com/ai-detector

I checked the lyrics posted by multiple posters on this site and most were clean and clear, but a couple showed high probabilities that their lyrics were written by AI.

It is now possible to create lists of probabilities associated with posters who post lyrics, music, and full tracks that were created by AI.

I have nothing against people using AI for their own interests or amusement, but why post to a songwriters forum and ask people to waste their time listening to fake songs, reading fake lyrics, and providing feedback for fake content that a computer generated? It makes no sense.
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: JohnS on Dec 07, 2025, 09:52 AM
I've just run through 5 ai detectors, the lyrics to a song I wrote in 2020. That song won the 2020 UK Songwriting contest lyrics section so there can be no doubt when it was written - long before ai was available.

Grammerly, QuillBot, Scribbr and Notegpt say 0% ai content. However, Justdone says 74% ai content!

So, be careful which detector you use, perhaps try three or four to see if they are consistent.
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: ChrisPrice on Dec 07, 2025, 11:08 AM
Quote from: JohnS on Dec 07, 2025, 09:52 AMI've just run through 5 ai detectors, the lyrics to a song I wrote in 2020. That song won the 2020 UK Songwriting contest lyrics section so there can be no doubt when it was written - long before ai was available.

Grammerly, QuillBot, Scribbr and Notegpt say 0% ai content. However, Justdone says 74% ai content!

So, be careful which detector you use, perhaps try three or four to see if they are consistent.
Yes, I fully agree with this. We can't be sure that these sites are accurate so trying several is a good shout.
So said, this hasn't got to become some kind of witch hunt..honesty is all I can hope for.
Title: Re: Interesting new tools for detecting AI-generated songs
Post by: icystorm on Dec 07, 2025, 05:34 PM
Quote from: ChrisPrice on Dec 07, 2025, 11:08 AMYes, I fully agree with this. We can't be sure that these sites are accurate so trying several is a good shout.
So said, this hasn't got to become some kind of witch hunt..honesty is all I can hope for.

@ChrisPrice and @JohnS — I completely agree. In October/November 2009, I posted lyrics and a full demo of an original song I composed and recorded titled Nonexistent.

Those lyrics are still available on the Homerecording.com site in a songwriting challenge thread here: Nonexistent (https://homerecording.com/bbs/threads/oct-nov-2009-challenge-joseph-spain.290929/#post-3264518)

I ran those lyrics through the tool Chris linked to from https://arting.ai/ai-detector and it incorrectly reported a 13% chance that my lyrics from 2009 were AI-generated and that the tool was "highly confident" my lyrics from 2009 were AI generated. 😲🤯😂🤣

(https://i.imgur.com/HQiXjAu.png)

In contrast, Grammarly's AI checker (https://www.grammarly.com/ai-detector) correctly identified a 0% chance that the same lyrics were AI-generated:

(https://i.imgur.com/W573QNC.png)

I also tested my most recent 20 songs using Grammarly's AI detector. Every one of them, written both before and after the rise of AI creation tools, correctly indicated that 0% were AI-generated.

Suffice it to say, I do not trust the https://arting.ai/ai-detector website's tool. Its conclusion that lyrics from 2009 were somehow AI-generated is absurd and illogical. The tool clearly generates false positives and incorrectly indicates some degree of AI involvement where there is none. In contrast, Grammarly Pro's AI detector tool reliably reports what I already knew to be true, which is that there is a 0% chance of AI-generated lyrics in my songs. ;D

Title: Re: Interesting new tools for detecting AI-generated songs
Post by: JohnS on Dec 07, 2025, 06:29 PM
JustDone tells me that the lyrics to My MTV by Dire Straits is 71% ai generated!