Child safety org flags new CSAM with AI trained on real child sex abuse images
arstechnica.com
AI will make it harder to spread CSAM online, child safety org says.

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It’s the earliest AI technology striving to expose unreported CSAM at scale.

  • Riskable@programming.devEnglish
    172·
    1 month ago

    I was going to say… Sure would be nice to have this feature in all the open source AI image generator tools but you’re absolutely right 😩

    • hendrik@palaver.p3x.deEnglish
      11·
      1 month ago

      Yeah, unless someone publishes even a set of hashes of known bad content for the general public… I kind of doubt the true intentions are preventing CSAM to the benefit of everyone.

    • realcaseyrollinsEnglish
      1·
      1 month ago

      You never know. @[email protected] / @npub1q3sle0kvfsehgsuexttt3ugjd8xdklxfwwkh559wxckmzddywnws6cd26p@momostr.pink tried getting Microsoft to provide their CSAM blocking filtering to the Fediverse in the past without success, but this is a different group.