• 2 Posts
  • 9 Comments
Joined 1 year ago
cake
Cake day: June 10th, 2023

help-circle


  • since C2PA relies on creators to opt in, the protocol doesn’t really address the problem of bad actors using AI-generated content. And it’s not yet clear just how helpful the provision of metadata will be when it comes to media fluency of the public. Provenance labels do not necessarily mention whether the content is true or accurate.

    Interesting approach, but I can’t help but feel the actual utility is fairly limited. For example, I could see it being useful for large corporate creative studios that have contractual / union agreements that govern AI content usage.

    If they’re using enterprise tools that build in C2PA, it’d give them a metadata audit trail showing exactly when and where AI was used.

    That’s completely useless in the context where AI content flagging is most useful though. As the quote says, this provenance data is applied at the point of creation, and in a world where there are open source branches of generation models, there’s no way to ensure provenance tagging is built in.

    This technology is most needed to combat AI powered misinformation campaigns, when that is the use case this is least able to address.






  • Well, one context I’m already familiar with is the counter-terrorism duty in the UK. There is a program called Prevent that is designed to tackle radicalisation risk that could result in terrorism or non-violent extremism.

    These programs basically work by placing a duty on certain types of organisation to report concerning behaviours that could result in radicalisation. An example would be a teacher or social worker overhearing a teenager espousing violent ideological positions that they’d been exposed to online.

    This then results in a referral to the local counter-terrorism police unit, who carry out an assessment to determine the level of vulnerability and risk. Far-right ideologies including fascism can be accounted for here. Depending on the outcome, this may result in the referral being closed, or a multi-agency support plan being developed for the individual.

    In that narrow band of circumstances, determining someone’s susceptibility to fascism as an extremist ideology is warranted. That’s in the context of a reactive specialist law enforcement assessment, when there is a justifiable national security interest in the prevention of terrorism.

    That said, this is very different to indiscriminate profiling on a population level. If everyone in the UK was subject to mandatory fascism assessments, that would be massively intrusive and disproportionate, and an enormous infringement of civil liberties - even if the government attempted to justify it on the same national security basis described above.