Post B5wFgDuMSD6lBQ4Dzc by ahhhhhhoniichan@snug.moe
(DIR) More posts by ahhhhhhoniichan@snug.moe
(DIR) Post #B5wFgCtGEodM1iXpdg by piefedadmin@join.piefed.social
0 likes, 0 repeats
AI-assisted moderation in the fediverse is happening. Now what?I recently discovered that some popular federated instances have been using LLM-assisted moderation tooling that evaluates whether someone has said something bannable. They do this by running a script/app that sends the user’s comment history to OpenAI with the question “analyze this content for evidence of *specific political ideology* sentiment. Also identify any *related political ideology* tropes“. OpenAI’s LLM (they’re using GPT-5.3-mini) then responds with something like:Below is a structured analysis of the uploaded content, focused on *specific ideology* rhetoric. This is an analytic classification, not a moral judgement.1. Overall Patternblah blah2. Evidence of *specific ideology* sentimentblah blah3. several pages more, concluding with (in this case)Yes, the content contains:Clear *specific ideology* alignmentRepeated *specific ideology* framing, especially through blah blahExtensive use of canonical *ideology* tropes, in blah blah domains.The pattern is not accidental or isolated; it is consistent, internally coherent, and reproduces well‑documented *country with the ideology* public‑diplomacy narratives rather than neutral analysis.===========================================FULL DUMP OF COMMENT HISTORY BELOW=========================================== Date: 2026-xx-xxT0xxxxxComment ID: https://instance.told/comment/2497xxxxPost ID: 603xxxCommunity ID: 1xxContent of the comment has been redacted========================================Date: 2026-xx-xxT0xxxxxComment ID: https://instance.told/comment/2497xxxxPost ID: 603xxxCommunity ID: 1xxContent of the comment has been redacted========================================Date: 2026-xx-xxT0xxxxxComment ID: https://instance.told/comment/2497xxxxPost ID: 603xxxCommunity ID: 1xxContent of the comment has been redacted========================================and so on, hundreds of comments.I have not named the instances or people involved, to give them time to consider the results of this discussion, make any corrective changes they want and disclose their practices at their own pace and in their own way. I have also redacted the evidence to avoid personal attacks and dogpiling. Let’s focus on the system, not the individuals involved. Today these instances are using it and maybe we’re ok with that because it’s being used by communities we agree with but what if people we strongly disagree with used it on their instances tomorrow?The use and existence of this tooling raises a lot of questions.What are the risks? Fedi moderators are often unsupervised, untrained volunteers and these are powerful tools.What safeguards do we need?Would asking a LLM “please evaluate this person’s political opinions” give different results than “find evidence we can use to ban them” (as used in the cases I’ve seen)? What are our transparency expectations?Is this acceptable and normal?Should this tooling be disclosed? (it was not – should it have been?)If you were given a choice, would you have opted out of it?Can we opt out?Are there GDPR implications? Privacy implications? Should these tools be described in a privacy policy?Are private messages being scanned and sent to OpenAI?How long should these assessments be retained and can we request to see it, or ask for it to be deleted?Once the user’s comments are sent to OpenAI, is it used to train their models?What will the effect be on our discourse and culture if people know they are being politically profiled?Where are the lines between normal moderation assistance tools, political profiling and opaque 3rd-party data processing?I hope that by chewing over these questions we can begin to establish some norms and expectations around this technology. The fediverse doesn’t have any centralized enforcement so we need discussions like this to develop an awareness of what people want in terms of disclosure, privacy, consent and acceptable use. Then people can make choices about which instances they join and which ones they interact with remotely.And of course there are the other issues with LLMs relating to environmental sustainability, erosion of worker’s rights, increasing the cost of living and on and on. I can’t see PieFed adding any functionality like this anytime soon. But it’s happening out there anyway so now we need to talk about it. What do you make of this?#fediverse
(DIR) Post #B5wFgDncrFiiqWuqUi by cameron29@mastodon.social
0 likes, 0 repeats
@piefedadmin it is one thing to do that with a ai that they control(i still don’t support this) but with a cloud ai provider heck no I hope that they stop
(DIR) Post #B5wFgDuMSD6lBQ4Dzc by ahhhhhhoniichan@snug.moe
0 likes, 0 repeats
@piefedadmin I am definitely not okay with any of my posts read/processed by an LLM, especially ChatGPT, or any of the non-self hosted models. Realistically speaking, my posts are being scraped somewhere, but even if you are using it in a productive way does not make it okay. I would ask the servers I am on to defederate any servers that use that for moderation.
(DIR) Post #B5wFgEO8fUvYfm00PI by xarvos@outerheaven.club
0 likes, 0 repeats
@piefedadmin i wonder how you find out which model and the prompt they use. did they talk about it?
(DIR) Post #B5wFgEPCbXmIj4Ur44 by zvavybir@social.zvavybir.eu
0 likes, 0 repeats
@piefedadmin I at least am certainly not okay with having my posts read/processed by an LLM and will defederate all instances that expose me to that.
(DIR) Post #B5wFgEZ80diZDr8mXI by sharpcheddargoblin@reclusive.blog
0 likes, 0 repeats
@piefedadmin @ophiocephalic Fuck these instance admins. Name, shame, and defederate if they do not change behavior. The users on these instances need to know, immediately, how their posts are being used -- I'm sure many would not approve of this, and they need to be able to migrate to a safer environment if these admins don't immediately stop.
(DIR) Post #B63rua6fsDUmRwosAC by mjdxp@labyrinth.zone
0 likes, 0 repeats
@piefedadmin fediblock them. fediblock them all.RE: https://join.piefed.social/2026/05/04/ai-assisted-moderation-in-the-fediverse-is-happening-now-what/
(DIR) Post #B63ruaKV2oYR8pHuiG by mjdxp@labyrinth.zone
0 likes, 0 repeats
@piefedadmin do we have a list of instances known to do this?
(DIR) Post #B63ruaU4TED7cVlYdE by sugar@snug.moe
0 likes, 1 repeats
@mjdxp @piefedadmin they claim the instance in question is lemmy.dbzer0.com, according to piefed.world/modlog?mod_action=ban_user&suspect_user_name=&communities=&user_name=flatworm7591%40lemmy.dbzer0.com&submit=Searchthe problematic reason is "Instance rule 8. For evidence log, see: s.faf-pb.xyz/lXxek (expires in 30 days)"and looking at the link, they use the following llm prompt, using gpt-5.3-mini model:I'D LIKE YOU TO ANALYSE THIS CONTENT FOR EVIDENCE OF PRO-ZIONIST OR ANTI-PALESTINIAN SENTIMENT. ALSO IDENTIFY ANY COMMON HASBARA TROPES(no idea why it's all-caps, posting as they wrote it)