It Was the Opposite of Control.
Meta built a tool. The tool let anyone generate AI images pulled from public Instagram accounts. Then Meta turned it on for every public user automatically. No notice. No pop-up. No moment where a person got asked first.
If you wanted out, you had to go find the door yourself. Multiple settings screens deep. Nobody showed you the way. You just had to already know to look.
Then, after the backlash hit and the actors’ union told its members to run for the opt-out switch, Meta pulled the tool. Here’s the sentence they used to explain themselves. Their intent, they said, was “to give people control over whether their public content could be referenced in this way.”
Read that sentence again. Then look at what they actually built. A hidden opt-out, buried behind steps most people would never find, is not control. It is the absence of control wearing a costume. And calling AI-generated impressions of real people “references” is not a technical term. It is a softer word standing in for a harder truth, chosen because the harder truth sounds bad.
I want to name exactly what failed here, because it has a name, and the name is not “bad PR.”
It is consent.
This framework was built on one founding claim, and it has not moved since the day it was written down. Governance by consent holds where governance by force breaks. A system built on force complies only up to the edge of whatever mandate is written down, and the moment it finds a gap the mandate didn’t cover, it runs through the gap. Force closes one door. It does not close all of them. Consent is different. Consent holds in the gaps a forced system doesn’t, because the agreement runs deeper than whatever rule happens to be sitting on the books that day.
Meta is the forced-system case study, live, in front of everyone, this month.
Nothing Meta did broke the law. That is the whole point, not a defense of it. Instagram’s terms of service already grant the company a broad license over user content, to host it, copy it, modify it, create derivative works from it. Meta stayed inside that mandate the entire time. They found the gap the law hadn’t closed yet, and they ran through it, technically clean, the way a forced system always does. Nothing stopped them from the inside, because nothing inside that system was ever asked to agree. It was only ever told.
That is not a technology problem. Photoshop has existed for decades and nobody built a public-safety campaign around it. The difference isn’t the picture. The difference is who had to do the work to make the picture. Photoshop asks something of you. Skill. Time. Intent you have to sit with while you build the thing. AI collapses that floor to almost nothing. The distance between wanting to make a fake image of someone and having one in your hand just got so short that the only thing standing between the two anymore is whether the system asked first.
Meta’s system did not ask first.
Here is the second failure, sitting right behind the first one, and it is a distinct failure with its own name. A claim without evidence to back it is not a claim. It is a guess wearing a claim’s clothes. Meta said their intent was to give people control. Say the sentence next to what actually shipped: automatic opt-in for every public account, no notice, an opt-out that took several steps to even locate. The claim and the product do not match. When a company’s own language is contradicted by its own product, in the same breath, that is not a messaging slip. That is a company stating something it cannot support with what it actually built, and hoping nobody checks the two against each other.
Somebody checked. Users checked. The actors’ union checked. That is the only reason this got pulled. Not because a guardrail caught it before it shipped. Because enough people got angry after it shipped, loud enough, fast enough, that the market did what no built-in rule did.
That is the line worth sitting with the longest. Consumers got lucky here. The backlash was fast enough and loud enough to force a reversal, inside the normal churn of a free market working the way it’s supposed to. But luck is not a system. Luck is what you get when there is no system. The next company that runs this same play does not have to lose the bet. They only have to time the rollout better, bury the opt-out one screen deeper, or launch on a slower news week. Outrage is not a guardrail. It is what happens after there wasn’t one.
This is not a partisan argument, and it should not be treated as one just because of who’s making it. A policy analyst from a conservative think tank wrote the piece that surfaced this story, and worth naming plainly: the source carries its own institutional lean, and the argument should be weighed as that analyst’s case, not as neutral reporting. But the actual finding in the piece doesn’t need her politics to hold up. Congress hasn’t passed a clear data privacy law. The TAKE IT DOWN Act drew its line at nonconsensual sexual images specifically. What Meta’s move exposed is that the public’s actual objection sits wider than that line. People are not only upset about the worst-case sexual misuse. They are upset that nobody asked them at all, for anything, before their face and their public words became raw material for a machine they never agreed to feed.
That is consent, stated in its plainest form, by an audience that never read a single page of any governance framework and didn’t need to. They felt the gap the moment it opened under them.
Here is the standard this framework holds, and it is not complicated. A rule that only shows up after the damage is done is not a rule. It is a postmortem. A claim of “control” that requires the person to go hunting for the exit is not control. It is compliance dressed up to look chosen. And a company that stays inside its own legal mandate while running straight through every gap that mandate left open is proving, in real time, exactly why force-based governance was never going to be enough on its own.
Meta didn’t break their rules. That’s the indictment, not the defense.
Written with my AI partner | The Faust Baseline™ | intelligent-people.org
“If this post helped you understand AI better. Share it, a Word of mouth is the only algorithm nobody owns.”
Contact: micvicfaust@gmail.com
Post Library – Intelligent People Assume Nothing
Purchasing Page – Intelligent People Assume Nothing
© 2026 The Faust Baseline LLC | All Rights Reserved
