Meta fixes the AI suggestion that asked a mother to identify her own child

El-Kassaby's statement to The Verge concedes the prompt and defends the data access. "While the content was available to this user, these prompts should never have been generated," she said ^[10]. Both halves can hold at once, and the combination is the useful part for anyone building a suggestion layer over a corpus of user content that already exists. Account permissions scoped what the assistant could fetch, and nothing in that model scoped what the product was willing to ask about.

Meta's stated purpose for the feature is topic discovery. "We created this feature to help people get more information about topics or posts that interest them," El-Kassaby said ^[14]. That works when the post is about sourdough. Applied to a clip of a parent and a child singing in a car, the generator had one subject available to be curious about, and it asked who the child was ^[2].

Teams building these surfaces treat a suggested prompt as a shortcut into content the user already owns. Users read it as the product speaking to them about the thing on screen. Robins says she tapped it, and the assistant returned details about her daughters drawn from her own earlier posts and from posts by her relatives, then offered follow-up prompts about the children's ages and where the family lives ^[3][4]. One prompt under one video became three prompts about the same child inside a single session ^[18].

The deleted-photo part is Robins' account, and it should be read as hers: she says the assistant showed photos of her daughters including one she had removed years earlier ^[19]. Dexerto made the wider point that deleting one post is not the same as removing every copy or reference to that information elsewhere on social media ^[11]. Meta's own explanation points at a second surface. El-Kassaby said the assistant may have pulled from videos in which Robins named her children ^[7].

The scoping test worth running before a generated surface ships has two axes, and permissions only cover one of them. Axis one: can the system retrieve the item for this account. Axis two: did the user ask for it. The quadrant this feature landed in is retrievable plus system-initiated, the only one of the four where the product picks the subject. Anything landing there needs a written rule about which subjects the system may raise unprompted, and minors, health, location and family relationships are the obvious four to name in it.

The cheap version of that check is to take a week of prompts the generator produced against real accounts and read them out as sentences an employee would say to the account holder's face. "Who is the child passenger?" fails that reading whether or not the video was public, which is what El-Kassaby's "missed the mark" concedes ^[5]. What Meta changed in the prompt system, and how many similar suggestions were generated before the fix, remain unpublished ^[9]. It pulled a different AI feature in July, the one that let people create deepfakes of other Instagram users, after what The Verge described as fierce backlash ^[16].