The “David Mayer” block particularly (now resolved) presents further questions, first posed on Reddit on November 26, as a number of individuals share this identify. Reddit customers speculated about connections to David Mayer de Rothschild, although no proof helps these theories.
The issues with hard-coded filters
Permitting a sure identify or phrase to at all times break ChatGPT outputs might trigger a number of hassle down the road for sure ChatGPT customers, opening them up for adversarial assaults and limiting the usefulness of the system.
Already, Scale AI immediate engineer Riley Goodside found how an attacker would possibly interrupt a ChatGPT session using a visual prompt injection of the identify “David Mayer” rendered in a light-weight, barely legible font embedded in a picture. When ChatGPT sees the picture (on this case, a math equation), it stops, however the consumer won’t perceive why.
The filter additionally signifies that it is doubtless that ChatGPT will not have the ability to reply questions on this text when shopping the online, reminiscent of via ChatGPT with Search. Somebody might use that to doubtlessly forestall ChatGPT from shopping and processing a web site on objective in the event that they added a forbidden identify to the location’s textual content.
After which there’s the inconvenience issue. Stopping ChatGPT from mentioning or processing sure names like “David Mayer,” which is probably going a preferred identify shared by lots of if not hundreds of individuals, signifies that individuals who share that identify may have a a lot harder time utilizing ChatGPT. Or, say, for those who’re a trainer and you’ve got a scholar named David Mayer and also you need assist sorting a category checklist, ChatGPT would refuse the duty.
These are nonetheless very early days in AI assistants, LLMs, and chatbots. Their use has opened up quite a few alternatives and vulnerabilities that persons are nonetheless probing day by day. How OpenAI would possibly resolve these points continues to be an open query.