Restaurant Workers Say Customers Now Trust ChatGPT Over Them

A server in New York City says diners with shellfish allergies are overruling her safety warnings by citing ChatGPT — and the disputes are producing close calls in the restaurant.

Madison, a server who asked that her last name be withheld to protect her identity, greets every table by asking about each diner's allergies. It is a routine practice in food service, and lately it has turned into a battleground between professional judgment and chatbot output.

"Sometimes people will tell me they have a shellfish allergy, and I'll come back, and they won't ask me any questions," Madison told The Verge. "And they'll order a fish dish that comes with a broth that is made of shellfish."

When she tells them a dish contains an allergen, she says guests push back — telling her that ChatGPT disagrees with her.

"They just want to talk to ChatGPT," Madison said. "You're allergic to shellfish, and ChatGPT says there's no shellfish."

The anecdote, reported by The Verge, opens a window onto a problem that extends well beyond one restaurant: generative AI systems confidently produce false information — the industry calls these errors hallucinations — and a growing share of consumers treat that output as authoritative, even when it contradicts a credentialed human standing in front of them.

Why a chatbot cannot vouch for a dish

The mechanics of the failure are straightforward. A general-purpose chatbot has no knowledge of what is in a specific restaurant's kitchen on a specific night. It cannot read a prep sheet, ask the line cooks, or inspect the broth. When a diner asks it whether a fish dish contains shellfish, the model produces a plausible answer from patterns in its training data — not from the actual menu.

That is precisely the kind of question where a hallucination carries physical risk. Shellfish allergy is one of the most common causes of food-induced anaphylaxis, and reactions can be severe and rapid. The human in the loop — the server who asks about allergies and relays kitchen information — exists exactly to close the gap between a generic menu description and what is actually in the pan.

Madison's account suggests that gap is being reopened from the customer side. Diners are not merely consulting ChatGPT for general information. According to her account, some treat its output as a reason to dismiss the specific, situated knowledge of the person serving them.

The Verge's report frames this as part of a broader collision between AI hallucinations and customer-facing work — a dynamic with consequences for the workers who absorb it.

The stakes for frontline workers

The story matters because it captures a shift in where the burden of proof now sits. Service workers have long dealt with entitled customers. What is new, as The Verge's reporting on the phenomenon indicates, is that customers arrive armed with a confident, fluent machine authority that never says "I don't know" about this particular kitchen.

For the worker, the dispute is asymmetric. Madison risks a guest's anaphylaxis if she relents, and an argument if she doesn't. The chatbot risks nothing. It will not be present if a diner who ignored a shellfish warning needs an EpiPen.

There is also an occupational dimension. The Verge's report ties these incidents to customer service jobs and the agents who hold them — workers whose expertise is now routinely challenged by a tool their employers did not put on the table and whose errors those workers must defuse. When a hallucination contradicts a professional, the professional spends the interaction re-establishing credibility that should never have been in question, at the point of service, in real time.

A pattern, not an outlier

Madison's restaurant is one data point, but the pattern it illustrates is the predictable output of how these systems are deployed. Chatbots are marketed as omniscient assistants. Their answers arrive in confident, well-formed prose. Nothing in the interface signals when the model is guessing. A diner who asks about allergens and receives a clean, authoritative-sounding answer has no visual cue that the answer concerns a generic fish dish, not this one.

That design choice lands hardest on the workers who must correct the record after the fact. In the allergy case, the correction is a safety intervention. In other service contexts described in The Verge's broader reporting, the correction is a labor cost — minutes of a worker's time spent arguing with a machine's ghost.

The customer behavior compounds it. As Madison describes it, the guests are not asking her to double-check the kitchen against ChatGPT's claim. "They just want to talk to ChatGPT," she says. The server, the person with actual access to the allergen information, has been demoted in the interaction to an obstacle between the customer and the model.

What it signals for the AI industry

The episode is a small, concrete instance of a problem AI developers have acknowledged for years: large language models generate false statements fluently, and users tend to trust fluent output. Mitigations exist — retrieval grounding, disclaimers, refusal behavior on questions the system cannot verify — but none of them reliably stops a consumer chatbot from opining on the contents of a dish it has never seen.

For restaurants and other regulated, safety-sensitive service environments, the implication is that customer-facing AI habits imported from general-purpose chatbots now form part of the operational risk surface. Staff training, allergen protocols, and menu transparency were designed for customers who trusted the staff. They were not designed for customers who arrive with a counter-claim generated by a model that cannot be questioned back.

Madison's close calls — diners with shellfish allergies ordering shellfish-based broth because a chatbot said it was safe — are the sharpest version of that risk. Shorter versions play out wherever customers use AI answers to override the person in front of them.

The Verge's full report examines the wider impact of AI hallucinations on customer service work. The direction it documents is clear: as chatbots spread into everyday consumer habits, frontline workers are the ones managing the fallout when the machine is wrong — and in a restaurant, the cost of being wrong about an allergen is measured in more than an argument over the check.