Joyce Esser, a woman living with bulbar motor neuron disease (MND), recently faced an unexpected setback when she was banned from using an AI-powered voice cloning tool. The tool, provided by ElevenLabs, allowed her to recreate her speech and communicate more freely, including using language that reflected her personality. Despite the tool’s promise to help individuals with MND express themselves uncensored, Esser found herself banned after typing a message that included a swear word. This incident has sparked a conversation about the importance of clear guidelines in AI speech technology and the rights of users to express themselves authentically.
Esser had been using ElevenLabs’ technology to input recordings of her old voice and then type messages to be spoken aloud. This innovative tool offered her a chance to reclaim a voice she thought she'd lost. During a local MND group session, she praised the technology for its ability to give her back a sense of normalcy in communication. However, her enthusiasm was short-lived.
In a moment of candid communication with her husband, Esser typed, "Come on, Hunnie, get your arse in gear!!" This playful yet authentic expression led to a swift response from ElevenLabs. According to Esser, "The next day I got a warning from ElevenLabs that I was using inappropriate language and not to do it again!!!" However, the situation escalated quickly. "Well, apparently not, because the next day a human banned me!!!!" she added.
The ban surprised Esser and highlighted an apparent gap in the company’s policy. While ElevenLabs prohibits threats, impersonation, and election interference, there is no explicit rule against swearing. This oversight has raised questions about the company's approach to free speech within their AI tools. Richard Cave from the MND Association emphasized the importance of allowing people living with MND to express themselves freely, including using swear words.
Esser's experience has drawn attention to the broader implications of AI-driven communication tools for those with MND. These tools are designed to help users express themselves without censorship. Yet, Esser's ban underscores the need for clearer guidelines around language use and expression in these technologies.
