New York AG warns of potential AI-generated election interference

Election integrity concerns: New York Attorney General Letitia James has issued a warning about the potential risks of relying on AI-powered chatbots for election-related information, urging voters to use only official sources.

• The Office of the Attorney General (OAG) conducted tests on multiple AI chatbots, finding that they frequently provided inaccurate information in response to sample questions about voting.
• James emphasized the importance of accurate voting information, stating that all voters deserve to know where, when, and how to vote correctly.
• The warning comes as early voting is underway and Election Day approaches, highlighting the urgency of the issue.

Key findings from the OAG’s tests: The investigation revealed several concerning instances of AI chatbots providing misleading or false information about crucial aspects of the voting process.

• Some chatbots gave inaccurate information about voter registration deadlines, which could potentially lead to voters missing their opportunity to register.
• Incorrect guidance was provided regarding voting locations, with one chatbot mistakenly advising that Kings County residents could vote at any designated early voting site within the county.
• This misinformation is particularly problematic because New York City residents, including those in Kings County, are assigned specific poll sites based on their residence.

AI companies’ responses: Major AI chatbot providers are implementing measures to address concerns about election misinformation and improve the accuracy of their responses.

• OpenAI, the company behind ChatGPT, has introduced a new search feature that provides sources for its answers and will append a message directing users to official news sources for election information.
• Anthropic’s Claude chatbot offers cautious and general information about voting, directing users to official sources like state election boards and voter lookup tools.
• Perplexity AI has launched its own Election Information Hub, which will provide live election results starting from November 5.

Broader implications: The challenges posed by AI chatbots in disseminating accurate election information highlight the complex relationship between emerging technologies and democratic processes.

• This situation underscores the need for increased digital literacy among voters and the importance of critical evaluation of information sources, especially in the context of elections.
• It also raises questions about the responsibility of AI companies in ensuring the accuracy of their systems, particularly when it comes to sensitive topics like voting rights and procedures.
• The incident may lead to further discussions about potential regulation or guidelines for AI systems when it comes to providing information about civic processes.

Looking ahead: As AI technology continues to evolve and become more integrated into daily life, ensuring the integrity of election information will likely remain a critical challenge for policymakers, tech companies, and voters alike.