San Francisco aims to track AI use with new legislation

San Francisco’s proactive approach to AI governance: San Francisco Supervisor Hilary Ronen is set to introduce groundbreaking legislation aimed at regulating the use of artificial intelligence (AI) across city and county departments.

• The proposed legislation seeks to create transparency, assess potential impacts, and establish standards for AI usage in local government operations.
• This initiative comes as San Francisco, a hub of technological innovation, grapples with the rapid advancement and integration of AI technologies in various sectors.

Key components of the proposed legislation: The Department of Technology would be tasked with implementing three primary measures to oversee and regulate AI use in San Francisco.

• Create and maintain a public inventory of AI technologies used across city and county departments, including the rationale behind their implementation.
• Conduct comprehensive impact assessments of AI programs, focusing on potential worker displacement, decision-making biases, security vulnerabilities, and privacy concerns.
• Develop standards for the procurement of new AI systems, ensuring they align with the city’s values and regulations.

Current state of AI usage in San Francisco: The city’s decentralized approach to technology adoption has led to a lack of centralized knowledge about AI implementation across departments.

• San Francisco’s Chief Information Officer, Michael Makstman, highlighted the challenges posed by the fragmented IT systems spread across more than 50 city departments.
• Despite the lack of a comprehensive overview, AI is already in use in various city services, including the 311 app, radiology departments, and cybersecurity systems.

Timeline and implementation: The proposed legislation sets specific deadlines for the Department of Technology to compile and assess AI usage across the city.

• Makstman would have six months to publish an initial inventory of AI programs currently in use.
• A one-year deadline would be set for completing impact assessments of these AI systems.

Labor union support and implications: The proposed legislation has garnered support from labor unions, recognizing the potential impact of AI on the workforce.

• SEIU 1021, a prominent labor union, backs the legislation as it provides a foundation for negotiating AI-related clauses in future contracts.
• The impact assessments will involve input from labor and privacy experts, ensuring a balanced approach to AI implementation.

San Francisco’s history of tech regulation: This proposed AI legislation aligns with San Francisco’s track record of proactively addressing emerging technologies and their societal impacts.

• In 2019, the city banned the use of facial recognition technology by police departments.
• Earlier this year, San Francisco prohibited the use of algorithmic systems for setting rental prices.

Balancing innovation and regulation: The proposed legislation aims to strike a balance between embracing technological advancements and mitigating potential risks.

• Rather than imposing outright bans on AI technologies, the legislation focuses on increasing transparency and addressing potential issues proactively.
• This approach allows for the continued adoption of beneficial AI systems while ensuring proper oversight and regulation.

Broader implications for AI governance: San Francisco’s proposed AI legislation could serve as a model for other cities and regions grappling with the rapid integration of AI technologies.

• The initiative highlights the growing need for local governments to develop comprehensive strategies for managing AI implementation in public services.
• By focusing on transparency, impact assessment, and procurement standards, the legislation addresses key concerns surrounding AI adoption in government operations.

Looking ahead: Challenges and opportunities: As San Francisco moves forward with this pioneering legislation, several key questions and considerations emerge.

• The effectiveness of the legislation will depend on the city’s ability to accurately assess and categorize AI systems across diverse departments.
• Balancing the need for innovation with regulatory oversight will be crucial in maintaining San Francisco’s position as a tech hub while addressing potential societal impacts.
• The success of this initiative could pave the way for more comprehensive AI governance frameworks at local, state, and national levels.