New AI Contracting Standards
Governor Gavin Newsom has unveiled a landmark executive order designed to regulate the use of artificial intelligence within California's state government.
This directive mandates that any AI companies seeking to do business with the state must adhere to robust standards, demonstrating a commitment to responsible policies. The primary objective is to prevent the exploitation of user data, safeguard against security breaches, and uphold the civil rights of California residents. Unlike a more reactive approach seen elsewhere, California is proactively establishing a framework to ensure that the AI solutions adopted by the nation's most populous state, and the world's fourth-largest economy, are not weaponized by malicious actors. This executive order initiates a crucial process for vetting AI providers, requiring them to clearly articulate their safeguards and attest to their practices, thereby building a more trustworthy technological ecosystem.
Preventing Exploitation and Bias
As part of the governor's directive, the state's agency for government operations is tasked with developing a comprehensive plan for new contracting procedures. These procedures will critically evaluate AI vendors based on their stated policies and their ability to guarantee public protection. Specific areas of scrutiny include the prevention of the distribution of illegal content through AI models, the identification and mitigation of inherent biases within AI systems, and the assurance that AI technologies do not lead to violations of civil rights or infringe upon freedom of speech. This multi-faceted approach aims to ensure that AI development and deployment serve the public good without compromising fundamental rights and safety.
Watermarking and Transparency
Beyond contracting requirements, the executive order also addresses the growing concern of AI-generated synthetic media. The California Department of Technology is directed to formulate recommendations and best practices for watermarking AI-generated images and manipulated videos. This initiative, the first of its kind nationwide, aims to provide a clear mechanism for identifying content that has been altered or created by artificial intelligence, thereby enhancing transparency and combating misinformation. Governor Newsom emphasized California's role as an innovation hub, acknowledging both the potential for progress and the risks associated with misuse. He affirmed that the state would leverage its position to ensure AI companies prioritize people's rights over exploitation, contrasting this proactive stance with approaches that might be perceived as less attentive to potential harms.
