The California Civil Rights Council has advanced new regulations regarding employers’ use of artificial intelligence (AI) and automated decision-making systems, clearing the way for them to take effect later this year. The new regulations will make the state one of the first to adopt comprehensive regulations regarding the growing use of such technologies to make employment decisions.

Quick Hits

Table of Contents

California Finalizes AI Employment Regulations: A Thorough Guide

The California Civil Rights Department finalized modified regulations for employers’ use of AI and automated decision-making systems.
The regulations confirm that the use of such technology to make employment decisions may violate the state’s anti-discrimination laws and clarify limits on such technology, including in conducting criminal background checks and medical/psychological inquiries.

On March 21, 2025, the Civil Rights Council, a branch of the California Civil Rights Department (CRD), voted to approve the final and modified text of California’s new “Employment Regulations Regarding Automated-Decision Systems.” The regulations were filed with the Office of Administrative Law, which must approve the regulations. At this time, it is not clear when the finalized modifications will take effect, although they are likely to become effective this year.

The CRD has been considering automated-decision system regulations for years amid concerns over employers’ increasing use of AI and other automated decision-making systems, or “Automated-Decision Systems,” to make or facilitate employment decisions, such as recruitment, hiring, and promotions.

While the final regulations have some key differences from the proposed regulations released in May 2024, they clarify that it is unlawful to use AI and automated decision-making systems to make employment decisions that discriminate against applicants or employees in a way prohibited by the California Fair Employment and Housing Act (FEHA) or other California antidiscrimination laws.

Here are some key aspects of the final regulations.

Automated-Decision Systems

The final regulations define “automated-decision system[s]” as “[a] computational process that makes a decision or facilitates human decision making regarding an employment benefit,” including processes that “may be derived from and/or use artificial intelligence, machine-learning, algorithms, statistics, and/or other data processing techniques.” This definition is narrower than the proposed regulations, which would have included any computational process that “screens, evaluates, categorizes, or otherwise makes a decision….”

Covered systems include a range of technological processes, including tests, games, or puzzles used to assess applicants or employees, processes for targeting job advertisements, screening resumes, processes to analyze “facial expression, word choice, and/or voice in online interviews,” or processes to “analyz[e] employee or applicant data acquired from third parties.” Such systems do not include “word processing software, spreadsheet software, [and] map navigation systems.”

Automated-decision systems do not include typical software or programs such as word processors, spreadsheets, map navigation systems, web hosting, firewalls, and common security software, “provided that these technologies do not make a decision regarding an employment benefit.” Notably, the final regulations do not include language from the proposed rule’s excluded technology provision that would have excluded systems used to “facilitate human decision making regarding” an employment benefit.

Other Key Terms

“Agent”—The final regulations would consider an employer’s “agent” to be an “employer” under the FEHA regulations. An “agent” would be defined as “any person acting on behalf of an employer, directly or indirectly, to exercise a function traditionally exercised by the employer or any other FEHA-regulated activity … including when such activities and decisions are conducted in whole or in part through the use of an automated decision system.” (Emphasis added.)
“Automated-Decision System Data”—The regulations define such data as “[a]ny data used to develop or customize an automated-decision system for use by a particular employer or other covered entity.” However, the final regulations narrow what is included as “automated-decision system data,” removing language from the proposed regulations that would have included “[a]ny data used in the process of developing and/or applying machine learning, algorithms, and/or artificial intelligence” used in an automated-decision system, including “data used to train a machine learning algorithm.” (Emphasis added.)
“Artificial Intelligence”—The regulations define AI as “[a] machine-based system that infers, from the input it receives, how to generate outputs,” which can include “predictions, content, recommendations, or decisions.” The proposed regulations had included “machine learning system[s] that can, for a given set of human defined objectives, make predictions, recommendations, or decisions.”
“Machine Learning”—The term is defined as the “ability for a computer to use and learn from its own analysis of data or experience and apply this learning automatically in future calculations or tasks.”

Unlawful Selection Criteria

Potentially discriminatory hiring tools have long been unlawful in California, but the final regulations confirm that those antidiscrimination laws apply to potential discrimination on the basis of protected class or disability that is carried out by AI or automated decision-making systems. Specifically, the regulations state that it is “unlawful for an employer or other covered entity to use an automated-decision system or selection criteria (including a qualification standard, employment test, or proxy) that discriminates against an applicant or employee or a class of applicants or employees on a basis protected” by FEHA.

Removal of Disparate Impact

However, the final regulations do not include the proposed definition of “adverse impact” caused by an automated-decision system under the FEHA regulations. The prior proposed regulations had specified that an adverse impact includes “disparate impact” theories and may be the result of a “facially neutral practice that negatively limits, screens out, tends to limit or screen out, ranks, or prioritizes applicants or employees on a basis protected by” FEHA. Further, the final regulations do not include similar language defining automated-decision systems to include systems that screen out or make decisions related to employment benefits.

Pre-Employment Practices

The final regulations further clarify that the use of online application technology that “screens out, ranks, or prioritizes applicants based on” scheduling restrictions “may discriminate against applicants based on their religious creed, disability, or medical condition,” unless it is job-related and required by business necessity and there is a mechanism for the applicant to request an accommodation.

The regulations specify that this would apply to automated-decision systems. The regulations state that use of such a system “that, for example, measures an applicant’s skill, dexterity, reaction time, and/or other abilities or characteristics may discriminate against individuals with certain disabilities or other characteristics protected under the Act” without reasonable accommodation may result in unlawful discrimination. Similarly, a system that “analyzes an applicant’s tone of voice, facial expressions or other physical characteristics or behavior may discriminate against individuals based on race, national origin, gender, disability, or other” protected characteristic may result in unlawful discrimination.

Criminal Records

California law provides that before employers deny applicants based on a criminal record, the employer “must first make an individualized assessment of whether the applicant’s conviction history has a direct and adverse relationship with the specific duties of the job” that would justify denying the applicant. The final regulations state that “prohibited consideration” of criminal records “includes, but is not limited to, inquiring about criminal history through an employment application, background check, or the use of an automated-decision system.” (Emphasis added.)

However, the final regulations do not include the proposed language that would have clarified that the use of an automated decision-system alone, “in the absence of additional processes or actions” is not a sufficient individualized assessment. The final regulations further do not include the proposed language that would have required employers to provide “a copy or description” of a report generated that is used to withdraw a conditional job offer.

Unlawful Medical or Psychological Inquiries

The final regulations state that rules against asking job applicants about their medical or psychological histories include “through the use of an automated-decision system.” The regulations state that such an inquiry “includes any such examination or inquiry administered through the use of an automate-decision system,” including puzzles or games that are “likely to elicit information about a disability.”

Third-Party Liability

The final regulations clarify that the prohibitions on aiding and abetting unlawful employment practices apply to the use of automated decision-making systems, potentially implicating third parties that design or implement such systems. Still, the regulations specify that “evidence, or the lack of evidence, of anti-bias testing or similar proactive efforts to avoid unlawful discrimination, including the quality, efficacy, recency, and scope of such effort, the results of such testing or other effort, and the response to the results” is relevant to a claim of unlawful discrimination. However, the final regulations do not include the proposed language that would have created third-party liability for the design and development and advertising, promotion, or sale of such systems.

Next Steps

Once effective, the final regulations will make California one of the first jurisdictions to promulgate comprehensive regulations concerning AI and/or automated decision-making technologies, along with Colorado, Illinois, and New York City. The regulations also come as President Donald Trump is seeking to reshape federal AI policy, focusing on removing barriers to the United States being a leader in the development of the technology. The new policy shifts away from the Biden administration’s focus on safeguarding employees and consumers from potential negative impacts from the use of such technology, particularly the possibility of unlawful employment discrimination and harassment. It is expected that states and localities will continue to regulate AI to fill in the gap.

date:2025-04-09 21:37:00

California Finalizes AI Employment Regulations: A Thorough Guide

california has emerged as a pioneer in addressing the ethical and practical implications of artificial intelligence (AI) in the workplace. With the increasing adoption of AI-powered tools for hiring, performance evaluation, and other employment-related decisions, the state has finalized comprehensive regulations aimed at fostering fairness, openness, and accountability. These new California AI employment regulations mark a meaningful step towards ensuring that AI systems are used responsibly and do not perpetuate bias or discrimination in the job market.

Understanding the Scope of California’s AI Employment Laws

The new regulations cover a broad spectrum of AI applications in the employment context. This includes, but is not limited to:

AI-driven Recruitment Tools: Software used for screening resumes, conducting initial interviews, and assessing candidate suitability.
Performance Management Systems: Platforms that leverage AI to track employee performance, provide feedback, and make promotion or termination decisions.
employee Monitoring Tools: Systems that use AI to monitor employee activity, productivity, and compliance with company policies.
Automated Decision-Making: Any system where AI is used to make or influence decisions related to hiring, firing, promotion, compensation, or other terms and conditions of employment.

The regulations apply to employers of all sizes operating within California.There are no specific exemptions based on company size or industry, highlighting the state’s commitment to ensuring fair AI practices across the board.

Key Provisions of the California AI Employment Regulations

The finalized regulations incorporate several key provisions designed to mitigate the risks associated with AI in the workplace:

Mandatory Bias Audits for AI Systems

Employers are now required to conduct regular bias audits of their AI-powered employment tools to identify and rectify any discriminatory outcomes. These audits must assess the impact of the AI system on different demographic groups, including gender, race, ethnicity, age, and disability status. The audits should include:

Data Analysis: Examining the data used to train and operate the AI system to identify potential sources of bias.
Impact Assessment: Evaluating the real-world impact of the AI system on employment outcomes for different demographic groups.
Mitigation Strategies: Implementing measures to address and eliminate any identified biases, such as retraining the AI system with more diverse data or adjusting the system’s parameters.

The results of these bias audits must be documented and made available to regulators upon request. Failure to conduct regular and thorough audits can result in significant penalties.

Enhanced Transparency Requirements

transparency is a cornerstone of the new regulations.Employers are obligated to inform employees and job applicants about the use of AI in employment-related decisions. This includes providing clear and concise explanations of:

The specific AI tools being used.
The types of data being collected and analyzed.
how the AI system makes decisions that affect employees or applicants.
The potential impact of the AI system on employment outcomes.
Opportunities for employees or applicants to challenge or appeal decisions made by the AI system.

This details must be provided in a clear, accessible, and understandable manner, both at the time of hiring and on an ongoing basis throughout the employment relationship. Failure to provide adequate transparency can lead to legal challenges and reputational damage.

Employee Data Privacy and Security

Recognizing the sensitive nature of employee data, the regulations place strict limits on the collection, use, and storage of data used by AI systems. Employers must:

Obtain explicit consent from employees before collecting and using their data for AI-driven applications.
Implement robust security measures to protect employee data from unauthorized access, disclosure, or misuse.
Limit the retention of employee data to the minimum necessary for the intended purpose.
Ensure compliance with all applicable data privacy laws, including the california Consumer privacy Act (CCPA) and the California Privacy Rights Act (CPRA).

Data privacy breaches related to AI systems can result in significant financial penalties and legal liabilities.

Protection Against Discrimination

A primary objective of the California AI employment regulations is to prevent discrimination. The regulations prohibit the use of AI systems that result in disparate treatment or disparate impact based on protected characteristics such as race, gender, age, religion, or disability. Employers must take proactive steps to ensure that their AI systems are not perpetuating or amplifying existing biases.

If an AI system is found to have a discriminatory effect,employers are required to take immediate corrective action,which may include:

Discontinuing the use of the AI system.
Retraining the AI system to eliminate bias.
Implementing option decision-making processes.
Providing remedies to affected employees or applicants.

Employees who believe they have been discriminated against by an AI system have the right to file complaints with the appropriate regulatory agencies and pursue legal action.

Benefits and Practical Tips for Compliance

While complying with the new regulations may seem daunting, there are several benefits to embracing responsible AI practices. These include enhanced employee trust, improved decision-making, and reduced legal risks.

Benefits of Compliance

benefit	Description
Enhanced Employee Trust	Employees are more likely to trust and engage with AI systems that are transparent and fair.
Improved Decision-Making	AI systems that are properly audited and trained can lead to more accurate and data-driven decisions.
Reduced Legal Risks	Compliance with the new regulations can help employers avoid costly lawsuits and penalties.
Positive Brand Image	Demonstrates a commitment to ethical AI practices, attracting talent and customers.

Practical Tips for Employers

Conduct a thorough assessment of your current AI systems: Identify which systems are used in employment-related decisions and evaluate their potential impact.
Develop a comprehensive AI ethics policy: Outline your institution’s commitment to fair, transparent, and accountable AI practices.
Invest in AI training and education: Ensure that your employees understand the ethical implications of AI and how to use AI systems responsibly.
Establish a process for addressing employee concerns: create a clear and accessible channel for employees to report potential biases or discriminatory outcomes.
Seek expert guidance: Consult with legal and technical professionals to ensure compliance with the new regulations.
Document everything: Maintain detailed records of your AI systems, bias audits, and compliance efforts.

Case Studies: Real-world Examples of AI in Employment

Examining real-world examples can provide valuable insights into the practical implications of the new regulations.

Case study 1: Bias in Resume Screening Software

A large technology company implemented an AI-powered resume screening software to automate the initial screening process for engineering positions. the software was trained on past resume data, which primarily consisted of male applicants. Consequently, the AI system learned to favor male candidates and automatically rejected resumes from qualified female applicants. This unintentional bias led to a significant disparity in the gender distribution of candidates selected for interviews.

Lesson Learned: AI systems can perpetuate and amplify existing biases if not carefully monitored and audited. Diversifying the training data and regularly evaluating the system’s impact on different demographic groups can definitely help mitigate these risks.

Case Study 2: Performance Management and Algorithmic Bias

A retail company used an AI-driven performance management system to evaluate employee productivity and identify top performers. The system analyzed various data points, including sales figures, customer feedback, and attendance records. Though, the system failed to account for external factors that could influence performance, such as store location, seasonality, and individual customer demographics. Consequently, employees in less affluent neighborhoods or those working during slower periods were unfairly penalized. This led to employee dissatisfaction and concerns about fairness.

Lesson Learned: AI systems should be designed to account for contextual factors and avoid relying on overly simplistic or incomplete data. Human oversight and judgment are essential to ensure that performance evaluations are fair and accurate.

First-Hand experience: Implementing AI ethics in a Startup

As a tech startup founder, I recently navigated the process of integrating AI tools into our hiring process. Initially,the allure of efficiency and data-driven decision-making was very appealing. However, after delving deeper into the ethical implications, we realized the importance of proactive measures.

We started by establishing a dedicated AI ethics committee comprised of diverse team members including HR, engineering, and legal. This committee developed a clear AI ethics policy outlining our commitment to fairness, transparency, and accountability. We also invested in third-party tools for conducting bias audits of our AI systems.

One of our biggest challenges was ensuring data privacy. We implemented strict data anonymization and encryption protocols to protect applicant information. We were surprised at the difficulty of finding readily available comprehensive data sets without inherent biases. We had to create our own data augmentation methods leveraging synthetic data and careful attention to sample parity.

Transparency was another key focus.we explicitly informed all job applicants about the use of AI in the selection process and provided them with the prospect to ask questions and challenge decisions. This increased trust and fostered a more positive candidate experience.

Our experience highlighted the meaning of taking proactive measures to ensure that AI systems are used responsibly. It’s not just about compliance; it’s about building a culture of ethical AI that benefits both the organization and its employees.

Resources for Compliance with California AI Employment Regulations

Navigating the complexities of AI employment regulations can be challenging. Here are some helpful resources:

California Department of Fair Employment and Housing (DFEH): Provides information on discrimination laws and regulations.
U.S. Equal Employment Opportunity Commission (EEOC): Offers guidance on federal anti-discrimination laws.
AI Ethics Organizations: Numerous organizations provide resources and tools for ethical AI growth and deployment.
Legal Professionals: Consult with attorneys specializing in employment law and AI compliance.

The Future of AI in Employment and California’s Role

California’s proactive approach to regulating AI in employment is likely to influence other states and even federal policies in the future. As AI continues to evolve, ongoing dialog and collaboration between policymakers, industry leaders, and experts will be essential to ensuring that AI is used to create a more equitable and inclusive workplace.

Worth a look

California Finalizes Artificial Intelligence Employment Regulatio