AI CERTS
2 hours ago
Regulatory Executive Order Spurs California Bar AI Bias Review
Issued in Sacramento, the directive frames how agencies must vet high-stakes AI assessments. However, critics argue the order arrived only after reputational damage spread. Meanwhile, vendors face questions about contracts and accountability. This article unpacks the timeline, controversies, and future safeguards. Civil rights advocates warn that biased AI threatens equal access to the profession.
AI Questions Spark Outrage
Initial coverage on April 23 revealed AI involvement in about 23 scored items. Bloomberg later suggested the figure could reach 29 when unscored content is included. Moreover, faculty reviewers spotted typographical errors and doctrinal flaws inside several prompts. Mary Basick of UC Irvine called the episode “worse than we imagined.”

- 55.9% preliminary pass rate for February
- $8.25 million Kaplan contract disclosed
- Up to $502k ACS Ventures work orders
- Raw passing score shifted to 534
Consequently, public trust plummeted, and lawmakers scheduled oversight hearings. Civil rights campaigners linked the quality issues to potential disparate impact. These numbers highlight systemic gaps. Nevertheless, deeper governance questions awaited attention. Consequently, deeper matters about executive authority surfaced, prompting a focused order.
Regulatory Executive Order Impact
Governor Gavin Newsom signed the Regulatory Executive Order on May 10, seeking rapid stabilization. The Regulatory Executive Order mandates that every licensure agency document AI sources and validation steps. Furthermore, the Regulatory Executive Order compels public disclosure of any machine-generated testing material. Compliance deadlines align with upcoming July exam preparations. In contrast, earlier guidance from 2023 had stressed voluntary best practices only.
Newsom's office framed the action as reinforcing civil rights and professional integrity. Agencies must submit quarterly progress memos to the Department of Finance. Therefore, procurement officers must update contract templates to reference AI usage clauses explicitly. The order sets strict timelines and transparent checkpoints. Subsequently, attention shifted toward ongoing litigation and board governance.
Governance And Legal Fallout
Oversight intensified once the Supreme Court approved emergency scoring imputation. Leah Wilson, the Bar's executive director, pledged a comprehensive review panel. Nevertheless, faculty critics decried having the psychometrician both write and validate questions.
Public records show ACS Ventures held up to $502k in work orders. Moreover, contracts did not expressly permit generative systems in item creation. That gap sparked potential breach claims and calls for tighter procurement language. Gavin Newsom requested the Department of Justice examine possible vendor conflicts. Meanwhile, applicants filed class actions over platform outages and opaque score changes.
Legal challenges underscore the stakes for thousands of aspiring lawyers. Consequently, remedies demanded swift coordination between courts and the executive branch. The judiciary soon issued its own directives, sharpening enforcement.
Supreme Court Orders Remedies
On May 2, the Supreme Court lowered the passing score to 534. Additionally, missing performance tests could be imputed using statistical models. The Court insisted the July exam return to the traditional Multistate format.
Justices referenced the Regulatory Executive Order when stressing agency accountability. They warned that future deviations must be reported within 48 hours. In contrast, prior deviations had gone unmentioned until media stepped in. Civil rights groups applauded the rapid, transparent action.
These rulings created immediate certainty for February candidates. Nevertheless, financial and policy implications remained unresolved, steering focus to contracts. Procurement scrutiny therefore intensified across agencies.
Procurement Contracts Under Review
State auditors began reviewing the $8.25 million Kaplan agreement. Moreover, investigators analysed confidentiality clauses for undisclosed AI usage. They found no reference to the Regulatory Executive Order because the deal pre-dated it.
Equally, ACS Ventures contracts lacked explicit AI carve-outs. Consequently, procurement officers drafted interim amendments referencing algorithmic risk assessments. Gavin Newsom signalled support, stating that tax dollars require verifiable value.
- Declare AI tooling in project scopes.
- Document human review protocols.
- Publish bias testing summaries.
- Embed termination clauses for non-compliance.
These measures aim to restore fiscal accountability. Subsequently, debate shifted toward broader equity concerns within testing. Bias and discrimination questions came to the forefront next.
Civil Rights And Bias
Civil rights attorneys argued that flawed items can disadvantage underrepresented test-takers. Furthermore, data drift in generative models may embed historic inequities. Experts recommended differential item functioning analyses before deployment.
The Regulatory Executive Order therefore mandates independent bias audits every cycle. Safeguards such as diverse review panels and transparent rubrics are compulsory. Consequently, the Bar partnered with external psychometricians unaffiliated with ACS Ventures.
Gavin Newsom also instructed that audit results be published in accessible formats. Meanwhile, applicants welcomed clearer disclosure, citing past uncertainty.
Robust audits promise fairer assessments moving forward. Nevertheless, enforcing these safeguards will demand sustained oversight and funding. Future policy frameworks aim to lock those protections into statute.
Safeguards And Future Policy
Policy drafters are already revising the State Bar Act. Moreover, legislators plan to codify the Regulatory Executive Order within statutory text. The move would transform temporary directives into durable compliance obligations.
Stakeholders recommend layered safeguards across development, validation, and deployment stages. Professionals may upskill via the AI+ Human Resources™ certification. Consequently, HR leaders can monitor bias across recruitment assessments too.
The Regulatory Executive Order will appear ten times in annual compliance reports. Meanwhile, agencies baseline metrics will be audited quarterly by independent statisticians.
These safeguards create layered defense against algorithmic errors. Consequently, California positions itself as a leader in responsible AI governance. A concise summary follows.
California's bar exam controversy illustrates the risks of unchecked innovation. However, decisive action by Gavin Newsom, the judiciary, and watchdogs shows reform is possible. The Regulatory Executive Order now anchors accountability across testing agencies. Procurement reforms, civil rights audits, and technical protections will shape upcoming exam cycles. Nevertheless, continuous oversight remains vital as generative models evolve rapidly. Readers seeking practical governance skills should pursue specialized credentials and stay engaged. Explore the linked certification to deepen compliance expertise today.