“Is it unreasonable for the government to want citizens to know in advance what information is being fed into the AI tool?”
U.S. Circuit Judge Johnnie Rawlinson asked during oral arguments Wednesday before the Ninth Circuit in San Francisco, according to Cryptopolitan.
A three-judge panel signaled skepticism toward xAI’s bid to block a California law requiring generative-AI developers to disclose summaries of their training data, suggesting the company faces a high bar to prove the mandate violates the First Amendment.
The hearing comes months after U.S. District Judge Jesus Bernal in Los Angeles denied xAI’s request for a preliminary injunction, ruling the company had not shown a likelihood of success on its constitutional claims. Rawlinson, Circuit Judge Milan Smith Jr. and Senior Circuit Judge Richard Tallman heard arguments on xAI’s appeal of that decision.
xAI, the artificial-intelligence company, contends the California AI Transparency Act compels speech by forcing it to publish details about proprietary training datasets. The law, signed by Gov. Gavin Newsom in September 2024 and effective Jan. 1, 2026, applies to developers of generative-AI systems with more than one million monthly users in the state.
James Xi, counsel for xAI, argued the disclosure requirement is not “purely factual and uncontroversial” — the standard for compelled commercial speech under Zauderer v. Office of Disciplinary Counsel — because it forces the company to reveal trade secrets and editorial judgments about data selection.
Deputy Attorney General Jason Lewis, representing California, countered that the statute asks only for a high-level summary — such as the categories and sources of data — not the underlying datasets themselves. He said the requirement serves the state’s interest in protecting consumers from deception and bias.
The institute argued that disclosure laws aimed at ensuring the free flow of accurate commercial information should receive deferential Zauderer scrutiny, and that xAI had not shown the California law imposes an undue burden.
Rawlinson and Smith both pressed Lewis on whether the law’s definition of “summary” could be stretched to demand limitless detail. “The concern is the open-ended nature of what the state might require down the road,” Smith said.
xAI was founded by Elon Musk in March 2023 as a public-benefit corporation and announced publicly that July; by December 2024 it had raised $6 billion in a round backed by BlackRock, Fidelity and Sequoia Capital, bringing total funding above $12 billion.
In March 2025 the company acquired X Corp., operator of the social network X, in an all-stock deal that valued xAI at $80 billion and X at $33 billion, combining both under X.AI Holdings Corp.
A ruling is expected in the coming months. If the Ninth Circuit affirms the district court, the disclosure obligations will remain in force while the case proceeds on the merits, potentially shaping similar legislation pending in other states.
Keep reading