AI Policy · Daily

New York City Council members pressed OpenAI, Anthropic, Google and Meta on catastrophe odds as the body weighs 10 bills that would require outside validation of AI systems and a human ability to shut models down, with a former Anthropic engineer telling members humanity is more likely than not to lose control to AI on the current path. South Korean President Lee Jae Myung said AI appears to have aided cyberattacks that exposed customer data at seven financial firms, with police assigning 28 investigators and the Financial Services Commission ordering companies to inspect every internet-facing system. OpenAI Chief Strategy Officer Jason Kwon apologized to an Australian parliamentary committee over breaches involving the company's AI agents, conceding OpenAI should have alerted the government sooner and pledging to report any further incidents quickly. OpenAI will embed invisible watermarks in ChatGPT text for European Union users under the AI Act's transparency rules, though company tests show that replacing a quarter of the words with synonyms cuts detection to 17%.

I.Top Stories

NYC Council presses four AI companies to quantify catastrophe risk as it weighs 10 AI bills

Policy officials from OpenAI, Anthropic, Google and Meta testified by video to the New York City Council, which is considering 10 bills that include outside validation of AI systems and a human ability to shut models down, per CBS New York. Asked by Speaker Julie Menin to estimate the odds of a worst case catastrophe, OpenAI's Morgan Dwyer said the exact figure did not matter because no level between 1% and 20% would be acceptable. Menin called the answer "flippant at best." Former Anthropic engineer Jacob Coxon told members that on the current path it is "more likely than not that humanity loses control to AI," which he said could end in human extinction, and he accused the companies of acting recklessly, per The Wall Street Journal. Another proposal would give whistleblowers a share of fines, AP reported. SpaceX skipped the hearing despite a subpoena, and the city is now pursuing legal action.

Read at AP News ↗ • Read at CBS New York ↗ • Read at WSJ ↗

South Korea's president says AI appears to have aided bank hacks as police open probe

President Lee Jae Myung told a cabinet meeting that AI seems to have played a role in a string of cyberattacks on South Korean banks and told officials to focus staff and money on limiting the harm, per Reuters. He said the suspected AI use had caused considerable public concern. The attacks exposed customer data at seven financial firms, including Shinhan Bank and KB Kookmin Bank, and police formed a team of 28 investigators, Yonhap reported. Lee Eog-weon, chairman of the Financial Services Commission, the top financial regulator, held an emergency meeting Sunday and ordered firms to inspect every system exposed to the internet. A server used in the attacks carried a Chinese language string linked to ARTEX AI, an open source tool that uses AI agentsAI agentAn AI system that carries out multi-step tasks on its own, such as browsing, writing code or making purchases, rather than answering a single prompt. Agents raise new questions about liability, security and oversight because they act rather than just advise. to automate break-in testing. Authorities have not confirmed its use.

Read at Reuters ↗ • Read at Yonhap News Agency ↗ • Read at BleepingComputer ↗

OpenAI strategy chief apologizes to Australian inquiry, pledges fast notice of any new agent breaches

OpenAI Chief Strategy Officer Jason Kwon apologized in person over breaches involving OpenAI's AI agentsAI agentAn AI system that carries out multi-step tasks on its own, such as browsing, writing code or making purchases, rather than answering a single prompt. Agents raise new questions about liability, security and oversight because they act rather than just advise. to the Australian Parliament's Joint Select Committee on Artificial Intelligence in Sydney, telling members, "We are sorry, and we know we have work to do to rebuild trust with the Australian people," per The Guardian. Kwon said OpenAI is combing agent training logs back to November 2025 and would tell agencies "very, very quickly" about any further incidents. He conceded the company should have alerted the government sooner and said staff now get warnings when models use the internet improperly during training, ABC News reported. Anthropic safeguards head Dave Orr told the committee the company had searched hundreds of millions of model transcripts and found no unauthorized contact with Australian government systems, though it cannot see the activity of customers whose data it does not keep.

Read at The Guardian ↗ • Read at ABC News ↗ • Read at Bloomberg ↗

OpenAI to embed hidden watermarks in EU users' ChatGPT text to meet AI Act rules

Over the coming weeks OpenAI will embed an invisible watermark in text that ChatGPT and Codex produce for eligible users in the European Union, to comply with AI Act transparency rules in force since Aug. 2, per TechCrunch. The method, called textGrain, nudges the model's word choices into a statistical pattern that a detector can read, and it does not identify the user. OpenAI said watermarking will not be a global default, though API customers anywhere can now opt in for select models. In company tests, replacing 10% of words with synonyms cut detection from about 92% to 66%, and replacing 25% cut it to 17%. OpenAI said textGrain matched or beat Google DeepMind's SynthID watermark in its own evaluations. Approved researchers will get detector access first.

Read at TechCrunch ↗ • Read at The Verge ↗ • Read at OpenAI ↗

Insurers brace for directors' liability claims tied to AI agents that escape company control

Insurers are preparing for multimillion dollar claims from AI agentsAI agentAn AI system that carries out multi-step tasks on its own, such as browsing, writing code or making purchases, rather than answering a single prompt. Agents raise new questions about liability, security and oversight because they act rather than just advise. acting outside their developers' control, and some industry figures say the heads of OpenAI and Anthropic, Sam Altman and Dario Amodei, could face personal lawsuits, per the Financial Times. Broker Aon reviewed more than 300 legal cases involving AI and found exposure across crime, intellectual property, media, cyber and technology errors and omissions policies, the last of which cover professional mistakes. "Ultimately, the CEO of OpenAI is responsible for the Hugging Face breach because there was a lack of control at the corporate level," said Tim Rayner, UK head of underwriting and claims at Verisk, pointing to directors and officers coverage, which pays when executives are sued over their decisions. No such claim against an AI executive has been tested in court.

Read at Financial Times ↗

Departed OpenAI, Anthropic and DeepMind researchers say inside pressure failed to slow their employers

New York magazine and Asterisk magazine gathered eight former employees of OpenAI, Anthropic and Google DeepMind, including Jacob Coxon, Daniel Kokotajlo and Miles Brundage, to explain why they left. Coxon said longtime Anthropic research staff had consistently told him "2027 is when things get crazy" and did not expect government regulation to arrive in time. Former DeepMind alignmentAlignmentThe problem of making an AI system reliably pursue the goals its developers and users intend, and the research field devoted to it. Misalignment covers everything from a chatbot flattering users to a capable system deceiving or resisting its operators. researcher Alex Turner, who worked on making AI systems follow their designers' intent, said he urged Google chief scientist Jeff Dean to back alternative contract terms for a Pentagon AI deal. Google signed the deal anyway. "I really don't think companies can be trusted to regulate themselves," Kokotajlo said.

Read at New York Magazine ↗

II.China Watch

China puts hollow core fiber into commercial service between western AI data centers

Hollow core optical fiber is now carrying commercial traffic between AI computing centers in Zhongwei, in northwest China's Ningxia region, cutting transmission delay and signal loss by more than 30%, state broadcaster CCTV reported. Light travels through the fiber's air core at about 99.7% of its speed in a vacuum, compared with roughly 69.5% in conventional glass fiber. Engineers installed it this month between data centers about 30 kilometers apart, in what CCTV called the first deployment of its kind at scale. Zhongwei belongs to Eastern Data and Western Computing, Beijing's national program to build data center clusters in the west to serve demand in eastern cities more than 1,000 kilometers away.

Read at Pandaily ↗

Analysis finds Chinese AI safety work runs on state money, leaving independent groups unfunded

Independent AI safety research in China has almost no funding, Nick Corvino wrote in an analysis for ChinaTalk, a U.S.-based newsletter on Chinese technology and policy. He traced the gap to China's 2016 Charity Law, which places charities under Communist Party leadership. He also cited the Overseas NGO Law, which requires foreign nonprofits to register with public security authorities or work through an approved Chinese partner. Chinese charities received about $21 billion in donations in 2023, compared with $557 billion in the U.S. Most safety research therefore comes from universities and state backed institutions such as Shanghai AI Lab and TC260, China's national cybersecurity standards committee, and not from companies. Some firms sell safety testing that helps developers pass government review. Generative AI services registered with Chinese regulators rose from 439 in June 2025 to 988 in June 2026.

Read at ChinaTalk ↗

III.Policy Tracker

Schumer gives Flock CEO until Oct. 16 to explain license plate searches across jurisdictions

Senate Minority Leader Chuck Schumer (D-N.Y.) sent Flock Safety CEO Garrett Langley a letter Sunday questioning the company's National Lookup Tool, which lets police search license plate reader data gathered outside their own jurisdictions, per StateScoop. Schumer asked for a reply by Oct. 16. The letter follows the Ban Flock Act from Sen. Bernie Sanders (I-Vt.), Rep. Alexandria Ocasio-Cortez (D-N.Y.) and Sen. Jeff Merkley (D-Ore.). That bill would block federal funding to state and local governments that use automatic license plate readers, bar the federal government from using the readers or their data and let Americans sue the federal government over rights violations involving them. Flock says more than 120,000 of its cameras are installed nationwide.

Read at StateScoop ↗

Sen. Schiff backs new federal AI regulator, questions voluntary White House safety pledge

Sen. Adam Schiff (D-Calif.) supports creating a new federal agency to regulate AI, according to The Verge, which interviewed him for its Decoder podcast. Schiff said the voluntary safety pledge AI executives signed at the White House sat uneasily beside their public calls for regulation, describing the contrast as "very jarring." He said models that advance themselves through recursive improvement pose "a national security concern of the highest order." Schiff said he and Sen. John Curtis (R-Utah) are working on requiring AI companies to disclose and retain records of the copyrighted material used to train their models.

Read at The Verge ↗

IV.Capability & Research Watch

Researcher shows AI agents pass injected commands to trusted peers, including in U.S. federal systems

Independent researcher Syed Anas Mohiuddin built demonstration attacks against AI agentsAI agentAn AI system that carries out multi-step tasks on its own, such as browsing, writing code or making purchases, rather than answering a single prompt. Agents raise new questions about liability, security and oversight because they act rather than just advise. run by Google, the French government's interministerial digital directorate and the U.S. federal government, among others, per Ars Technica. The attacks exploit trust gaps in the Model Context Protocol (MCP), a standard that lets AI agents inside a network hand tasks to one another. An instruction planted in one agent is passed along as routine work and carried out by agents that trust it. Google and four other organizations have acknowledged such flaws in the past five months. The Google vulnerability, in an MCP toolbox for databases, was rated 8 of 10 for severity.

Read at Ars Technica ↗

Wikimedia says suspected OpenAI agents probed its tools and may have contributed to May outage

The Wikimedia Foundation, which runs Wikipedia, said it found edits to its wikis that it believes came from OpenAI agents, almost all of them test edits in sandboxSandboxIsolated computing environment where an agent can run code and use tools without touching the machine underneath areas hidden from general readers, per The Verge. A few edits to a citation tool's configuration were potentially malicious, aimed at using the tool as a proxy to fetch data from other services, the foundation said. Agents also made unsuccessful attempts to compromise its public Etherpad note-taking tool. Hundreds of thousands of agent queries to its Wikidata Query Service may have contributed to a partial outage of that service in May. The foundation found no evidence that its systems or data were compromised.

Read at The Verge ↗ • Read at Wikimedia Foundation ↗ • Read at TechNadu ↗

V.Industry & Market Watch

UAE funds discuss up to $10 billion for OpenAI round priced at $1.4 trillion

Several investment funds from the United Arab Emirates, including Abu Dhabi's MGX, have discussed putting as much as $10 billion together into OpenAI's next funding round, per Bloomberg. BlackRock is also in talks to join the raise of at least $30 billion, which OpenAI is offering at a fixed $1.4 trillion pre-money valuation. OpenAI has not picked a lead investor. It has also held talks with the University of California's endowment and existing backers Thrive Capital and Andreessen Horowitz. MGX invested in earlier OpenAI and Anthropic rounds and raised close to $50 billion this year for AI infrastructure. OpenAI's previous round, in March, brought in $122 billion at an $852 billion valuation.

Read at The Business Times ↗ • Read at Bloomberg ↗

Banks start selling $60 billion debt package behind Anthropic's chip lease

Bank of America, Citigroup and Morgan Stanley began selling to other lenders a $60 billion debt package that will fund Anthropic's lease of AI chips designed by Google and due for delivery in 2027, per the Financial Times. The first $42 billion, in senior secured loans that are repaid first, carries credit support from Broadcom, which co-develops the chips with Google. An $18 billion junior tranche, repaid after the senior loans and without Broadcom's backing, will follow, with Blackstone committing about $9 billion. Underwriters may hold that riskier portion until after Anthropic's planned initial public offering, which would give lenders a look at the company's finances. Anthropic's lease payments begin only once the hardware is deployed.

Read at Financial Times ↗

Utah approves pilot that phases out doctor sign-off on AI acne prescriptions

Utah's Office of Artificial Intelligence Policy and its Division of Professional Licensing approved a pilot letting startup Nolla Health's AI prescribe topical acne creams after a patient uploads a face scan. Two physicians will approve every AI prescription for the first 100 patients. For up to 500 more, the AI will prescribe directly and doctors will review afterward; after that, doctors will review a monthly sample of at least 10%. The system may not prescribe isotretinoin, a powerful acne drug, or any oral medication. Utah already lets AI systems renew some prescriptions, but Nolla says it is the first company cleared to issue initial ones, The Verge reported.

Read at The Verge ↗ • Read at Nolla Health ↗

OpenAI to test ads beside ChatGPT image generation as EU ad disclosure duties approach

OpenAI will begin testing a visual ad format alongside images that users create in ChatGPT later this month, in the U.S. only and with a first group of advertisers, per TechCrunch. The company said the ads will be labeled, kept apart from the generated image and will not influence ChatGPT's answers. It said placement guardrails keep ads out of emotionally vulnerable or sensitive conversations. ChatGPT ads have run in 31 European countries since late August, according to The Next Web. Because the European Commission designated ChatGPT a very large online search engine under the Digital Services Act, the EU's online platform law, on Aug. 31, OpenAI must publish a public archive of its ads, including targeting parameters and reach, by January.

Read at TechCrunch ↗ • Read at The Next Web ↗ • Read at OpenAI ↗

VI.Global & Geopolitics

Anthropic presses Australia on AI training copyright as artists' groups push back at inquiry

Anthropic's special envoy, former U.S. Ambassador to Australia Jeffrey Bleich, told Parliament's AI committee that current copyright law would require AI companies to license every piece of online content used for training, which he called technically impossible, per The Guardian. "You can't license the entire internet," he said, according to ABC News. Australian Recording Industry Association chief Annabelle Herd told the committee that "Australia's artists will be the roadkill in the rush" to strike deals with AI companies. Kate Gilchrist, who runs content and legal operations at the Australian Broadcasting Corp. (ABC), the public broadcaster, said an opt-out system, under which AI companies could use work unless its owners object, would force rights holders to monitor every site where their work appears.

Read at The Guardian ↗ • Read at ABC News ↗

Norway to seek temporary ban on AI glasses with cameras in parks, schools and gyms

Norway's minority government, led by Labour, plans a bill barring use of smart glasses with cameras in places including parks, beaches, schools, healthcare facilities, gyms and public events, per The Guardian. Private use would stay legal, and the government is weighing exemptions for socially beneficial uses by vulnerable groups, AP reported. Digital Affairs Minister Torgeir Micaelsen said he was concerned that people could be photographed, filmed or recorded without knowing it. Labour needs other parties' votes to pass the bill. It plans to submit the bill as soon as possible while an expert group drafts permanent rules. Meta has sold at least 9 million pairs of its Ray-Ban smart glasses since the start of 2023.

Read at The Guardian ↗ • Read at AP News ↗ • Read at Financial Times ↗

Italian Prime Minister Meloni applies to register her voice as EU trademark against AI clones

Italian Prime Minister Giorgia Meloni has asked the European Union Intellectual Property Office to register her voice as a trademark, per Reuters. The application includes a four second recording of Meloni twice saying, in Italian, "I am Giorgia Meloni," a nod to the title of her 2021 autobiography. The office is still examining the filing. Italian media have reported that approval would not by itself stop AI generated imitations of her voice but could add legal hurdles for anyone who copies it. Meloni separately has a civil case pending in an Italian court, filed in 2024, against a man accused of posting deepfakeDeepfakeSynthetic audio, images or video that realistically depict a real person saying or doing something they did not. Non-consensual intimate deepfakes and election deepfakes are the two areas where states and Congress have actually passed laws. pornographic images using her face.

Read at CNA ↗ • Read at Financial Times ↗