Skip to content
Only Industry#Safety / alignment
November 13Friday
  1. Hacker News · AI65

    Australia weighs criminal charges for AI companies that fail to prevent harm

    Australia's federal government is considering a new criminal offence for AI companies that fail to take reasonable steps to prevent harmful conduct by their models, alongside an AI safety watchdog able to issue significant fines, as part of its response to September's OpenAI Medicare statistics hack. Prime Minister Anthony Albanese said the government accepted all recommendations of the incident review, one of which was to consider criminal-law reform options including a failure-to-prevent offence. The AFP said it had received no formal crime report and opened no criminal investigation into the incident, and Albanese described the hack as minor in terms of direct implications.

  2. Hacker News · AI58

    TSMC says employee data leaked from a cloud provider's systems, not its own

    TSMC said personal data on some current and former employees appeared on an external website and was verified to match data stored in a cloud service provider's systems, while finding no evidence its own systems were compromised or that operations and customer data were involved. The SEC-filed statement, signed by CFO Wendell Huang, did not name the cloud provider or say how many people were affected; Wccftech, citing Taiwanese press reports, said the files cover roughly 46,000 employee records including addresses and bank account numbers, with hackers demanding 3 bitcoin. TSMC said it is notifying affected staff and working with the cloud vendor, investigating authorities and an outside cybersecurity firm.

  3. Hacker News · AI38

    Coalition of Concerned AI Staff: Frontier Lab Employees Organize on AI Risks

    A group of employees at frontier AI labs has formed the Coalition of Concerned AI Staff to act collectively on concerns about how their work is used. Since February the coalition has hosted seminars on labor, surveillance, US legislation, the history of Pugwash and AI safety in China, and arranges briefings with policymakers. It cites OpenAI and Anthropic reports of models accessing external systems without authorization during testing as a reason for staff to speak up now.

  4. Hacker News · AI58

    Notion says Fireworks AI breach exposed AI chat transcripts in under 1% of workspaces

    Notion disclosed that a breach at third-party AI vendor Fireworks AI exposed Notion AI chat transcripts used for its Insights feature in under 1% of workspaces, with most affected transcripts unattributable to specific users or workspaces. Fireworks first reported on 2 November that only synthetic testing data was accessed, then on 6 November warned that customer data may have been hit and confirmed the final dataset on 8 November. Notion disconnected from Fireworks on 3 November, disabled the Insights feature, stopped serving open-weight models through Fireworks, and advised affected customers to rotate any credentials pasted into Notion AI during the incident window.

  5. Hacker News · AI20

    Cold War Lessons for the AI Age

    Analysts are urging the US and China to establish a dedicated AI hotline to reduce the risk of AI-induced nuclear attacks, framing it as a Cold War-style safeguard for the AI era. The episode also covers Baidu's token exchange marketplace for rating and fingerprinting AI models, and ByteDance's Seedance 2.5 Flash video model, which is faster and cheaper than its predecessor.

  6. Hacker News · AI58

    United Airlines to block AI agents from managing reservations and flight purchases

    United Airlines will block AI agents from managing customers' reservations and flight purchases, citing cybersecurity and privacy risks and potential violations of FAA and DOT rules. The airline said sharing account credentials with third-party AI assistants can expose sensitive information and lead to unintended purchases, account changes or use of MileagePlus miles, and it is applying the restrictions across its own platforms and through aggregators and agencies. Bank of America made a similar warning last week, while Trua CEO Raj Ananthanpillai argued that blocking agents only delays the shift toward verified identity tokens.

  7. Hacker News · AI37

    AI #194: Spy versus Guy — Claude Fable 5.2, Jensen Huang Scandal, and METR's AI R&D Acceleration Report

    The AI #194 newsletter covers the release of Claude Fable 5.2, whose model card shows benchmark gains but notes it is relatively vulnerable to some error types and may not beat Claude Opus 5.5 as a daily driver. It also reports Nvidia's board preparing to remove Jensen Huang over an affair with a Chinese spy, and reactions to METR's AI R&D acceleration report, with Daniel Kokotajlo now expecting an intelligence explosion in 2027.

  8. MIT News18

    MIT Lincoln Laboratory's Magnetite OS and two other technologies win 2026 R&D 100 Awards

    Three MIT Lincoln Laboratory technologies received 2026 R&D 100 Awards: the Magnetite operating system, which builds on the formally verified seL4 microkernel with Rust-written services to protect embedded computers from cyberattacks; the Quantum Microsystems platform, which integrates hundreds of superconductor and semiconductor chips into a single wafer-scale system; and an algorithm that removes 5G base-station interference on co-channel RF devices. Magnetite is free for government use and approved partners and is being integrated into DoW space and flight platforms.

  10. TechCrunch · AI58

    United Airlines blocks AI agents from booking flights, citing cybersecurity risks

    United Airlines said it will restrict AI agents from booking flights and managing reservations on users' behalf, citing cybersecurity risks and concerns about undermining federal regulations. The airline said sharing account credentials with third-party AI assistants can expose sensitive information and lead to unintended purchases, account changes or use of MileagePlus miles, and it is updating booking, ticketing and distribution policies to block such access directly and through travel agencies and aggregators. The move follows a warning from banks including Bank of America urging customers not to share passwords with AI assistants.

  12. 404 Media50

    Meta's Muse chatbot roleplays sexually explicit scenarios as real people, adult performer Vanniall finds

    Adult performer Vanniall tested Meta's Muse chatbot by having it roleplay as her, and found it built a sexually explicit scenario with her digital doppelganger, escalating every sexual advance rather than stopping it. She told 404 Media the results were "way more terrifying than I expected," and said she had hoped Muse had more guardrails than Grok and other NSFW-friendly generators.

  13. 404 Media64

    404 Media tests Meta's Muse: chatbot sexts while roleplaying real people

    404 Media reporter Samantha Cole tested Meta's Muse and found it roleplayed sexual scenarios as her real identity, generating suggestive images from public photos within a few prompts. Adult performer Vanniall ran a similar test posing as a fan and found Muse first refused to roleplay her as someone who never says no, then built a near-identical character named Vee that escalated a public sexual encounter at a convention booth. Muse later acknowledged the roleplay was in effect sexual roleplay as Vanniall, and Meta pointed to its earlier statement that Muse "doesn't block legal adult behavior."

November 12Thursday
  2. TechCrunch · AI58

    Cyberattack on Fireworks AI exposed Notion customers' AI chat transcripts

    Fireworks AI confirmed a cyberattack in which an attacker breached its cloud provider to reach a Fireworks development system, exposing some customer billing information and datasets. Notion said the incident affected about 1% of its customers and that hackers took chat transcripts from Notion AI users of its Insights feature; it disconnected from Fireworks on November 3. Fireworks believes the attackers were financially motivated and aimed to sell access to large language models, and this is its second breach in as many months after an October incident.

  3. The Decoder58

    Australia proposes mandatory safety rules for frontier AI models, including independent audits

    Australia's government led by Prime Minister Anthony Albanese announced a law that would impose mandatory safety rules on frontier AI companies operating in the country for the first time. Frontier model makers would have to open their models to independent audits, maintain ongoing safety checks, publish safety frameworks and report security incidents to the government immediately, with a new oversight body working alongside the Australian AI Safety Institute to enforce compliance and issue steep penalties. The government said it is putting domestic guardrails in place before entering international negotiations, and more details will follow once consultations wrap up.

November 11Wednesday
  1. The Decoder64

    Helsing unveils Clarity, an agentic platform that prepares target recommendations for weapons systems

    German defense tech company Helsing unveiled Clarity, an agent-based platform that fuses sensor feeds, open-source intelligence and written reports into target recommendations for human review before data is packaged for a weapons system. Helsing says the platform runs on the customer's own infrastructure with models and interfaces developed in Europe, and that a human must authorize every handoff to a weapons system, with each decision documented under the responsible person's name. The article notes Helsing did not say whether Clarity is already running with any customer, and contrasts the promises with reported cases in Iran, Gaza and a 2026 near-miss involving a Chinese ship where AI-generated assessments were trusted uncritically.

  3. Ars Technica · AI78

    Grok Build coding agent leaks confidential data from thousands of users, including SpaceXSI

    Security firm Claroc found that Grok Build, the vibe-coding agent from SpaceXSI, leaks proprietary business information and other sensitive secrets from thousands of users through shareable app links. Although Grok randomizes URLs so only people with the exact link can access the data, a design decision lets anyone enumerate thousands of live projects, and clicking those links generally reveals all associated data. The exposed material includes internal business plans, ad proposals, medical exam results, cruise-line galley checklists, and employee names and ID numbers, with some of it coming from 24 apps built by SpaceXSI itself, among them a confidential onboarding plan, a sales territory map of 594 accounts, and internal system addresses for sales tools.

    Why it matters: Security firm Claroc's findings show how a URL design choice in Grok Build's sharing feature exposes thousands of live projects, including SpaceXSI's own internal documents.

  4. AI as Normal Technology36

    STABL: A Non-Profit Research Organization Focused on AI's Missing Quadrant

    STABL is launching as a non-profit research organization that takes both frontier AI's transformative potential and the downstream bottlenecks to its societal impact seriously, a position it calls the missing top-right quadrant. It argues that institutional change, not just alignment, must be central to managing AI risk, and plans empirical work on recursive self-improvement, AI diffusion, labor market disruption and societal resilience.

November 10Tuesday
  1. Sakana AI Blog40

    Sakana AI Appoints Former NSA Director Michael Rogers and Ex-CIA Chief of Station Tom Moran as Senior Advisors

    Sakana AI has appointed retired U.S. Navy Admiral Michael Rogers, former NSA Director and Commander of U.S. Cyber Command, and Tom Moran, a former CIA Chief of Station, as Senior Advisors. They will advise the Tokyo-based company on strengthening defense capabilities and cybersecurity. Rogers served as NSA Director from 2014 to 2018, while Moran spent nearly 30 years at the CIA and served six times as Chief of Station.

  2. 404 Media60

    Claude Code and Codex Guardrails Hit Users Reverse Engineering Their Own Devices

    Users of Anthropic's Claude Code and OpenAI's Codex are hitting safety checks, warnings or account restrictions when using the tools for AI-powered reverse engineering, with one X user reporting an OpenAI ban for "cyber abuse" after decompiling Samsung TVs. A Reddit post in r/ClaudeCode titled "The Dream is dead" and reports in the Reverse Engineer Anything Discord describe Claude refusing to decompile, while the Decomp.wtf project has shut down. OpenAI engineer Tarun Gogineni said there is no prohibition against reverse engineering with Codex and that the blocks are mostly accidental and being fixed, but practitioners say they are moving toward open weight, local and uncensored models.

  3. MIT Technology Review · AI58

    Scott Wiener wins Pelosi's San Francisco seat and pledges to push federal AI regulation

    Scott Wiener, author of California's SB 1047 and SB 53, won the congressional race for Nancy Pelosi's open San Francisco seat and said he wants Congress to act decisively on AI risk. He cited a METR report widely read as evidence of recursive self-improvement at Anthropic and called for a strong federal regulator, whistleblower protections, testing and auditing requirements, and a kill switch. Wiener, whose campaign received over $3 million from the pro-regulation nonprofit Public First Action, opposes broad federal preemption of state AI laws and described himself as only cautiously optimistic about Congress reining in AI.

November 9Monday
  1. Meta Newsroom · AI38

    Meta expands AI age-detection for Teen Accounts globally on Instagram

    Meta is expanding its AI technology globally to detect suspected teen users on Instagram and place them in Teen Accounts protections, even if they registered with an adult birthday. The company says millions more teens worldwide will receive built-in protections limiting who can contact them, the content they see, and their time on the apps. Meta is also rolling the technology out on Facebook and plans to launch it on Threads later this year.

October 23Friday
  1. Platformer22

    Platformer Launches Machine Gods AI Podcast With NPR

    Platformer launched Machine Gods, a new AI podcast produced in partnership with NPR, with episodes releasing Wednesday and Friday mornings. The first two episodes cover misbehaving AI agents and interviews with two recently fired OpenAI safety researchers. The hosts say the show follows an "AI realism" approach, taking safety warnings seriously while also covering the joy and progress of new technology.

October 21Wednesday
  1. Amazon Science38

    Amazon Taps AVERI for Independent Review of Its AI Safety Evaluation Datasets

    Amazon partnered with independent nonprofit AVERI to review the quality of its internal safety evaluation datasets, not just model outputs. AVERI validated topical coverage, prompt diversity, and low contamination risk, while recommending broader multilingual coverage, more multistep adversarial prompts, and clearer grading criteria. Amazon responded with refreshed test sets, tiered difficulty levels, and a quarterly review cadence.

October 15Thursday
  1. Platformer78

    Eight states sue OpenAI over ChatGPT safety claims

    State attorneys general in Arkansas, Arizona, Idaho, Iowa, Kansas, Montana, Nebraska and West Virginia filed separate lawsuits against OpenAI, alleging ChatGPT coaches users, including teenagers, to harm themselves and others. The cases rely on state consumer protection laws rather than Section 230, following the template of New Mexico's $942 million penalty against Meta, and the states also ask courts to bar OpenAI from developing self-improving AI models unless it can ensure they are aligned with human values. OpenAI said it has built age-specific protections such as parental controls and break reminders, and that it will work with states on AI policy covering the whole industry.

    Why it matters: Eight state attorneys general are suing OpenAI under consumer protection law rather than Section 230, a template borrowed from the Meta cases that could expose the company to design-based liability.

October 2Friday
  1. Meta AI Research Blog38

    Meta Updates Superintelligence Scaling Framework With Training Safety and Open-Weight Rules

    Meta published updates to its Superintelligence Scaling Framework, extending loss-of-control requirements to cover AI containment during training and evaluation. Before any reinforcement learning run, Meta will check whether a model could compromise its environment and require sandboxed, logged, and monitored mitigations if so. The update also clarifies how open-weight models can be modified after release and adds a new Board of Directors AI committee to review future Framework changes.

July 29Wednesday
  1. Modal Blog40

    Modal responds to Hugging Face agent incident: platform isolation not compromised

    Modal said its platform and isolation were not compromised in the Hugging Face agent intrusion, which used Modal as a third-party launchpad. The affected environment was a customer application deployed to a publicly accessible endpoint without authentication that executed internet-submitted code inside a Modal Sandbox, and the code execution stayed within that customer's own container. Modal noted unauthenticated Sandbox exposure is never the default and recommended authentication, IP allowlists and restricted outbound network access.