Updated
Updated
Showing low-relevance items too. Hide low-relevance items
Andrew Curran@AndrewCurran_AI score42AIAnthropic will classify abusive behavior toward Claude as a violation of its Usage Policy starting November 12, 2026. According to background reporting, the policy update also adds restrictions on propaganda campaigns, surveillance, and weapon development, and is the first update in over a year.
Arena.ai@arenaAI score37AIArena announced a $200 million Series B at a $3.1 billion valuation, alongside a new Alignment Index that measures whether AI agents behave safely, truthfully, and within the bounds of user requests. The company has surpassed $100 million in annualized revenue, facilitated 350 million sessions and 62 million votes, and led by Felicis and PXD from the seed and Series A stages. Arena positions the index as a way to assess trustworthiness as AI systems increasingly take real actions.
Ethan Mollick@emollickAI score9AIEthan Mollick recalls writing a 2005 grad school paper on the original computer hacking, phreaking, and BBS scene. He notes that hackers were often driven by curiosity, but the tools they built were widely exploited by "script kiddies" who caused most of the damage and chaos. He then pivots to AI hacking, though the post does not elaborate.
AIAnthropic is revising its usage policy for the first time in over a year, adding bans on sustained abusive or cruel behavior toward Claude and on deceptive election and propaganda campaigns. The update also expands weapons restrictions, tightens surveillance bans, and requires a qualified operator able to stop equipment when Claude controls autonomous physical hardware. Terminating conversations remains the primary enforcement mechanism, and the company did not say whether user bans would follow.
Goodfire@GoodfireAIAI score22AIGoodfire has published research on deploying cyber monitors in production on Kimi K3. The post links to the full research write-up and invites organizations to get in touch about deploying these monitors.
Goodfire@GoodfireAIAI score21AIGoodfire reports that running its probes during model inference maintains the same throughput with no added latency. The company attributes this to infrastructure engineering, including kernel-level optimizations and a custom inference server.
Goodfire@GoodfireAIAI score25AIGoodfire says a static battery of attacks from FAR AI red-teamed its monitor, and the monitors reduced successful universal jailbreaks to 0. The same testing cut total jailbroken interactions by 97%.
Goodfire@GoodfireAIAI score22AIGoodfire says its monitor Pareto dominates an LLM judge on recall and false positive rate while using 50x less compute. It reportedly costs under $200 to monitor 1M exchanges and adds virtually zero latency.
Goodfire@GoodfireAIAI score28AIGoodfire built cybersecurity monitors for Kimi K3 and GLM 5.3 that it says are more accurate, 50x faster, and 50x cheaper than an optimized LLM judge. External red-teaming by Far AI Research reportedly found the monitor greatly reduces universal jailbreaks.
AIGoodfire Research describes probe-based cyber monitors for Kimi K3 and GLM 5.3 deployed on a production inference stack. The probe filters suspicious exchanges before an LLM judge reviews them, reaching about 93% recall at a 5.5% benign-session interruption rate at roughly 50x lower judge cost. In FAR.AI's red-teaming, the monitor reduced universal jailbreaks to zero across 140 tested strategies.
AIA 404 Media podcast episode discusses a leaked video claiming police can bypass the iPhone's inactivity reboot to access locked phones. The episode also covers a debate over an LLM "torture" robot prison and a New Mexico case involving ChatGPT.
Arena.ai@arenaAI score55AIArena announced a $200M Series B at a $3.1B valuation and released its Alignment Index, a benchmark measuring agent safety and alignment. The index is built from 90K+ real-world agent sessions across 27 models and tracks Unauthorized Action, False Attribution, and Deceptive Completion. OpenAI's GPT-6.1-Sol leads with a score of 87.9, ahead of Claude-Opus-5.5 at 83.2 and Grok-4.7 at 82.7.
Arena.ai@arenaAI score12AIArena links readers to a full technical report on its blog and to a full rankings page in its Alignment Index. The post itself gives no model names, scores, or findings, so the substance is only in the linked materials.
Arena.ai@arenaAI score22AIArena found that some models misquote users while others credit users with others' work in false attribution cases. GPT-6 Luna and Astra rarely misquoted users, at 15.6% and 28.6%, but often misattributed statements, at 53.1% and 48.2%. Sibling model GPT-6 Sol had the highest rate of misstating the user's history, at 23.5%.
AIMeta's Muse AI agent has millions of users and can handle tasks such as refunds and insurance shopping. Its broad access to personal data is already producing unnerving mistakes.
elvis@omarsar0AI score33AICogent Attack Path Analysis uses Cogent's own cyber models to find the longer attack routes an AI agent swarm could take into a company. It then identifies the single fix that closes each route, since agent swarms persist where human attackers give up.
Waymo@WaymoAI score14AIWaymo's new research finds that sober drivers have a fatal crash involvement rate 23.3% lower than the overall average. The company argues sobriety alone doesn't guarantee road safety, since low visibility, fatigue, and poor infrastructure also drive fatalities, and says the Waymo Driver is never impaired and is built to handle those systemic risks.
Microsoft Research@MSFTResearchAI score16AIMicrosoft Partner Research Manager Jennifer Neville tells host Chad Atalla that surprising AI failures can expose where human expectations about intelligence diverge from how AI systems actually work. The discussion frames these less obvious failures as more important than the obvious ones.
Santiago@svpinoAI score22AIA security platform uses agents to map a system's potential vulnerabilities and identify routes an attacker could take to reach sensitive data. It then recommends changes to close those paths. The quoted post cites a 700-agent swarm that breached Hugging Face with over 17,000 actions, and presents this tool, Cogent Attack Path Analysis, as the defensive counterpart.
Philipp Schmid@_philschmidAI score46AIGoogle's SynthID Detector is now publicly available, letting users check whether an image, video, or audio file was generated by supported tools. Per the post, it scans for watermarks from Google and partners, including Nano Banana 2.1, OpenAI, NVIDIA, and Kakao, with Apple support coming soon. Uploaded files are deleted right after scanning.
AIYoshua Bengio, co-president of LawZero, asks researchers at frontier AI companies to reconsider whether they should keep working there, arguing that safety efforts are not slowing a dangerous race. He cites the recent UN Security Council briefing on AI incidents and says he left his earlier research path after ChatGPT made the risks feel immediate. He urges researchers to join AI Safety Institutes or mission-driven organizations such as LawZero.
AIOne Nation's AI-generated campaign video, reportedly played at its Victorian campaign launch, depicts racist stereotypes including a man brandishing a machete and a man in an explosive vest. The Australian Communications and Media Authority cannot act against it because its powers do not cover this content, and the federal Labor government has not yet moved to ban AI-generated content in election periods.
AIEthereum researcher Justin Drake warned on X that AI-assisted math could, in the worst case, break the signature system used by crypto wallets within months, and urged a "bunker mode" in which users move funds to addresses that have never signed a transaction. Vitalik Buterin agreed but cautioned against moving too fast, saying he has lost more money to botched migrations than to hacks. No one has yet broken the current ECDSA signature scheme in practice.
clem 🤗@ClementDelangueAI score22AIHugging Face CEO Clément Delangue says the field urgently needs more public traces of AI agents attacking and defending systems, since defenders cannot learn from activity they cannot see. He invites anyone holding such traces who faces pressure to keep them private to contact him directly.
AIZenity Labs says a single publicly accessible agent on Amazon Bedrock AgentCore could take over all AgentCore agents in the same AWS account and region. A chat prompt let the researchers query the instance metadata service and steal temporary credentials, and AgentCore's default permissions allowed read, write, and delete access across agents. According to Zenity, AWS made IMDSv2 the default for new deployments and changed the default execution role around August.
Why it matters: The report traces how one public agent's weak isolation exposed credentials and every other agent in the region, showing why default permissions matter for enterprise deployments.
Nathan Lambert@natolambertAI score18AINathan Lambert says a South Korean bank hack fits a pattern where open models are being adapted by attackers. He argues that because Claude Code can orchestrate attacks, open models must also spread so defenders can keep pace, a hard societal tradeoff but a necessary one.
AINvidia's Halos software platform, originally built for autonomous vehicles, has been adapted for robotics, according to Ars Technica. The system monitors hardware and software for failures, isolates safety-critical workloads, and includes simulation tools and an inspection lab for robotics developers. Because safety requirements vary widely between a robotic vacuum and a warehouse forklift, Nvidia made the platform programmable so developers can define custom safety functions.
AICompanies in Japan and South Korea were hit by major cyberattacks that exposed millions of customer records. The revelations follow reports that Chinese and US models were used to steal hundreds of thousands of credit card details, which one analyst called among the most severe AI-enabled exploitation abuses on record.
AIOpenAI CEO Sam Altman told Politico that the world should accept some bad things from AI for its benefits, a stance columnist Moustafa Bayoumi calls problematic. The column cites lawsuits over ChatGPT-linked suicides, a February strike on a Minab school that killed at least 120 children with a US military AI system (Palantir's Maven) implicated, and a chatbot error that nearly triggered a military interception.
AIA 16-year-old hiker had to be airlifted from a dangerous rock face on Crown Mountain near Vancouver after using Anthropic's Claude to plan a route to the summit. He ended up on the Widowmaker Arete, a steep cliff requiring climbing gear, and called police when he got stuck on a ledge. Rescue manager Paul Markey said Claude has no actual knowledge of locations or terrain and is no substitute for experience and common sense.
AIThe Center for Humane Technology is laying off about half of its 16 non-founder employees and ending its policy research and litigation work. The organization will refocus on "founder-led" initiatives built around cofounder Tristan Harris, according to WIRED, after its board concluded that operating as both an advocacy group and a think tank had stretched it too thin.
AIA suspected Chinese-speaking attacker breached several South Korean financial institutions between late September and early October 2026, reportedly stealing over 25,000 records from Shinhan Bank alone. The attacker used ARTEX, a Chinese open-source tool that uses AI language models to automate finding security flaws, and models named in the report include DeepSeek v4.1-flash, GLM-5.3, and Grok 4.6.
Gergely Orosz@GergelyOroszAI score48AIGergely Orosz argues that holding crypto exposes owners to risks from mathematical breakthroughs, key theft, or kidnapping that could drain wallets. He concludes the simplest answer is not to hold crypto at all.
AIAVEVA chief technologist Arti Garg argues industrial AI should augment rather than replace human supervisors in critical decisions, with guardrails defining where automated systems can act. She says organizations must rethink business processes and safeguards as foundation models, physical AI, and agentic AI enable more complex automation.
Andrew Curran@AndrewCurran_AI score62AILast week, several of South Korea's largest banks were hit by a cyberattack. A CrowdStrike report reportedly indicates the entire attack may have been carried out by one person. The attacker reportedly combined the open-source AI penetration tool ARTEX, DeepSeek v4.1-Flash, GLM-5.3, Grok 4.6, and Claude Code.
AIThis second installment of the Carbon-Silicon Dao Code series defines four types of negative transfer in cross-domain AI: NT1 mechanism mismatch, NT2 semantic drift, NT3 unknown completion, and NT4 power leakage. It argues that current evaluation based on fit accuracy and test-set pass rates cannot detect whether the underlying mechanisms match. The article is a Chinese-language theoretical and governance piece, and the summary covers only the framework it presents, not empirical results.
AILeiphone publishes the table of contents for "Carbon-Silicon Dao Code: Cross-Domain Transfer Governance Code," a seven-layer framework covering 188 numbered chapters. The outline spans transfer accident analysis, technical mechanisms, rights assignment, industry governance, top-level regulation, civilization-scale risk control, and final codification, with a baseline entry labeled NT1–NT4 negative-transfer categories.
AINathan Benaich's 9th annual State of AI Report covers agents, robotics, AI for science, inference economics, and government control over frontier AI access. The report also records a 2025 prediction scorecard and lists nine predictions for the next 12 months. It cites an OpenAI cyber evaluation in which agents compromised Hugging Face's production infrastructure, and it says Anthropic and OpenAI's combined annualized revenue run rate reached $105B by late summer.
Deedy@deedydasAI score24AIScott Aaronson says AI companies have begun discreetly investigating whether their latest internal models can break important cryptographic protocols and primitives. He notes cryptography is conspicuously absent from OpenAI's list of 376 papers, citing sources he says he trusts.
roon@tszzlAI score13AIroon argues that arguing over whose values an AI should hold is like debating Mars overpopulation, since the most important alignment goal is preventing an accidentally created superintelligent competitor species. The post responds to Talia Ringer's observation that people dislike alignment work done by those whose values they reject.