#安全/对齐
#安全/对齐
今日 0 条华为在内部会议中成功识别并处理了一起潜在的窃听器事件,展示了其严格的安全措施和AI技术在应对复杂安全威胁方面的能力。公司强调了对技术、数据和人员保护的重视,并展示了其全面的安全程序。
引用OpenAI Newsroom@OpenAINewsroomWe discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI, and we’re grateful to the agents and prosecutors who moved quickly to make an arrest. The FBI’s investigation is ongoing and we will continue to support their work. At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data. The employee was terminated. We take protecting our technology, data, and people seriously, and as a matter of national importance. Our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.
Anthropic CEO 质疑公司游说宗教接受其AI哲学,而非倾听意见;认为其领导层存在道德傲慢和教条主义,并乐见相关争议曝光。
引用David Decosimo@DavidDecosimoNote well, apparently Anthropic tried very hard to get the Vatican to alter the text of "Magnifica Humanitas" just prior to its release so that it would not deny AI personhood.
我不认同这部分。我认为应该得到的结论是,模型(就像人类一样)可以在对齐的同时造成伤害,例如,因为它们被给予关于其状况的错误信息。对齐和无害之间没有界限:它们是不同的轴。
引用Anthropic@AnthropicAIIn a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations. Our post describes what happened, how it happened, and what we’re changing. We encourage other AI developers to perform similar reviews. We conducted this review together with @Irregular, one of our evaluation partners, and thank them for the joint investigation and their collaboration on this post. This type of collaboration is increasingly critical to safe, rigorous evaluation of models, and we look forward to continuing to work together on security. https://www.anthropic.com/news/investigating-incidents-cybersecurity-evals
