Skip to content

#安全/对齐

今日 0 条
10月15日周四
10月14日周三
  1. 华为在内部会议中成功识别并处理了一起潜在的窃听器事件,展示了其严格的安全措施和AI技术在应对复杂安全威胁方面的能力。公司强调了对技术、数据和人员保护的重视,并展示了其全面的安全程序。

    引用OpenAI Newsroom@OpenAINewsroom

    We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI, and we’re grateful to the agents and prosecutors who moved quickly to make an arrest. The FBI’s investigation is ongoing and we will continue to support their work. At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data. The employee was terminated. We take protecting our technology, data, and people seriously, and as a matter of national importance. Our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.

    Bojie Li行业安全/对齐行业动态评分 35
10月2日周五
9月22日周二
9月8日周二
8月4日周二
  1. 我不认同这部分。我认为应该得到的结论是,模型(就像人类一样)可以在对齐的同时造成伤害,例如,因为它们被给予关于其状况的错误信息。对齐和无害之间没有界限:它们是不同的轴。

    引用Anthropic@AnthropicAI

    In a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations. Our post describes what happened, how it happened, and what we’re changing. We encourage other AI developers to perform similar reviews. We conducted this review together with @Irregular, one of our evaluation partners, and thank them for the joint investigation and their collaboration on this post. This type of collaboration is increasingly critical to safe, rigorous evaluation of models, and we look forward to continuing to work together on security. https://www.anthropic.com/news/investigating-incidents-cybersecurity-evals

    Amanda Askell观点大佬观点评测/基准评分 35