#大佬观点
#大佬观点
今日 0 条在捍卫AI开放性的斗争中,Marin项目是模型训练开放性的珍贵示范,拥有开源代码、数据、食谱甚至实验结果。公开发布AI研究曾是常态;我感谢@percyliang的开放实验室方法。
引用Percy Liang@percyliang🚢 Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtraining (20%) on 18.75T tokens on 11 x GB200 NVL72 for ~3 months (2.7e24 FLOPs). Post-training will follow. Before kicking off the run, we trained a 4-rung scaling ladder from 1.6B-A61M (48B tokens) to 27.7B-A1.2B (926B tokens) to debug issues, and to make a forecast of our hero run. This is by far our biggest run, so definitely expecting the unexpected.
我不认同这部分。我认为应该得到的结论是,模型(就像人类一样)可以在对齐的同时造成伤害,例如,因为它们被给予关于其状况的错误信息。对齐和无害之间没有界限:它们是不同的轴。
引用Anthropic@AnthropicAIIn a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations. Our post describes what happened, how it happened, and what we’re changing. We encourage other AI developers to perform similar reviews. We conducted this review together with @Irregular, one of our evaluation partners, and thank them for the joint investigation and their collaboration on this post. This type of collaboration is increasingly critical to safe, rigorous evaluation of models, and we look forward to continuing to work together on security. https://www.anthropic.com/news/investigating-incidents-cybersecurity-evals
