跳到正文

全部动态

今日 77 条
8月25日周二
8月24日周一
  1. 在捍卫AI开放性的斗争中,Marin项目是模型训练开放性的珍贵示范,拥有开源代码、数据、食谱甚至实验结果。公开发布AI研究曾是常态;我感谢@percyliang的开放实验室方法。

    引用Percy Liang@percyliang

    🚢 Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtraining (20%) on 18.75T tokens on 11 x GB200 NVL72 for ~3 months (2.7e24 FLOPs). Post-training will follow. Before kicking off the run, we trained a 4-rung scaling ladder from 1.6B-A61M (48B tokens) to 27.7B-A1.2B (926B tokens) to debug issues, and to make a forecast of our hero run. This is by far our biggest run, so definitely expecting the unexpected.

    Andrew Ng观点大佬观点开源/仓库评分 45
8月23日周日
8月22日周六
8月21日周五