Stanford CS336 上，Tatsu 讲了一节 LLM 架构课，把过去 3 年所有主流 LLM 拆开，看它们的共通模板结论挺爆：90% 的架构选择已经收敛，你随便挑一个开源大模型，它跟其他模型在这些维度上几乎一模一样讲师的原话- 2024 年大家都在 cosplay Llama2- 2025 年的主题是「怎么训得不崩」- 2026 年的主题是「怎么扛住长上下文」下面是 2026 年开源 LLM 的标准模板 你训自己的模型可以直接抄【架构层 已经收敛的 7 件事】1）Layer Norm 挪出残差流（pre-norm）原版 Transformer 把 LN 放在残差里 几乎所有现代模型都挪到外面原因：keep your residual stream clean 梯度反传更稳2）RMS Norm 替代 LayerNormLayerNorm 的减均值 + 加 bias 那部分实际没怎么帮上忙丢掉之后 flops 只省 0.17% 但运行时省到 25%（瓶颈在数据搬运 计算反而次要）3）所有 bias 项全删跟 RMS Norm 一个道理 系统层省内存搬运4）激活函数用 SwiGLU
1:29:02
Stanford CS336 上，Tatsu 讲了一节 LLM 架构课，把过去 3 年所有主流 LLM 拆开，看它们的共通模板结论挺爆：90% 的架构选择已经收敛，你随便挑一个开源大模型，它跟其他模型在这些维度上几乎一模一样讲师的原话- 2024 年大家都在 cosplay Llama2- 2025 年的主题是「怎么训得不崩」- 2026 年的主题是「怎么扛住长上下文」下面是 2026 年开源 LLM 的标准模板 你训自己的模型可以直接抄【架构层 已经收敛的 7 件事】1）Layer Norm 挪出残差流（pre-norm）原版 Transformer 把 LN 放在残差里 几乎所有现代模型都挪到外面原因：keep your residual stream clean 梯度反传更稳2）RMS Norm 替代 LayerNormLayerNorm 的减均值 + 加 bias 那部分实际没怎么帮上忙丢掉之后 flops 只省 0.17% 但运行时省到 25%（瓶颈在数据搬运 计算反而次要）3）所有 bias 项全删跟 RMS Norm 一个道理 系统层省内存搬运4）激活函数用 SwiGLU
520.3K views1 week ago
x.comJason Zhu
Desperate Boy Trixie Cosplay Fairly Odd Parents
Desperate Boy Trixie Cosplay Fairly Odd Parents
188.3K viewsOct 11, 2022
TikTokgoodpicks167
Incredible Cosplay Journey After 6 Months
Incredible Cosplay Journey After 6 Months
35.3K views10 months ago
TikTokmalignantmachinery
Kagome Cosplay (Inuyasha)
1:51
Kagome Cosplay (Inuyasha)
512.4K viewsNov 22, 2014
YouTubeSSSniperWolf
Cosplay wings tutorial
7:59
Cosplay wings tutorial
345.2K viewsFeb 26, 2016
YouTubeUncle Silver
Princess Peach Cosplay - Part 1: Intro
7:59
Princess Peach Cosplay - Part 1: Intro
20.2K viewsJan 16, 2015
YouTubeUrsa Minor Sewing
I Made TERRIBLE Low Budget Cosplays...
10:51
I Made TERRIBLE Low Budget Cosplays...
3M viewsOct 30, 2019
YouTubeakidearest
3:48
Cosplayer Attempts Supergirl Transformation
32.1K viewsMay 26, 2019
YouTubeColleen Cosplay
35:26
Cosplay Wars | COSTUME REVIEW | Custom Ladybug Suit
193.6K viewsMay 20, 2019
YouTubeUptown Cosplay
11:15
Villain Bakudeku Outing (BNHA Cosplay!
195.1K viewsNov 16, 2019
YouTubeShady Cosplay
1:26
Cosplay Costumes | Barbie Vlogs | ‪@Barbie‬
1.4M viewsJun 24, 2016
YouTubeBarbie
1:18
COSPLAY SHOWCASE: Black Cat
37.3K viewsMar 17, 2016
YouTubeMs. Rae
3:25
BNHA Prom- Part 1 (Boku No Hero Academia cosplay)
259.5K viewsAug 5, 2018
YouTubeCaptain Cleanfreak
23:29
Kiribaku Bakes Sugar Cookies (BNHA Cosplay)
507.2K viewsFeb 29, 2020
YouTubeShady Cosplay
0:43
DISNEY PRINCESS COSPLAY RAPENZEL COSPLAY SO BEAUTIFUL
460.2K viewsJun 19, 2021
YouTubeMiss Daisy
4:09
[Cosplay] Shklance CMV - Colors [Voltron Legendary Defender]
289.2K viewsDec 10, 2018
YouTubeKitsuhime
1:34
Cosplay Showcase - Sailor Saturn (Sailor Moon)
2.2K viewsFeb 14, 2019
YouTubeLittlegeeky
3:18
5 Cosplay ideas for beginners
73K viewsMar 20, 2021
YouTubelittlekitten
9:24
5 Tips for Underage Cosplayers | Cosplay Tips
711K viewsNov 2, 2020
YouTubeAnnieChie Designs
3:05
[Power Rangers Theme Remix] Power Morphicon 4 Convention Experience
28.6M viewsAug 29, 2014
YouTubeChillyWillyTube
23:00
Dragon Con 2019 - Cosplay Music Video
1.9M viewsSep 6, 2019
YouTubeJustin Cosplay
0:15
90's Nostalgia - Sailor Moon Cosplay
81.7K viewsOct 12, 2015
YouTubedaydreamernessa
1:49
Heros Time Mystique Cosplay Review | Naoko Cosplay |
44.9K viewsAug 3, 2017
YouTubeNaoko Cosplay
2:48
Teen Titans Cosplayers at ConnectiCon 2013
477.2K viewsJul 16, 2013
YouTubeNerd Caliber
12:57
Modifying A Supergirl Cosplay In Partnership With Party City
10.5K viewsOct 14, 2020
YouTubeCosplay
5:45
Cara Nicole AZ Powergirl Cosplay at Comic-Con 2017
12.4K viewsAug 2, 2017
YouTubemediocrefilms2
18:22
BNHA -- My Hero Academia Cosplay -- DEKU AND TODOROKI BREAKUP
162.7K viewsSep 20, 2019
YouTubePresto Productions
2:00
DC Comics Raven Cosplay by freiaraven at IgroCon 2019
7K viewsNov 27, 2019
YouTubeR.E.D. Cosplay
29:30
Cosplayers React to Miraculous Ladybug - Dark Cupid 💘
350.9K viewsSep 20, 2019
YouTubeThe 86th Floor: Cosplay Revolutions
2:03
Elastigirl Cosplay Tiktok Compilation - Incredibles 2 costume
26.2K viewsJan 30, 2021
YouTubeFancy Jen Cosplay
See more