[BidClub_]

PERSON DIRECTORY

傅天予

傅天予 appears in 1 indexed conversation across 晚点聊 LateTalk. This directory brings every appearance, source, TL;DR, digest, and transcript into one searchable feed.

1 EPISODE1 SHOW
1 episode
Language
晚点聊 LateTalkZH · 88 min

103: 用Attention串起大模型优化史,详解DeepSeek、Kimi最新注意力机制改进

程曼祺肖朝军傅天予

NSA与MOBA把块状稀疏、局部窗口和动态选块推进到预训练,并尝试将理论节省落实为GPU上的真实加速,稀疏模型有望在效率提升同时保持能力。长COT把优化重点推向RL、decoding与服务成本,但稀疏Attention仍需解决显存和长期记忆问题,多模态输入还会进一步放大长序列压力。