PERSON DIRECTORY
傅天予
傅天予 appears in 1 indexed conversation across 晚点聊 LateTalk. This directory brings every appearance, source, TL;DR, digest, and transcript into one searchable feed.
1 EPISODE1 SHOW
Language
103: 用Attention串起大模型优化史,详解DeepSeek、Kimi最新注意力机制改进
NSA与MOBA把块状稀疏、局部窗口和动态选块推进到预训练,并尝试将理论节省落实为GPU上的真实加速,稀疏模型有望在效率提升同时保持能力。长COT把优化重点推向RL、decoding与服务成本,但稀疏Attention仍需解决显存和长期记忆问题,多模态输入还会进一步放大长序列压力。
