① 他说过的话

13 条

所有这些建立在对数据和学习直觉之上的分析工作,造就了我们如今拥有的模型——相比 2017 年的 Transformer,它就像一艘忒修斯之船。
All of this analysis work built on intuitions about data and learning led to the model that we have now, which is like a ship of Theseus compared to the 2017 Transformer.
—— Chris Potts · [15:29]

指向原始笔记的链接

所以当人们说「哦,我们不理解」时,我说:我认为你们理解的程度远超你们所承认的。
And so when people say, oh, we don’t understand, I say, I think you understand much better than you’re letting on.
—— Chris Potts · [16:53]

指向原始笔记的链接

这大概是一种专业知识的悖论,对吧?你知道得越多,你就越觉得还有谜团存在。
It’s probably a paradox of expertise, right? So the more you do know, the more you feel like there are also mysteries.
—— Chris Potts · [17:15]

指向原始笔记的链接

而且由于它们非常齐心协力地这样做,你实际上可能从一个你原本认为非常好的规格说明中得到系统性的偏差行为。
And since they do it very concertedly, you can actually get systematically biased behavior from something that you thought was a very good specification.
—— Chris Potts · [25:04]

指向原始笔记的链接

我看到 Ed Zitron 的一条推文,只是某人发的截图,注意到 Copilot 告诉他们上个月的账单是 500 美元,如果他们按照 Copilot 新的计费方式继续下去,下个月将是 11,000 美元。
I saw a tweet from Ed Zitron, just a screenshot from someone who was noticing that Copilot was telling them that their bill last month was $500,andiftheykeepupthewaytheyarewithCopilo{t}^{\prime }snewbilling,itwillbe$11,000 in the next month.
—— Chris Potts · [26:37]

指向原始笔记的链接

我的意思是,毕竟,所有这些东西都是在深度中没有递归这一事实之上的一种打补丁。
I mean, after all, so all of this stuff is a kind of patch job on the fact that there’s no recursion in the depth.
—— Chris Potts · [34:52]

指向原始笔记的链接

我认为在当下,我们就是不知道,但基本上,对于全球经济而言,没有比价值在哪里、谁来支付、支付多少更重要的问题了。
I think at the current moment, we just don’t know, but there couldn’t be a more significant question for the global economy, basically, than where the value is and who’s going to pay and how much.
—— Chris Potts · [43:25]

指向原始笔记的链接

是的,根据我们在这里能想到的一切测量手段,你的 token 已经买不到它曾经能买到的东西了。
Yes, your token is not buying you what it once did, according to everything we can think to measure here.
—— Chris Potts · [43:56]

指向原始笔记的链接

这关系到我一直坚持的一个观点,就是我们应该从系统的角度思考,而不是从模型的角度思考。
So, and this relates to a line I’ve had consistently, which is that we should think in terms of systems, not in terms of models.
—— Chris Potts · [45:11]

指向原始笔记的链接

正是由于他们引入的所有那些摩擦、所有那些反驳,专家才能更可靠地完成更难的事情。
Experts can do harder things more reliably as a result of all that friction they introduce, all that pushback.
—— Chris Potts · [49:09]

指向原始笔记的链接

那个验证步骤——它并不意味着我拥有全面的知识,只意味着我知道我最终想看到什么——实在是太关键了。
That verification step that doesn’t imply I have comprehensive knowledge, it just implies that I know what I want to see in the end, is so critical.
—— Chris Potts · [53:30]

指向原始笔记的链接

完全相同的问题,如果所有的代码审查智能体都以同样的方式带有偏见,它们就会漏掉完全同一类 bug,那我们就全完了。
Same exact issue, if all the code review agents are biased in the same way, they will miss exactly the same class of bugs and then we’re all sunk.
—— Chris Potts · [55:13]

指向原始笔记的链接

但如果你不打算承担那种风险,那当学术研究者还有什么意义?
But what’s the point of being an academic researcher if you’re not going to take that kind of risk?
—— Chris Potts · [59:13]

指向原始笔记的链接

② 出现在这些集

1 集

• 《斯坦福语言学家的代币经济学：你的 token 贬值了》 — 作为联合主持

③ 他谈到的

点进去有真内容 —— 本页主要出口

Sam Charrington · tokenflation · tokenomics · token · 消费者价格指数 · 推理时扩展 · 苦涩的教训 · Transformer · DSPy · 提示词优化

④ 也在聊「创业与行业」的人