实验 (experiment)
集里怎么说它
- 《增长不是指标黑客,是连接用户与价值》(12:48起):本集说 Albert 在 Chess.com 设定’一年 1000 个实验’的北极星目标,这个数字是他编的,他不在乎能否精确达到,真正有用的是它引发的对话——哪些职能可以参与实验(生命周期营销、应用商店优化)、哪些屏幕需要无代码化、可观测性够不够;典型实验胜率约 30-50%。
- 《把棒球变成马戏团:Savannah Bananas 创始人的粉丝优先生意经》(07:25起):本集说实验是核心方法:起步时「没有什么可失去」就拼命试,后来形成 SNL 模式——周二全天点子会、围读、排练,每周一档新节目
① 提到它的金句
13 条
但是当你确实发现了一个突破噪音的东西,它实际上也可能是一个巨大的失败的实验,这些也是非常有价值的。
指向原始笔记的链接
But when you do find a thing that breaks through the noise, and it could actually be a hugely losing experiment too, those are also super valuable.
—— Albert Cheng · [13:51]
所以在 2023 年之前,公司实际上根本没有做实验。
指向原始笔记的链接
So prior to 2023, the company practically didn’t experiment at all.
—— Albert Cheng · [57:56]
有一个团队实际上正在 OpenAI 内部进行一项实验,他们维护着一个 100% 由 Codex 编写的代码库。
指向原始笔记的链接
There’s a team that’s actually doing an experiment right now within OpenAI where they are maintaining a 100% Codex-written code base.
—— Sherwin Wu · [00:35]
大公司不做的是当一个实验成功时,他们不会全力以赴并加倍下注。
指向原始笔记的链接
What large companies don’t do is when an experiment works, they don’t go all in and double down.
—— Jeetu Patel · [11:17]
一个有趣的思想实验是,如果你试图使用可能每天有 20 个错误而不是每百万年一个错误的晶体管构建一个系统,会发生什么。
指向原始笔记的链接
an interesting thought experiment is what would happen if you tried to build a system out of transistors that might have 20 errors per day rather than one every million years.
—— Jeff Dean · [38:29]
有趣的思想实验是,如果 GPU 价格下降 99%,那么我们会回到一个真正的开源世界吗?
指向原始笔记的链接
The fun thought experiment is if GPUs dropped in price by 99%, then do we get back to a real open source world?
—— Matt Bornstein · [00:00]
所以它是在跑不是主实验的实验,以此来优化主实验。
指向原始笔记的链接
So it’s running experiments that are not the main experiment in order to optimize them.
—— 嘉宾 · [35:44]
这个实验的教训是:审查并没有消失。它被重建成一个系统,而那个系统是由人类构建的。
指向原始笔记的链接
Review didn’t disappear is the lesson of this experiment. It got rebuilt as a system and that system is built by humans.
—— Laurie Voss · [18:31]
另一部分,我认为这对 AI 实验的递归自我改进同样成立:当驱动实验的思考的智能水平越来越高、而实验因此成为瓶颈时,我认为我们会做更多的思考。
指向原始笔记的链接
The other part there, and I think this is true of RSI for AI experiments as well, is as our intelligence levels on the thinking that then drives that experiment gets higher and higher, And as that experiment therefore becomes the bottleneck, I think we do more thinking.
—— Walter Goodwin · [26:57]
提前剧透一下实验结果:我们实现了每线程中位成本降低 64%,且质量没有可测量的变化。
指向原始笔记的链接
And to kind of spoil the results of the experiment here, we were able to see a 64% reduction in median cost per thread with no measurable change in quality.
—— Sydney · [02:00]
只把工具交到人们手里,是得不到高质量的学习或工作成果的。你需要给他们真正的学习和实验时间。
指向原始笔记的链接
Good quality learning or work out of just handing people the tools. You need to give them real time to learn and experiment.
—— Em Shreve · [01:01]
我的演讲到此结束,但我希望大家从中带走的一个要点是:给人们真正的时间去实际实验和学习。
指向原始笔记的链接
That is the end of my presentation, but the one takeaway that I wanted people to take from this is give people real time to actually experiment and learn.
—— Em Shreve · [14:04]
换句话说,如果你已经决定要把一个军用级别的、故障频发的实验品——也就是 LLM——作为能产生营收的点子从私人公司发布给大众,那你已经做出了那个决定。
指向原始笔记的链接
In other words, if you’ve decided that you were going to release a military-grade malfunctioning experiment, which is what LLMs are, into the general public as a revenue-producing idea in private companies, you’ve already decided to do that.
—— 嘉宾 · [62:03]
② 出现在这些集
2 集
- 《增长不是指标黑客,是连接用户与价值》 — 作为概念
- 《把棒球变成马戏团:Savannah Bananas 创始人的粉丝优先生意经》 — 作为概念
③ 关联
点进去有真内容 —— 本页主要出口
Albert Cheng · Jeff Furman · Lenny · Jesse Cole · Duolingo · Savannah Bananas · Grammarly · Fans First Entertainment · Chess.com · 粉丝体验
