集里怎么说它

• 《AWS 杰出工程师：智能体时代，难的不是写代码，是写规格》(35:07起):本集的重磅判断：在某种意义上 testing 现在是软件开发中最重要的部分，思考如何构建能判断软件好不好的测试正处于软件开发的前沿。
• 《Meta 用毫秒级数据丈量工程师：AI 时代代码不再是货币》(01:17起):本集说 AI 让加测试变得非常容易,但全绿的测试可能给你虚假的安全感——智能体做的和你要求的之间可能有漂移或规格说明不足

① 提到它的金句

10 条

一旦你变成一种比较对象，一旦你变成他们同时测试的三个之一，你就已经某种程度输了。
As soon as you become a comparison, as soon as you become one of three that they’re testing out, you’ve already sort of lost.
—— Jen Abel · [39:19]

指向原始笔记的链接

A/B 测试效果不是很好，而且它对大多数事情都不起作用。
A/B testing doesn’t work very well and it doesn’t work on most things.
—— Jason Cohen · [94:43]

指向原始笔记的链接

我认为我们每季度的红队测试非常像医生的看诊，你会从头到脚检查一遍。你做核磁共振扫描，你做血液测试，你就像伊丽莎白·霍姆斯试图用 Theranos 阻止的那些事情，我们都会对你做，而且我们会做上十遍。
I think our quarterly red teaming is is very much alike to the doctor’s visit where you go from head to toe. You go through the MRI scanner, you go through the blood testing, you like everything that Elizabeth Holmes tried to prevent with Theranos, we will do to you and we will do it 10 times over.
—— Emil Lassen · [37:24]

指向原始笔记的链接

当我们实际测试让客户尝试直接用智能体通过我们的平台交付工作成果时，智能体的失败率高得惊人。
When we’ve actually done testing of clients trying to use agents directly to deliver work products through our platform, the failure rate of agents is incredibly high.
—— Hayden Brown · [10:24]

指向原始笔记的链接

从我们的测试来看,大约 40 行优质内容胜过 1,000 行噪音。
For about 40 good lines beats 1,000 lines of noise from our testing.
—— Christopher Burns · [06:33]

指向原始笔记的链接

我认为对抗黑魔法唯一真正的防御是：第一步，深入投入部署前测试。
I think the only real defense against the dark arts is step one to invest deeply in pre-deployment testing.
—— Sumanyu Sharma · [13:37]

指向原始笔记的链接

而且你知道，在某种意义上，测试现在是软件开发中最重要的部分。
Um and you know, in some sense uh testing uh is is now the most important part of software development.
—— Marc Brooker · [35:07]

指向原始笔记的链接

如今，GrubTile 评审的所有拉取请求中，将近五分之一是在没有任何人工评审或任何人工测试的情况下被合并的。
Today, almost a fifth of all the pull requests of GrubTile reviews are merged without any human review or without any human testing.
—— Daksh Gupta · [11:53]

指向原始笔记的链接

红队测试和渗透测试的区别在于，在我看来渗透测试只是一种卫生步骤。
And the difference between red teaming and pen testing is pen test to me is a hygiene step.
—— Kevin Mandia · [18:36]

指向原始笔记的链接

但我们对 Engine 的愿景是：发现问题、修复这些问题、测试那个修复方案，全部自主完成。
But the vision that we have for Engine is the finding of problems, the fixing of those problems, and the testing of that fix all autonomously.
—— Ben · [13:42]

指向原始笔记的链接

② 出现在这些集

2 集

• 《AWS 杰出工程师：智能体时代，难的不是写代码，是写规格》 — 作为概念
• 《Meta 用毫秒级数据丈量工程师：AI 时代代码不再是货币》 — 作为概念

③ 关联

点进去有真内容 —— 本页主要出口

智能体 · Simon Maple · Brian Hook · Marc Brooker · Moritz Beller · AWS · Meta · Strands · Microsoft Research · Agent Core