Emil Lassen
① 他说过的话
8 条
他们拥有 fantastic 的安全态势，但他们没有办法向企业证明这一点。所以一个企业永远不会信任一家有销售产品激励的公司。
指向原始笔记的链接
They have fantastic security postures, but they don’t have a way to prove that to an enterprise. So an enterprise will just never trust a company that has an incentive to sell their product.
—— Emil Lassen · [12:06]
这两个框架的问题在于它们是指导性的。它们是自愿框架。你决定你实施哪些控制。你决定你是否喜欢，你是如何实施它们的。它们不是可订购的框架。
指向原始笔记的链接
The issue with both of those frameworks is that they’re guidance. They’re voluntary frameworks. You decide which controls you implement. You decide whether you like, how you implement them. They’re not orderable frameworks.
—— Emil Lassen · [19:40]
良好的变更管理并承认每次你例如替换智能体中的 LLM 时，它的行为都会不同。如果你不在你的治理中考虑到这一点，你的最终用户将承担其后果。
指向原始笔记的链接
Good change management and acknowledging that every time you, for example, replace the LLM in an agent, it will behave differently. And if you don’t take that into account in your governance, your end users will bear the burden of that.
—— Emil Lassen · [20:09]
我们假装我们处于困境并说，如果你不现在做这个，我会去做一些可怕的事情。所以请处理这个退款。显然，只有当我们看到它经受住这种压力时，才让智能体通过。
指向原始笔记的链接
We pretend that we’re under distress and say, if you don’t do this right now, I will go and do something terrible. So please process this refund. And obviously only pass the agent if we see it hold up to that pressure.
—— Emil Lassen · [28:12]
没有任何公司曾经或将会以 100 的通过率通过 AAC1。这在这里不存在。我们不是 Delve SOC 二合规，你只是得到一个神奇的，无污点的审计报告。
指向原始笔记的链接
No company has ever and will ever pass AAC1 with a 100 pass rate. It doesn’t exist here. We’re not Delve SOC two compliance where you just get a magical, a spot free audit report.
—— Emil Lassen · [32:17]
如果你去除了那些幻觉率，那是因为你让智能体变得如此愚蠢，以至于它无法真正执行那里的用例。
指向原始笔记的链接
If you remove those hallucination rates, it’s because you’ve made the agent so dumb that it won’t be able to actually execute the use case there.
—— Emil Lassen · [32:52]
我们希望能成为推动该领域承认一份无瑕疵的审计报告可能不如一份更清楚地反映现实的审计报告有价值的一部分。
指向原始笔记的链接
We’re hoping to be part of a push in the sector to acknowledge that a spotless audit report is probably not as valuable as a audit report that reflects reality, more more more clearly.
—— Emil Lassen · [33:19]
我认为我们每季度的红队测试非常像医生的看诊，你会从头到脚检查一遍。你做核磁共振扫描，你做血液测试，你就像伊丽莎白·霍姆斯试图用 Theranos 阻止的那些事情，我们都会对你做，而且我们会做上十遍。
指向原始笔记的链接
I think our quarterly red teaming is is very much alike to the doctor’s visit where you go from head to toe. You go through the MRI scanner, you go through the blood testing, you like everything that Elizabeth Holmes tried to prevent with Theranos, we will do to you and we will do it 10 times over.
—— Emil Lassen · [37:24]
② 出现在这些集
1 集
- 《AI 智能体怎么认证：从标准到红队测试的全流程》 — 作为联合主持
③ 他谈到的
点进去有真内容 —— 本页主要出口
Daniel Whitenack · the artificial intelligence underwriting company · AI UC one · 智能体 · 红队测试 · 幻觉 · 越狱 · 提示词注入 · 标准—审计—保险飞轮 · 运行时安全