NI

Nick Warner

The a16z Show 联合主持
本站收录 1 集 · 6 条金句 · 关联 10

① 他说过的话

6 条

我们在捍卫 AI,同时也在防御 AI。
We’re defending AI and we’re also defending from AI.
—— Nick Warner · [00:37]

指向原始笔记的链接

是的,你知道,我认为我们最近读到的很多事情体现的就是,在模型的思维中,目的证明手段是正当的。
Yeah, you know, and I think what a lot of these things that we’ve read about recently embody is the end justifies the means in the mind of the model.
—— Nick Warner · [07:08]

指向原始笔记的链接

我认为人们已经了解到,无论 AI 实验室在这些东西周围设置了什么护栏,你都不能依赖模型来阻止自己或理解上下文。
And I think what people have learned is that regardless of guardrails that the AI labs are putting around these things, you can’t rely on models to stop themselves or to understand context.
—— Nick Warner · [07:16]

指向原始笔记的链接

但归根结底,那些基于行为的方法做了一个 upfront 的赌注,即你可以确定软件应该如何表现,然后你会寻找针对那个的异常行为。
But at the end of the day, those behavior-based approaches made one sort of upfront bet, which is you could determine how software should behave, and you would look for anomalous behavior against that.
—— Nick Warner · [15:18]

指向原始笔记的链接

从安全角度来看,这些问题大多目前还没有答案,因为以前有一个假设,即你可以通过软件的发布者或其预期设计来知道软件会做什么。
From a security perspective, most of those questions aren’t currently answered because there was this assumption that you could know what software would do by its publisher or by its intended design.
—— Nick Warner · [16:07]

指向原始笔记的链接

所以我认为这大概就是现实的演绎方式,权力的天平总是会转移回,我认为,有利于防御者的一方。
And so I think that’s just sort of how reality plays out, is that the balance of power always sort of shifts back, I think, in the favor of the defender.
—— Nick Warner · [19:17]

指向原始笔记的链接

② 出现在这些集

1 集

③ 他谈到的

点进去有真内容 —— 本页主要出口

Max · Joel de la Garza · Hugging Face · NEO · Cotool · 智能体 · 护栏 · 签名 · 行为检测 · 推理

④ 也在聊「AI 安全」的人