Sachin Katti
① 他说过的话
12 条
今天的算力需求远远超过算力供给。所以我们能把任何东西上线,都会立即被消耗掉。
指向原始笔记的链接
Demand far outstrips compute supply today. So anything we can bring online, we consume immediately.
—— Sachin Katti · [00:07]
我们确实相信,递归的世界离我们并不遥远——AI 将设计它自己所需的系统,来训练和运行下一代 AI,包括这个。
指向原始笔记的链接
We do believe that the world of recursion is not that far, where AI will design the systems it needs to train and run the next generation of AI, including this.
—— Sachin Katti · [00:21]
所以我认为把数据中心可视化最好的方式,就是巨大的工厂,把电子变成 token。
指向原始笔记的链接
So I think the best way to visualize data centers is giant factories that are turning electrons into tokens.
—— Sachin Katti · [05:52]
所以芯片越热,你获得的内存带宽就越多,你获得的 flops 就越多。所以有很强的回报。如果你能冷却得好,那也意味着你能产出更多智能。
指向原始笔记的链接
So the hotter the chip, the more memory bandwidth you get, the more flops you get. And so there’s a strong payoff. If you can cool well, that also means you can produce more intelligence.
—— Sachin Katti · [07:59]
所以无论我们在哪里建数据中心,我们都会做出硬性承诺,即我们不会从电网夺走电力。事实上,我们是在投资电网以产生新的电力,这样我们才能把电力用于数据中心。
指向原始笔记的链接
So whenever we build a data center anywhere, we make it a hard commitment that we are not taking power away from the grid. In fact, we are investing in the grid to generate new power so that we can consume it for data centers.
—— Sachin Katti · [08:44]
它来得越快越好。我认为它是我们所有人都能生产和消费的最密集的能源形式。而且它还是清洁的。
指向原始笔记的链接
It can’t come soon enough. I think it is the densest form of energy we can all produce and consume. And it’s also clean.
—— Sachin Katti · [11:20]
我们把算力翻了三倍,收入也翻了三倍。
指向原始笔记的链接
We tripled compute and we tripled revenue.
—— Sachin Katti · [15:53]
现在,AI 本身可以做 AI 研究了。我们能做的实验数量爆炸式增长。因此,研究所需的算力也爆炸式增长。
指向原始笔记的链接
Now, AI itself can do AI research. The number of experiments we can run explodes. And therefore, the amount of compute you need for research also explodes.
—— Sachin Katti · [16:50]
任何时候我们觉得自己已经有足够的算力,可以慢下来了,总是会给我们带来负面的惊喜,比如,糟了,我们不该放慢速度的,对吧?
指向原始笔记的链接
Any time we have thought we have enough compute, we can slow down. always negatively surprise us, like, oh, shit, we should not have slowed down, right?
—— Sachin Katti · [17:24]
我们在建造世界上最大的计算机。
指向原始笔记的链接
We are building the largest computer in the world.
—— Sachin Katti · [27:41]
这里的独特优势在于,我们知道未来的模型可能长什么样,因此能够走捷径,省去很多你在芯片侧需要做的决策、设计决策。
指向原始笔记的链接
There’s a unique advantage here of us knowing what the future models might look like and therefore being able to short circuit a lot of the decisions you need to make, design decisions you need to make on the chip side.
—— Sachin Katti · [35:26]
所以与其只挑一条路线,我们会把流量发送到所有这些路线上。哪条先成功,就走哪条。
指向原始笔记的链接
So instead of picking just one route, We will send traffic across all of them. And whichever one succeeds, you take that.
—— Sachin Katti · [38:24]
② 出现在这些集
1 集
③ 他谈到的
点进去有真内容 —— 本页主要出口
Matt Turk · OpenAI · 数据中心 · 液冷 · Stargate · Jalapeno · MRC · 推理 · GPU · 核能
