Akshat Bubna
人物 · 又名 Akshat
出现在 1 集 · 金句 6 条 · 关联 10 个
金句
就像我们在 2023 年 5 月构建了沙箱,在任何人甚至知道这将成为一件事之前。
Link to original
like we built sandboxes in May of 2023 before anyone was even knew this was going to be a thing.
—— Akshat Bubna · [09:19]
这是我们一直有所回避的一件事,就是为模型提供 API
Link to original
This is one thing we’ve kind of stayed away from is providing an API for models
—— Akshat Bubna · [48:34]
我们不是试图与世界上的 render 竞争,因为我们认为对我们的差异化的是那些需要专用计算,需要大量上下扩展的工作负载。
Link to original
we’re not trying to compete with the renders of the world because we think the differentiator for us are the workloads that need specialized compute, need to scale up and down a lot.
—— Akshat Bubna · [07:10]
你可以给一个函数添加一个装饰器,然后你会得到一个 gpu 集群,并且它们已经建立了网络连接,所以你可以运行一个真正的无服务器的 speed 训练任务
Link to original
you can add a decorator to a function and you get a cluster of gpus and they have already been networking so you can run a speed training job that’s truly serverless
—— Akshat Bubna · [28:41]
它就像是构建时沙箱对比运行时沙箱,而事实上运行时更好。
Link to original
it’s just like build-time sandboxes versus runtime sandboxes, and actually it turned out runtime was better.
—— Akshat Bubna · [54:07]
我认为提供模型 API,其中一些最终服务的就像一个非常业余的市场,粘性低得多
Link to original
I think providing model APIs is some of it ends up serving like a really hobbyist market which is much less sticky
—— Akshat Bubna · [48:40]
出现在这些集
- 《为什么 AI 基础设施必须为「Agent 体验」进化》 — 作为嘉宾
关联实体
swyx · Vibhu · Modal · Kubernetes · 无服务器 · 沙箱 · 智能体 · 推理 · GPU 快照 · 投机解码