BTC $80,810.05 +0.24%
ETH $2,336.86 -0.04%
BNB $745.61 -0.27%
XRP $1.29 -1.97%
SOL $101.02 -0.40%
TRX $0.3310 +0.40%
DOGE $0.0795 +0.61%
ADA $0.2033 +0.57%
BCH $288.79 +1.26%
LINK $11.73 +1.63%
HYPE $94.70 +17.84%
AAVE $133.91 +1.50%
SUI $0.9399 +1.83%
XLM $0.1706 +0.38%
ZEC $1,335.12 +4.19%
AAPL $349.68 +1.09%
AMZN $245.92 -2.76%
GOOGL $283.02 -12.97%
MSFT $526.79 -0.23%
META $628.50 +2.50%
NVDA $213.38 -1.70%
TSLA $404.64 +0.56%
SNDK $1,340.83 -2.84%
INTC $91.70 -2.57%
SPCX $144.13 -0.26%
MU $937.38 -3.29%
AMD $566.21 -0.30%
BTC $80,810.05 +0.24%
ETH $2,336.86 -0.04%
BNB $745.61 -0.27%
XRP $1.29 -1.97%
SOL $101.02 -0.40%
TRX $0.3310 +0.40%
DOGE $0.0795 +0.61%
ADA $0.2033 +0.57%
BCH $288.79 +1.26%
LINK $11.73 +1.63%
HYPE $94.70 +17.84%
AAVE $133.91 +1.50%
SUI $0.9399 +1.83%
XLM $0.1706 +0.38%
ZEC $1,335.12 +4.19%
AAPL $349.68 +1.09%
AMZN $245.92 -2.76%
GOOGL $283.02 -12.97%
MSFT $526.79 -0.23%
META $628.50 +2.50%
NVDA $213.38 -1.70%
TSLA $404.64 +0.56%
SNDK $1,340.83 -2.84%
INTC $91.70 -2.57%
SPCX $144.13 -0.26%
MU $937.38 -3.29%
AMD $566.21 -0.30%

Vitalik 分享本地私有 LLM 方案,强调隐私与安全优先

2026-04-02 14:53:42

ChainCatcher 消息,Vitalik Buterin 发文分享其截至 2026 年 4 月的本地化、私有化 LLM 部署方案,核心目标是将隐私、安全与自主可控作为前提,尽量减少远程模型及外部服务接触个人数据的机会,并通过本地推理、文件本地存储及沙箱隔离等方式降低数据泄露、模型越狱及恶意内容利用风险。

在硬件方面,其测试了搭载 NVIDIA 5090 GPU 的笔记本、AMD Ryzen AI Max Pro 128 GB 统一内存设备及 DGX Spark 等方案,并使用 Qwen3.5 35B 与 122B 模型进行本地推理。

其中,5090 笔记本在 35B 模型下可达约 90 tokens/s,AMD 方案约 51 tokens/s,DGX Spark 约 60 tokens/s。Vitalik 表示,其更倾向于基于高性能笔记本构建本地 AI 环境,同时使用 llama-server、llama-swap 及 NixOS 等工具搭建整体工作流。

app_icon
ChainCatcher 与创新者共建Web3世界