Plenty of developers are looking for powerful computers to run the latest AI models. NVIDIA Project DIGITS is a small AI supercomputer that can run 200b parameter models. The chip has a petaflop of AI computing power. This superchip has an:
NVIDIA Blackwell GPU with latest-generation CUDA cores and fifth-generation Tensor Cores, connected via NVLink-C2C chip-to-chip interconnect to a high-performance NVIDIA Grace CPU, which includes 20 power-efficient cores built with the Arm architecture.
Each Project DIGITS has 128GB of RAM and 4GB of NVME storage. You can pair two of these to run 405b parameter models. This is ready for developers as you can fine tune models with NeMo and run PyTorch, Python and Jupyter notebooks. The starting price is set at $3000.
what??
NVIDIA just dropped Project DIGITS, a $3,000 personal AI supercomputer that’s small enough to look like a Mac Mini but packs 1,000x the power of your average laptop.
Handles AI models with up to 200 BILLION parameters.
This is incredible.. pic.twitter.com/z4JOeFD2JI
— el.cine (@EHuanglu) January 7, 2025
[HT]
