Available in May 2025, the new Digits off-the-shelf AI box direct from NVIDIA, starting at $3,000.
Inside will be a special AI-tuned Linux system, NVIDIA’s special GB10 processor and 128GB of memory, and it should easily run local AI models of “up to 200B” in size. 70B would usually be the maximum for a local PC, so this is effectively a doubling of that capability, plus some overhead left over to run other software. Such as audio voice recognition/synthesis, potentially meaning that models such as an advanced human-ish roleplaying LLM could have real-time fluid voice conversations with a human.
The box can run as a standalone, or be plugged into a normal PC. Two can be placed side-by-side to make an ‘AI super-processor’ capable of running the largest and (arguably) the most powerful AIs. Two boxes should come in at under $10,000, thus superpowered AI becomes affordable for many small businesses. Provided they can afford the electricity — I’ve heard nothing about power consumption as yet.
It would be very interesting to see what creative hackers and tweakers can do with a $10,000 setup and the ability to run multiple AIs and other software, and have the AIs control the software (e.g. Poser, which ‘talks Python’ just as the AIs do) and talk to each other. A complete virtual movie-studio, with voice-actors, in your garage?