‘Going to sell like hotcakes’: First reviews of Nvidia Jetson AGX Thor Developer Kit leaves me with no doubt

(Image credit: Cnx-software)

  • Nvidia unveils Jetson AGX Thor featuring Blackwell GPU, 128GB RAM, and 1TB storage
  • Initial assessments highlight significant performance leaps over Jetson Orin
  • Experts agree it’s ideal for developers requiring robust AI and robotics hardware

Introducing Nvidia Jetson AGX Thor: A New Benchmark in Edge AI and Robotics

Nvidia has recently introduced the Jetson AGX Thor Developer Kit, a premium $3,499 platform tailored for advanced robotics and edge AI applications. Early feedback from industry reviewers underscores its impressive capabilities and marks it as a substantial upgrade from the previous Jetson Orin series.

Powerful Hardware Built on Blackwell Architecture

The core of this developer kit is the Jetson T5000 module, which leverages Nvidia’s cutting-edge Blackwell GPU architecture. This powerhouse integrates 2,560 CUDA cores alongside 96 Tensor cores, complemented by a 14-core Arm Neoverse CPU, delivering a balanced and formidable processing environment.

Supporting this is a massive 128GB of LPDDR5x memory, providing an exceptional bandwidth exceeding 270GB/s, paired with a spacious 1TB onboard SSD for high-speed storage. Connectivity is comprehensive, featuring USB-C, USB-A, HDMI 2.1, Wi-Fi 6E, Bluetooth, Gigabit Ethernet, and a high-throughput 100GbE port, ensuring versatile integration options for diverse development needs.

Exceptional Performance: A Leap Beyond Jetson Orin

Hands-on evaluations reveal that the Jetson AGX Thor delivers remarkable computational power, justifying its premium price point. Testing by leading tech reviewers demonstrated smooth operation of Nvidia’s Arm64 containers and highlighted the platform’s ability to handle workloads that the older Orin struggled with or failed to complete.

Performance comparisons position the Orin closer to the capabilities of an RTX 3050 GPU, whereas the Thor approaches the performance tier of an RTX 5070, marking a significant advancement in edge AI processing power.

Optimized for Large Language Models and Multimodal AI

One standout feature is the platform’s proficiency in running large language models (LLMs), a critical requirement for next-generation humanoid robots that integrate language understanding with visual perception. The Jetson AGX Thor excels in this domain, offering developers a robust environment for multitasking and complex AI workloads.

Reviewers have praised the kit’s “abundant horsepower,” emphasizing its suitability for demanding AI and robotics projects. Nvidia’s ongoing software enhancements promise to further unlock the device’s potential, making it a future-proof investment for developers.

Benchmark Highlights and Real-World Implications

Independent benchmarks confirm Nvidia’s performance claims, with the Jetson AGX Thor achieving 149.1 tokens per second on the Llama 3.1 8B model, closely matching the expected 150.8 tokens per second. Its CPU multi-threaded performance rivals that of high-end consumer processors like the AMD Ryzen AI 7 3500 or the upcoming Mac Mini M4, underscoring its balanced design focused on GPU-intensive tasks.

Across various AI models, Thor consistently outperforms Orin. For smaller models such as Qwen 2.5-VL 7B and Llama 3.1 8B, it delivers approximately 30% faster processing. More substantial gains are observed with Deepseek-R1 7B at 1.5 times the speed, and an impressive near fivefold increase with the demanding Qwen 3 32B inference task, highlighting its strength in handling large-scale AI workloads.

While the device’s power consumption may pose challenges for battery-operated systems, its computational and memory resources are well-suited for sophisticated robotics applications. The included 1TB SSD has been identified as a WD/SanDisk SN5000S, ensuring reliable and fast storage performance.

Conclusion: A Game-Changer for Developers in Robotics and AI

Both expert reviews concur that the Jetson AGX Thor represents a significant evolution in edge AI and robotics development platforms. Its combination of high compute power, expansive memory, and comprehensive developer tools positions it as a top choice for cutting-edge projects.

With continuous software updates anticipated to enhance its capabilities further, the Jetson AGX Thor is poised to become a staple in the toolkit of developers pushing the boundaries of AI and robotics technology.

As one reviewer aptly summarized, “For those building the next generation of advanced robotics, the Jetson AGX Thor is the definitive platform to invest in.”

(Image credit: ServeTheHome)

Related Reads

  • Top Mobile Workstations for Professionals in 2024
  • China’s Accelerated Shift Away from Nvidia AI Chips
  • Nvidia’s Affordable Next-Gen “Robot Brain” Chip Unveiled

More from this stream

Recomended