NVIDIA has introduced the Jetson Orin Nano Super Developer Kit, a groundbreaking advancement in generative AI for small edge devices. With its new Super Mode, the kit delivers up to a 1.7x boost in generative AI performance, making it the most affordable supercomputer for edge AI and robotics applications.
To complement this innovation, JetPack 6.2 now supports Super Mode for both Jetson Orin Nano and Jetson Orin NX production modules, enabling up to 2x higher generative AI model performance. This upgrade unlocks greater value and reduces the total cost of ownership for new and existing robotics and edge AI applications.
Key Features of Super Mode
Enhanced Power Modes
Jetson Orin Nano and Jetson Orin NX modules now offer new power configurations to maximize performance:
The MAXN SUPER mode allows for uncapped performance by enabling the highest frequency across CPU, GPU, DLA, PVA, and SOC engines. While this mode provides unparalleled performance, the module dynamically throttles when power exceeds the thermal design power (TDP) budget to maintain thermal stability.
Performance Benchmarks
Large Language Models (LLMs)
Super Mode delivers a remarkable boost for popular LLMs such as Llama3.1 8B, Qwen2.5 7B, and Gemma2 2B. Below are some key performance gains:
Similar gains were observed on other modules, including the Jetson Orin NX 8GB and 16GB, with performance improvements ranging from 1.3x to 2x.
Vision Language Models (VLMs)
Super Mode also enhances the performance of VILA1.5 8B, LLAVA1.6 7B, and other VLMs.
These benchmarks highlight the module’s ability to handle complex vision and language tasks with ease.
Custom Power Optimization
NVIDIA’s updated Power Estimator Tool allows developers to create custom power profiles to balance performance and energy consumption. By modifying GPU, CPU, and DLA configurations, users can optimize their applications for thermal stability and efficiency.
Applications and Recommendations
The Jetson Orin Nano and NX modules are ideal for a wide range of robotics and edge AI applications, including:
-
Autonomous vehicles
-
Smart surveillance
-
Edge-based generative AI
To fully leverage Super Mode’s potential, ensure your product's thermal design supports the increased power requirements. For guidance, refer to the updated Thermal Design Guide provided by NVIDIA.
The introduction of Super Mode with JetPack 6.2 marks a significant leap for edge AI and generative AI technologies. Whether you're deploying robotics, vision transformers, or large language models, the NVIDIA Jetson Orin Nano Super Developer Kit offers unmatched performance and affordability.
For detailed specifications, benchmarks, and setup instructions, visit the official NVIDIA Jetson documentation.
