Nvidia Jetson

From Wikipedia the free encyclopedia

Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor (or SoC) from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.

Hardware[edit]

Nvidia Jetson TK1

The Jetson family includes the following boards:

  • In late April 2014, Nvidia shipped the Nvidia Jetson TK1 development board containing a Tegra K1 SoC in the T124 variant and running Ubuntu Linux.[1]
  • The Nvidia Jetson TX1 development board bears a Tegra X1 of model T210.[2]
  • The Nvidia Jetson TX2 board bears a Tegra X2 of microarchitecture GP10B[3] (SoC type T186 or very similar). This board and the associated development platform was announced in March 2017 as a compact card design for low power scenarios, e.g. for the use in smaller camera drones. A matrix describing a set of performance modes was provided by the media along with that.[4] Further a TX2i variant, said to be rugged and suitable for industrial use cases, is mentioned.[5]
  • The Nvidia Jetson Xavier was announced as a development kit in end of August 2018. Indications were given that a 20x acceleration for certain application cases compared to predecessor devices should be expected, and that the application power efficiency is 10x improved. Nvidia Jetson Xavier NX has a 6-core Nvidia Carmel ARMv8.2.
    • The Nvidia Jetson AGX Xavier is the 8-core version on the same core architecture (Carmel Armv8.2).[6]
An Nvidia Jetson Nano developer kit.
An Nvidia Jetson Nano developer kit
  • The Nvidia Jetson Nano was announced as a development system in mid-March 2019[7] The intended market is for hobbyist robotics due to the low price point.[8][9] The final specs expose the board being sort of a power-optimized, stripped-down version of what a full Tegra X1 system would mean. Only half of the CPU (only 4x A57 @ 1.43 GHz) and GPU (128 cores of Maxwell generation @ 921 MHz) cores are present and only half of the maximum possible RAM is attached (4 GB LPDDR4 @ 64 bit + 1.6 GHz = 25.6 GB/s) whilst the available or usable interfacing is determined by the baseboard design and is further subject of implementation decisions and specifics in an end user specific design for an application case.[10]
    • The Nvidia Jetson Nano Developer Kit is an AI computer for makers, learners, and developers that brings the power of modern artificial intelligence to a low-power, easy-to-use platform, to start quickly with out-of-the-box support for many popular peripherals, add-ons, and ready-to-use projects.[11][12]
An Nvidia Jetson AGX Orin developer kit.
An Nvidia Jetson Orin developer kit
  • In September 2022 Nvidia announced the Jetson Orin Nano.[13][14] The modules have the same 260-pin SO-DIMM connector and 69.6 mm x 45 mm dimensions, and come in two variants. The 4 GB variant provides 20 Sparse or 10 Dense TOPs, using a 512-core Ampere GPU with 16 Tensor cores, while the 8 GB variant doubles those numbers to 40/20 TOPs, a 1024-core GPU and 16 Tensor cores. Both have 6 Arm Cortex-A78AE cores. The 4 GB module starts at $199 and the 8 GB variant for $299, when purchasing 1000 units.

Performance[edit]

The published performance modes of the Nvidia Jetson TX2 are as follows.

Mode Max Clocks (Denver 2 + A57) Max-P (Denver 2 + A57) Max-P (only Denver 2) Max-P (only A57) Max-Q (only A57)
GPU Clock (MHz) 1302 1122 854
Denver 2 Clock (MHz) 2000 1400 2000 stopped stopped
Cortex-A57 (MHz) 2000+ 1400 stopped 2000 1200
TDP / W might vary 15 15 15 7.5

Jetson TX2 also has 5 power modes, numbered 0 through 4 as published by NVIDIA.[15] The default mode is mode 3 (MAX-P).

Jetson TX2 clock configuration with power modes
Property MAX-N

(Mode 0)

MAX-Q

(Mode 1)

MAX-P

(Mode 2)

MAX-P*

(Mode 3)

MAX-P

(Mode 4)

Power budget N/A 7.5W 15W 15W 15W
Online A57 CPU 4 4 4 4 1
Online D15 CPU 2 0 2 0 1
A57 CPU max freq (MHz) 2000 1200 1400 2000 345
D15 CPU max freq (MHz) 2000 N/A 1400 N/A 2000
GPU max freq (MHz) 1300 850 1122 1122 1122
Memory max freq (MHz) 1866 1331 1600 1600 1600

The published operation modes of the Nvidia Jetson Nano are:

Mode 0 1
GPU Clock (MHz) 921 640
Cortex-A57 (MHz) 4x 1428 2x 918
2x stopped
TDP / W 10 5

Versions[edit]

There are various versions of the Jetson board available. Some of them are:

Year Version Performance GPU CPU Memory Power
2017 Jetson TX2 [16] 1.33 TFLOPS 256-core Nvidia Pascal architecture GPU Dual-core Nvidia Denver 2 64-bit CPU and quad-core ARM Cortex-A57 MPCore processor 8 GiB 7.5–15 W
2020 Jetson Xavier NX 21 TOPS 384-core Nvidia Volta architecture GPU with 48 Tensor cores 6-core Nvidia Carmel ARMv8.2 64-bit CPU 6MB L2 + 4MB L3 8 GiB 10–20W
2018 Jetson AGX Xavier [17] 32 TOPS 512-core Nvidia Volta architecture GPU with 64 Tensor cores 8-core NVIDIA Carmel ARMv8.2 64-bit CPU 8MB L2 + 4MB L3 32-64 GiB 10W - 30W
2019 Jetson Nano 472 GFLOPS 128-core Nvidia Maxwell architecture GPU Quad-core ARM Cortex-A57 MPCore processor 4 GiB 5–10 W
2023 Jetson Orin Nano [18] 20–40 TOPS from 512-core Nvidia Ampere architecture GPU with 16 Tensor cores 6-core ARM Cortex-A78AE v8.2 64-bit CPU 1.5MB L2 + 4MB L3 4-8 GiB 7–10 W
2023 Jetson Orin NX 70–100 TOPS 1024-core Nvidia Ampere architecture GPU with 32 Tensor cores up to 8-core ARM Cortex-A78AE v8.2 64-bit CPU 2MB L2 + 4MB L3 8–16 GiB 10–25 W
2023 Jetson AGX Orin 200-275 TOPS up to 2048-core Nvidia Ampere architecture GPU with 64 Tensor cores up to 12-core ARM Cortex-A78AE v8.2 64-bit CPU 3MB L2 + 6MB L3 32–64 GiB 15–60 W

Software[edit]

Various operating systems and software might be able to run on the Jetson board series.

Linux[edit]

JetPack is a software development kit (SDK) from Nvidia for their Jetson board series. It includes the Linux for Tegra (L4T) operating system and other tools. The official Nvidia download page bears an entry for JetPack 3.2 (uploaded there on 2018-03-08) that states:

JetPack 3.2 adds support for the Linux for Tegra r28.2 image for the Jetson OS. It is packaged with newer versions of Tegra System Profiler, TensorRT, and cuDNN from the last release.[19]

RedHawk Linux is a high-performance RTOS available for the Jetson platform, along with associated NightStar real-time development tools, CUDA/GPU enhancements, and a framework for hardware-in-the-loop and man-in-the-loop simulations.[20]

QNX[edit]

The QNX operating system also available for the Jetson platform, though it is not widely announced. There are success reports of installing and running specific QNX packages on certain Nvidia Jetson board variants. Namely the package qnx-V3Q-23.16.01 that is seemingly in parts based on Nvidia's Vibrante Linux distribution is reported to run on the Jetson TK1 Pro board.[21]

See also[edit]

References[edit]

  1. ^ Michael Larabel (29 April 2014). "NVIDIA's Tegra TK1 Jetson Board Is Now Shipping". Phoronix.
  2. ^ "Embedded Systems Development Solutions from NVIDIA Jetson". NVIDIA. 2015-03-18. Retrieved 2016-07-10.
  3. ^ NVIDIA Rolls Out Tegra X2 GPU Support In Nouveau by Michael Larabel at phoronix.com on March 29, 2017
  4. ^ NVIDIA Announces Jetson TX2: Parker Comes To NVIDIA’s Embedded System Kit, March 7, 2017
  5. ^ "NVIDIA Jetson TX2i Module for Industrial Environments". NVIDIA Developer Forums. March 9, 2018.
  6. ^ "Jetson AGX Xavier Developer Kit". NVIDIA Developer. July 9, 2018.
  7. ^ "NVIDIA Jetson Nano For Edge AI Applications and Education". NVIDIA.
  8. ^ "Nvidia Jetson Nano – $99 of CUDA X Awesomeness". March 18, 2019.
  9. ^ "Hands-On: New Nvidia Jetson Nano Is More Power In A Smaller Form Factor". March 18, 2019.
  10. ^ NVIDIA Introduces $99 Jetson Nano Developer Kit by Jean-Luc Aufranc on March 19, 2019 on CNXSoft
  11. ^ Links to Jetson Nano Resources & Wiki
  12. ^ Nvidia Jetson Developer Kit User Guide
  13. ^ "Solving Entry-Level Edge AI Challenges with NVIDIA Jetson Orin Nano". NVIDIA Technical Blog. 2022-09-21. Retrieved 2022-10-27.
  14. ^ Robinson, Cliff (2022-09-22). "NVIDIA Jetson Orin Nano Launched Cheaper Arm and Ampere". ServeTheHome. Retrieved 2022-10-27.
  15. ^ "Tegra Linux Driver (See under "NVPModel Clock Configuration for Jetson TX2 and TX2 4GB")". docs.nvidia.com. Retrieved 2021-07-25.
  16. ^ NVIDIA (18 April 2023). "Jetson TX2 Module". Nvidia.
  17. ^ NVIDIA (18 April 2023). "Jetson AGX Xavier Series". Nvidia.
  18. ^ NVIDIA (27 March 2023). "Jetson Orin Modules and Developer Kits". Nvidia.
  19. ^ "Jetson Download Center". NVIDIA Developer. November 3, 2015.
  20. ^ "Concurrent products for the NVIDIA Jetson". Concurrent Real-Time Linux RTOS Solutions.
  21. ^ "Running QNX onto Jetson TK1 Pro (1860)". NVIDIA Developer Forums. June 6, 2016.