Compatibility range for benchmark

You can measure the actual performance on the devices listed below without the need to purchase or install the device.

Support Hardware

Arm MCU/NPU

Target Device.tflite
Renesas RA8D1 (Arm Cortex-M85)O (only INT8)
Renesas RA8D1 (Arm Cortex-M85) with heliumO (only INT8)
Alif Ensemble DevKit-E7 Gen2 (Arm Cortex-M85 + Ethos-U55)O (only INT8)
Alif Ensemble DevKit-E7 Gen2 (Arm Cortex-M85 + Ethos-U55) with heliumO (only INT8)
Arm Virtual Hardware Corstone-300(Ethos-U55/U65)O (only INT8)
Arduino Nicla Vision(Arm Cortex-M7/M4)O (only INT8)
NXP i.MX 93(Arm Cortex-A55/M33)O (only INT8)

NVIDIA

  • When benchmarking on Jetson, it is essential for the model file and target device to match the Jetpack version.
Target Device.trt.engine.tflite.onnx
Jetson Nano JetPack 4.4.1OOXO
Jetson Nano JetPack 4.6OOXO
Jetson Xavier NX JetPack 4.6OOXO
Jetson Xavier NX JetPack 5.0.2OOXO
Jetson TX2 JetPack 4.6OOXO
Jetson AGX Xavier JetPack 4.6OOXO
Jetson AGX Orin JetPack 5.0.1OOXO
AWS-T4OOXO

Raspberry Pi (Arm CPU)

Target Device.tflite.onnx
Raspberry Pi ZeroWOX
Raspberry Pi Zero2WOX
Raspberry Pi 2BOO
Raspberry Pi 3BOO
Raspberry Pi 3B+OO
Raspberry Pi 4BOO
Raspberry Pi 5OO

Intel

Target Device.zip(bin+xml)
Xeon W-2223O