NetsPresso Benchmarker

NetsPresso Benchmarker is a service that allows you to easily obtain benchmark results from real devices.

Key Features

NetsPresso Benchmarker is a cloud-based service that executes models on real devices to verify model accuracy and obtain benchmark results, including latency and memory usage. The service supports over 20 different devices and provides results using various runtimes, such as ONNX, TFLite, TensorRT, DRPAI, and OpenVino.

Scope of support

Devices that support benchmarks for model's framework

Device / Framework	ONNX	TENSORRT	TENSORFLOW_LITE	DRPAI	OPENVINO
RASPBERRY_PI_5	✓		✓
RASPBERRY_PI_4B	✓		✓
RASPBERRY_PI_3B_PLUS	✓		✓
RASPBERRY_PI_ZERO_W	✓		✓
RASPBERRY_PI_ZERO_2W	✓		✓
ARM_ETHOS_U_SERIES			✓ (only INT8)
ALIF_ENSEMBLE_E7_DEVKIT_GEN2			✓ (only INT8)
RENESAS_RA8D1			✓ (only INT8)
NXP_IMX93			✓ (only INT8)
ARDUINO_NICLA_VISION			✓ (only INT8)
RENESAS_RZ_V2L	✓			✓
RENESAS_RZ_V2M	✓			✓
JETSON_NANO	✓	✓
JETSON_TX2	✓	✓
JETSON_XAVIER	✓	✓
JETSON_NX	✓	✓
JETSON_AGX_ORIN	✓	✓
JETSON_ORIN_NANO	✓	✓
AWS_T4	✓	✓
INTEL_XEON_W_2233					✓