Benchmark Model

benchmark_model(self, input_model_path: str, target_device_name: DeviceName, target_software_version: str | SoftwareVersion | None = None, target_hardware_type: str | HardwareType | None = None, wait_until_done: bool = True, sleep_interval: int = 30) → BenchmarkerMetadata

Benchmark the specified model on the specified device.

• Parameters:
  • input_model_path (str) – The file path where the model is located.
  • target_device_name (DeviceName) – Target device name.
  • target_software_version (Union *[*str , SoftwareVersion ] , optional) – Target software version. Required if target_device_name is one of the Jetson devices.
  • target_hardware_type (Union *[*str , HardwareType ] , optional) – Hardware type. Acceleration options for processing the model inference.
  • wait_until_done (bool) – If True, wait for the benchmark result before returning the function.
    If False, request the benchmark and return the function immediately.
• Raises:
  e – If an error occurs during the benchmarking of the model.
• Returns:
  Benchmark metadata.
• Return type:
  BenchmarkerMetadata

Example

from netspresso import NetsPresso
from netspresso.enums import DeviceName, SoftwareVersion


netspresso = NetsPresso(email="YOUR_EMAIL", password="YOUR_PASSWORD")

benchmarker = netspresso.benchmarker_v2()
benchmark_task = benchmarker.benchmark_model(
    input_model_path="./outputs/converted/TENSORRT_JETSON_AGX_ORIN_JETPACK_5_0_1/TENSORRT_JETSON_AGX_ORIN_JETPACK_5_0_1.trt",
    target_device_name=DeviceName.JETSON_AGX_ORIN,
    target_software_version=SoftwareVersion.JETPACK_5_0_1,
)