Improved
Inference Interface Update and Compressor Metadata Expansion
August 29th, 2024
🚀 New Features
Inference Interface Update
- Refactored the inference interface for improved clarity and consistency.
- Provides a cleaner experience when running inference across multiple model formats.
Training Result in Compressor Metadata
- Added
training_resultfield to compressor metadata, giving users visibility into pre-compression training performance.
Data Type in Benchmark Results
- Benchmark results now include a
data_typefield, helping users evaluate performance with clearer context.
🐞 Bug Fixes
- Added
scipytorequirements.txtto resolve missing dependency issues in environments using compression or quantization. - Fixed incorrect
return_stage_idxparameter in ResNet-50 backbone configuration. - Added missing
preprocessandpostprocesssteps for full INT8 pipelines, ensuring accurate inference results.
🧠 Why these matter
- These updates improve usability and output consistency in inference and benchmarking workflows.
- Enhancing metadata structures gives users more insight into pipeline stages and improves integration with downstream tools.
- Fixes to model configuration and INT8 processing ensure correctness and stability in common deployment paths.
