ONNX tests exist across transformer, integration, conversion, and sequence-type test projects. However, there is no current coverage matrix for supported scenarios, validation paths, platforms, and public APIs.
Issues such as #2500 and #3375 also show areas that need review.
Goal
Review the current ONNX test suite, document its coverage, and create focused follow-up issues for confirmed gaps.
Scope
Review coverage for:
- Model loading from files, streams, and memory
- Fixed, dynamic, unknown, and variable-length dimensions
- Tensor, sequence, and map types
- Single and multiple inputs and outputs
- Input and output schema validation
- Image layout, channel order, and normalization
- Model save, load, disposal, and session options
- CPU and GPU execution and fallback
- Windows, Linux, and macOS
- Output correctness against expected ONNX Runtime results
- Use of current public APIs
Acceptance criteria
ONNX tests exist across transformer, integration, conversion, and sequence-type test projects. However, there is no current coverage matrix for supported scenarios, validation paths, platforms, and public APIs.
Issues such as #2500 and #3375 also show areas that need review.
Goal
Review the current ONNX test suite, document its coverage, and create focused follow-up issues for confirmed gaps.
Scope
Review coverage for:
Acceptance criteria