Skip to content

Review and document ONNX testing coverage #7687

Description

@matouskozak

ONNX tests exist across transformer, integration, conversion, and sequence-type test projects. However, there is no current coverage matrix for supported scenarios, validation paths, platforms, and public APIs.

Issues such as #2500 and #3375 also show areas that need review.

Goal

Review the current ONNX test suite, document its coverage, and create focused follow-up issues for confirmed gaps.

Scope

Review coverage for:

  • Model loading from files, streams, and memory
  • Fixed, dynamic, unknown, and variable-length dimensions
  • Tensor, sequence, and map types
  • Single and multiple inputs and outputs
  • Input and output schema validation
  • Image layout, channel order, and normalization
  • Model save, load, disposal, and session options
  • CPU and GPU execution and fallback
  • Windows, Linux, and macOS
  • Output correctness against expected ONNX Runtime results
  • Use of current public APIs

Acceptance criteria

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    onnxExporting ONNX models or loading ONNX modelstestrelated to tests

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions