ITT support

[joniohtonen]

ITT enablement through a new run-benchmark action version with a dedicated workflow.

Background

MLflow-based inference testing tool support is a previously planned feature to consolidate all benchmarking under one tool. This brings additional benefits, like long-term private storage for the results and the artifacts.

Goals

Benchmarking workflow that utilizes ITT for running the benchmarks.

Tasks

• Implement new action and required scripting
  • Implement configuration parser/converter as ITT uses its own format for workload configurations
• Implement new workflow

Tests

• E2E run here

Other

• Implemented as an alternate workflow and action version to be thoroughly evaluated before implementing it as the de facto benchmarking suite
• Requires setting up a dedicated runner