[Feature] Allow selected metadata fields to be ignored during tests.

[daw3rd]

Search before asking

• I searched the issues and found no similar issues.

Component

Library/core

Feature

Some transforms may produce non-repeatable metadata. For example, time to execute. In this case, the expected metadata will generally not match the test-generated metadata. It would be good to have a way to specify which keys of the metadata should be ignored in the comparison of test-generated and expected metadata.

Note, we have something similar for the parquet files in that we can specify which columns to not compare.

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[daw3rd]

This will need to be done for both the pure transform test and the launcher-based tests.

[blublinsky]

Wait, we do not compare metadata