Automation of running testing isolated test program on the release packages — Python

[asafpamzn]

After a python isolated program will be created — automate the installation and run of it against new release as part of the CD.

[avifenesh]

@asafpamzn Might be more efficient to separate to creating the test script to a better pythonista (If Java needed so the same) and I will take of automate it in the CI.

[asafpamzn]

@avifenesh , please create two tasks. Lets discuss it tomorrow

[Yury-Fridlyand]

We have CI with full tests which happens on every PR merge.
@GumpacG is adding smoke testing for java client RC during release process in #2128

[avifenesh]

We have CI with full tests which happens on every PR merge. @GumpacG is adding smoke testing for java client RC during release process in #2128

This test is mimicking external user?
Meaning running in a clean env, downloading the package manager and running usual user behavior?
We want to test the Released artifact during release, so we know the RC is not broken and the real release, of course.

@Yury-Fridlyand

[Yury-Fridlyand]

The test runs benchmark with minimal flag with the artifact from maven staging.