TestGrid 0.9.0-m31

We are pleased to announce the release of TestGrid Milestone 31

TestGrid provides enterprise customers with the confidence that the products and fixes they get from WSO2 are tested against all product scenarios against a wide-array of infrastructures and deployments, hence is production-ready.

Here’s what really happens in TestGrid:

• Provision an infrastructure on AWS and other infrastructure providers via Infrastructure as Code (IAC) scripts. We use the IAC scripts provided by WSO2 for this purpose.

• Do WSO2 product deployments on top the provisioned infrastructure. We do that by running Configuration -Management scripts (Puppet/Ansible) provided for WSO2 products.

• Run JMeter/Selenium/TestNG scenarios against the deployment to certify the created deployment pattern against the given infrastructure combination.

• In the end, Testgrid generates a report that shows the outcome of the scenario tests. All is good if it is green; start worrying if it is red! :)

With this release, we provide the following,

• Implement Performance testing report generation
• Ability to monitor the last success time of the product build
• Testgrid-prod-deploy job should first delete the old wso2-testgrid before unpacking the dist
• The build jobs should use existing testgrid distribution
• Login issue in TestGrid-prod
• Persist scenario test results/artifacts in S3 in the correct build directory

List of resolved features and issues can be tracked at :
https://github.com/wso2/testgrid/milestone/30

TestGrid has been tested against following infrastructures:

• Cloud Provider: AWS and K8S-on-Openstack
• Spawn instances with AMI images in any AWS region
• Any database type AWS RDS supports (MySQL, MariaDB, PostgreSQL, SQL Server and Oracle)

Known Issues: https://github.com/wso2/testgrid/issues