0017 gauge ordering of specs

17.

This ADR has been recorded retrospectively.

Status

Accepted

Context

Gauge executes specs in a random order if --sort flag is not specified. It tries to sort specs and then randomizes the order of specs to be executed.

Decision

Gauge should not randomize the specs, instead it should take the specs in the order given by the user or provided by the filesystem. It should sort the specs only if --sort flag is specified. If a user want to randomize the order of specs executed, it can be done by writing a simple script to do so.
The --sort flag should sort the specs in depth first order and should be based on the complete filename of the spec.

Consequences