SRS_Verifier

SRS_DRAGNET_0011

SRS_DRAGNET_0011 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If the “result” field has the value “failed”, the Manual Tests shall be marked as failed.

References: none

Back References: none

SRS_DRAGNET_0012

SRS_DRAGNET_0012 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If a MTR lists files and there has been any change to the listed files after the revision specified in the “sha1” field, the Manual Test shall be marked as skipped.

References: none

Back References: none

SRS_DRAGNET_0014

SRS_DRAGNET_0014 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If a MTR lists glob patterns and any file matched by the glob pattern has changed since the revision specified in the “sha1” field then, the Manual Tests shall be marked as skipped.

References: none

Back References: none

SRS_DRAGNET_0050

SRS_DRAGNET_0050 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If the MTR lists repositories, each individual repository shall be checked.

References: SRS_DRAGNET_0051, SRS_DRAGNET_0053, SRS_DRAGNET_0059, SRS_DRAGNET_0045

Back References: none

SRS_DRAGNET_0045

SRS_DRAGNET_0045 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If the “path” attribute doesn’t point to a valid git repository the MTR shall be considered invalid.

References: none

Back References: SRS_DRAGNET_0050

SRS_DRAGNET_0059

SRS_DRAGNET_0059 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If the verification of any the listed repositories fails the MTR shall be considered invalid.

References: none

Back References: SRS_DRAGNET_0050

SRS_DRAGNET_0051

SRS_DRAGNET_0051 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If the repository lists files, Dragnet shall verify that none of those files have changed between the revision specified by the “sha1” attribute and the current revision.

References: SRS_DRAGNET_0052

Back References: SRS_DRAGNET_0050

SRS_DRAGNET_0052

SRS_DRAGNET_0052 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If changes are detected between the two revisions, the MTR shall be marked as Skipped.

References: none

Back References: SRS_DRAGNET_0051

SRS_DRAGNET_0053

SRS_DRAGNET_0053 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If no “files” attribute is given, then Dragnet shall verify that no changes have been done to the repository between the revision specified by the “sha1” attribute and the current revision.

References: SRS_DRAGNET_0054

Back References: SRS_DRAGNET_0050

SRS_DRAGNET_0054

SRS_DRAGNET_0054 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If changes are detected between the two revisions, the MTR shall be marked as Skipped.

References: none

Back References: SRS_DRAGNET_0053

SRS_DRAGNET_0015

SRS_DRAGNET_0015 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

If the MTR doesn’t list any files and there are any changes to the repository since the revision specified in the “sha1” field. (Except for the commit that introduced the Manual Test itself), then the Manual Test shall be marked as skipped.

References: none

Back References: none

SRS_DRAGNET_0016

SRS_DRAGNET_0016 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

The Manual Test is marked as passed if:
  • The “result” field’s value is “passed”.

  • There hasn’t been any changes to the files it lists (if any) since the revision specified in the “sha1” field.

  • There hasn’t been any changes on the repository since the Manual Test Record was added (if it doesn’t list any files)

  • The validation of the listed repositories (if any) pass.

References: none

Back References: none

SRS_DRAGNET_0030

SRS_DRAGNET_0030 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

The Verifier shall run through the whole set of MTR without stopping because of failures, format errors or invalid files. The results of the verification process shall be provided at the end of the run.

References: none

Back References: none

SRS_DRAGNET_0031

SRS_DRAGNET_0031 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

The verifier shall not print anything to the console, it shall be left to the exporter and or the CLI to take care of the output.

References: none

Back References: none

SRS_DRAGNET_0074

SRS_DRAGNET_0074 | accepted | ESR Labs

Tags: []

Test Setups: [“none”]

The result of the verification shall include information on when the verification was executed and how much time it took.

References: SRS_DRAGNET_0075, SRS_DRAGNET_0076, SRS_DRAGNET_0077

Back References: none

SRS_DRAGNET_0075

SRS_DRAGNET_0075 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

The result of the verification shall include a timestamp to mark the start of the verification.

References: none

Back References: SRS_DRAGNET_0074

SRS_DRAGNET_0076

SRS_DRAGNET_0076 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

The result of the verification shall include a timestamp to mark the completion of the verification.

References: none

Back References: SRS_DRAGNET_0074

SRS_DRAGNET_0077

SRS_DRAGNET_0077 | accepted | ESR Labs

Tags: [“covered”, “tested”]

Test Setups: [“off_target”]

The result of the verification shall include its runtime, this is, the number of seconds elapsed between the start and the completion of the verification.

References: none

Back References: SRS_DRAGNET_0074