Package schrodinger :: Package test :: Package stu :: Module workup

Module workup

Runs workups.

Requires as input a testscript.TestScript object referring to a completed job. Uses the outcome status of the TestScript object as well as the workup protocol stored within the TestScript object to perform a workup and get a Pass/Fail (True/False) result for the test.

Actual workup criteria are in outcomes.

Functions

[hide private]

boolean

workup_outcome(test, job_dir, registered_workups=None)
Runs the outcome_workup of a given script.

check_exit_status(test)
Check that the exit status of the test matched expected.

discover_workups()
Registers all workups in outcomes and outcomes.custom.*

check_workup(test, test_id, registered_workups=None)
Runs the test's workupstr.

print_summary(scripts)
Prints the summary information at end of a execution.

Variables

[hide private]

logger = log.get_logger('test_backend')

__package__ = 'schrodinger.test.stu'

Function Details

[hide private]

workup_outcome(test, job_dir, registered_workups=None)

Runs the outcome_workup of a given script.

Parameters:

test (testscripts.TestScript) - The script to be tested.
job_dir (str) - The directory in which the job was executed

Returns: boolean

Does the test pass or fail?

check_exit_status(test)

Check that the exit status of the test matched expected. Either a good exit status or a bad one can be expected, you can't enforce that an exit status be "incorporated", for instance.

check_workup(test, test_id, registered_workups=None)

Runs the test's workupstr.

If the workup is False, raises a WorkupFailure. Note that many workups raise an AssertionError when they fail. These are automatically turned into False by the workup wrapper.

print_summary(scripts)

Prints the summary information at end of a execution.

Parameters:

scripts (dict) - a dictionary of TestScript objects. Each holds its own results information.

Returns:

Did all tests pass?