CodeRunner bulk testing | University of Rwanda

Test Configuration

Number of runs per question: How many times each included question will be tested. Repeatitions will depend on Repeat random only setting.

Random seed: If set to a postive integer then the PHP randomseed is set to this value before running the test(s) for each question that has random in its name.
If you don't set the random seed then each time you do a bulk test you will get random sequences of question instances, which may mean the grade cache isn't so useful and more questions have to actually be run on the Jobe server (depending on how random your questions are).
For a given seed the sequence of random question instances should be the same (assuming your question template uses the random seed it is given correctly). Setting the random seed allows you to recreate a specific sequences of random question instances (eg, you could do 100 runs with 1 being the initial seed, then try 100 runs with 200 being the seed, etc, hopefully getting more coverage).

Repeat random only:

Limits repeated runs to questions with random in their names.

Clear course grading cache first:

This will clear the whole grading cache for the course being tested. Be careful as you will lose the whole grading cache for all student attempts on all questions in the course! This option is useful when jobe servers are being changed/updated, ie, to ensure new results are generated.

Use grading cache:

Whether or not to use the Coderunner grading cache. Turning it off means that questions will always be run on the jobe server. When doing multiple runs, this setting will help show issues with individual jobe servers when you are using a list of servers or a jobe proxy that is load sharing to multiple jobes. Deafult: true

You do not have suitable access to any CodeRunner questions

Accessibility

Reset All

Background Colour