OVERVIEW

The TestKit package contains:

The TestKit program;

The Tester program;

a demonstration test;

and an installation program.

The TestKit and Tester programs may be run separately  to allow for greater security in test administration.  Tests may be administered independently of the TestKit program.

 

 

Demonstration Test

Following installation, the TestKit program group contains icons for running both Tester and TestKit.  Tester may be run directly via the icon by test candidates.  By default, the Tester icon runs the demonstration test “DEMO” test in “Preview” mode.  By changing the parameters passed to Tester, any test created by TestKit may be run in this manner.

The demonstration program shows a test created with practice questions and multiple choice questions which include items with both graphics and sound.

 

TestKit

TestKit is the exam, survey and election building program which allows computerised multiple choice and short answer tests, surveys and elections to be quickly and easily constructed.

TestKit will create new exams, surveys and elections or allow construction from components of existing exams, surveys and elections.  It contains both text and graphics editing functions.

Your own scanned graphics files in popular .JPEG and GIF formats may be included in the questions.  A graphic conversion facility is also available for converting graphics files from other popular formats.

Text, graphics and question options may be placed anywhere on the screen.  During construction, each question may be previewed and the positions of different item components may be dragged to different locations.  Graphics may be resized, flipped, rotated, etc.  As well as individual questions, the entire test may be previewed during test construction.

TestKit marks the tests you create, stores and analyses the results.  TestKit maintains databases of results so that you may produce your own dynamic norms for different reference groups.  Amongst the reports produced are results in comma delimited flat file format.  If additional statistical analysis is required, this may be performed with your favourite statistical package.

The TestKit program may be used to mark and analyse existing paper-and-pencil exams using the data entry facilities provided for this purpose.  The manual entry facility may also be used to enter any additional results collected by methods other than via collection of results via running the computerized forms of the test.

TestKit includes a number of security features.  The number of runs of a test may be restricted and these runs may be bundled as a stand alone executable program to be distributed as required.  The distribution and return of these test run bundles may be recorded.  Passwords may be set to restrict access to questions and answers and to override test timing parameters.

TestKit manages the results databases, allowing the merging of results from different machines, from different classes, grades, schools, etc. in order to create large databases of norms.

Standard reports include:

Questions

The Question Report lists all the questions, option choices, answers and marks for a test.

 

Individual Answers

The Individual Answers Report may be used to list the answers given by all individuals who have performed the test, or may be restricted to the answers given by a single individual.

 

Individual Answers (comma delimited)

The Individual Answers report may be output in comma delimited format.

 

Answer Percentages

The Answer Percentages Report may be used to list the frequencies and percentages of candidates achieving each test score total and selecting each question option.

 

Sample Answer Percentages

The Sample Answer Percentages Report is used to list the frequencies and percentages of candidates achieving each test score total and selecting each question option.  Data is restricted to the last sample of candidates selected in the Sample Statistics screen of the Analyze Menu.

 

Questions HTML

The Questions HTML report type displays the code necessary to create a web page through which a test will be run.  The APPLET code clause includes all the parameters necessary to run the test.  It may be extracted and placed within your own web page.in order to run a given test.

 

 

Test Details

The Test Details report lists any details of the test which were entered in the New Test screen and any change history information which has been entered in the Open Test screen.  The fields included are the Test Name, Author, the date the test was created, the name of any relevant contact personnel, their telephone number and email address.  Any details entered when the test was created and any recorded change history when the test was opened for modification are listed after the contact details.

 

Reports based upon Individual responses may be produced with or without associated Biographical Details for the candidate.  Additional reports are also available for each test type.

 

Exams

When creating an exam, the test is definable as you choose.  Create tests with or without practice phases, modify the number of runs possible, change the timing of the practice and real phases of the test, select your own items and the placement of those items and the allowable responses within the test.  Create a test consisting of either multiple choice or short answer questions or a combination of both types of question.

Specific additional reports which are available for exams are:

Individual Results

The Individual Results report lists results for all candidates undertaking the test and may be restricted to the results for a single candidate.

 

Individual Results (comma delimited)

The Individual Results report may be output in comma delimited format.

 

Group Results

The Group Results report displays the calculated statistics for the entire test followed by the calculated statistics for each question.

 

The statistics reported are:

 

Test Mean

Test Minimum

Test Maximum

Test Mode

Test Median

Test Standard Deviation

Test Skew

Test Kurtosis

 

Question Number

Question Mean

Question Minimum

Question Maximum

Question Mode

Question Median

Question  Standard Deviation

Question Skew

Question Kurtosis

 

 

Qualitative Answers

The Qualitative Answers report is used to list the qualitative answers given by all individuals who have performed the test, or may be restricted to the qualitative answers given by a single individual.

 

 

Qualitative (comma delimited)

The Qualitative Answers report may be output in comma delimited format.

 

Sample Individual Result

The Sample Individual Result report may be used to list the results for the last subset of test results selected in the Sample Select screen of the Analyze Menu.

 

 

Sample Individual Result (comma delimited)

The comma delimited form of the Sample Individual Result report lists the same information as the Sample Individual Result report, however, labels and white spacing are omitted and the data listed is separated by commas.  This report would be used if it is intended that the data should be imported into another program for further analysis.

 

 

Sample Group Result (Statistics)

The Sample Group Result report displays the calculated statistics for the entire test followed by the calculated statistics for each question.  These statistics are based upon only the candidate responses for the last subset of test results selected in the Sample Select screen of the Analyze Menu.

 

 

Weighted Results

The Weighted Results report displays the weighted marks for each candidate based upon weightings assigned to Biographical Detail values.  These marks are obtained by applying the weight value to the candidate marks where the candidate details match the weight value defined in the Define Weights screen.

 

Surveys

Survey tests may be created using either standard or customized survey items or a combination of both types of item.  Standard items are based upon a specified number of increments.  These items would be used where a candidate is required to mark their opinion along a scale, for example, from Strongly Agree to Strongly Disagree,

Customised survey items allow the test constructor to specify what will appear on the option.  For example, “Do you agree that …..?”:

 

 

Elections

Election tests are used where the candidate must respond with a ranking response such as in an election.  For example, a question might be “Who should be Prime Minister?”.  The candidate would respond by ranking the available choices, as in the following:

Note that the answers may be assigned to a group, such as a party and when the results are analysed the ranks may be reassigned based upon these groupings.

Additional reports available for elections are:

Election Rankings

The Election Rankings report displays the rank assigned to each Candidate by each respondent.  At the end of the individual candidate rankings, total frequencies of respondents selecting each candidate are listed.

 

 

Election Rankings (comma delimited)

The comma delimited Election Rankings report displays the rank assigned to each Candidate by each respondent in comma delimited format.  The fields listed are Run ID, Question Number, Candidate/Option number and assigned ranking.  Additional Biographical Details may be included in the report by using the Select Button.  The report may be restricted to a single Run ID by entering the Run ID in the Run ID field.

 

Weighted Elections

The Weighted Elections report displays the calculated statistics for the election based upon weightings selected for use by the election.  Weights are applied to frequencies calculated for the election where the candidate details match the Weight Value defined using the Weight Button on the Define Election screen and the last weight name used in the Sample Select screen of the Analyze Menu.

 

 

Election Results Reallocated

The Election Results Reallocated report displays the calculated statistics for a reallocated election followed by the calculated statistics for each question.  These statistics are based upon the candidate responses for the last subset of reallocations selected in the Reallocation screen of the Analyze Menu.  The data variables included in this report are the same as for the Group Result (Statistics).

 

Election Rankings Reallocated

The Election Rankings Reallocated report displays the rank assigned to each Candidate by each respondent after party reallocations have been applied.  The fields listed are Run ID, Question Number, Candidate number and assigned ranking

 

Albums

The testing format provided by TestKit may also be used to display items which may include sound, graphics and text but do not require a candidate response.  An example of this use would be for a photograph album or illustrated book.  The Album type is included for this purpose.

 

Custom

Tests may be created using any of the above item types.  As survey and election results are based upon frequencies, whereas exam results are based upon scores, the results from the different types cannot be combined but rather are displayed separately.

 

Tester

Tester is the test driving program which runs the tests constructed according to the parameters defined in TestKit.  It records candidate details and marks the tests.  It has a unique interface which makes it possible to administer tests to candidates who have little or no computer experience.

Test timing is enforced. It is not possible for candidates to "squeeze" in one more answer after the "clock has stopped".  If the test administrator wishes to override test timing parameters, this may be done by entering a password in either the practice or real phase of the test.

The Help Button allows users to display an analog clock of the current time and details of the number of questions answered and the number of questions remaining to be answered.

When correctly installed, candidates are prevented from exiting from the test and accessing other important files on your machine.