Test Development

How Is A New Test Version Created?

When a new version of a test is prepared for an already existing examination format, the test developer’s activity is mainly that of coordinator and advisor.

Authors

All test developers work with teams of native speaking authors, who write the subtests for the exam. Every author has long experience in foreign language didactics. Training sessions for these authors are also organised by the test developers.

Evaluation

As soon as the authors have finished their work, the prototype is evaluated. Are there discrepancies in the examination’s format? Are all subtests appropriate for the established level? Are the chosen themes relevant to the target group?

When necessary, the prototype is re-worked and then sent to several appraisers, who again carefully check each individual subtest.

Editing

The findings of the appraisers are collected and the test developer creates a preliminary version. This version is reviewed in the editors’ conference, where it is again debated and further developed.

Trial stage

When the experts have given the test version their go-ahead, the new test is sent to language courses for a trial run. Now it can be determined if the new test really meets telc’s high examination requirements.

Statistical evaluation

A test methodologist takes on the task of evaluating the trial run results, using classical and probabilistic methods of item analysis. The computed results inform the test developer which items have presented difficulties. These are altered or exchanged, and, if necessary, sent into the trial stage once again.

The final version

The final version of the examination is ready when the developer has approved the last test version, the answer key is complete and the listening activities from the listening comprehension subtest have gone through their final takes in the recording studio. Now the test is ready to be used.