In the previous three articles, Robyn’s team gave EPSI the task of integrating two tests into an online testing platform to evaluate over 2,000 bilingual candidates from the Canadian provinces, as well as from other parts of the world. The tests were adapted and integrated on the online testing platform and applicants were sent an email inviting them to take the tests.
In this fourth article in the series, we will now look at the actual online test-taking process.
Invitation email
As discussed in our previous article, candidates receive an email inviting them to take the tests in the hiring process(es) for which they have applied. This email contains important information to prepare and guide candidates in the online testing and ensure that they each have the best possible test experience.
The invitation email includes a detailed, step-by-step explanation to help candidates prepare for the tests and know what to do in the case of any problems. It also explains the support available to them if needed.
Start of the testing period
The invitation email contains the access codes that candidates will need to take the tests. Each access code is unique and specific to a particular person and test.
Although access codes are sent out ahead of time, they are only valid for a limited period, a set timeframe. This means it is impossible for applicants to start the tests before or after this period. This ensures that the EPSI expert and Robyn’s team can keep control over the process.
Configuring computer settings
Once the online evaluation process has been launched, hundreds of candidates visit the Compmetrica online testing platform to take their tests.
Before entering their access codes to start the tests, candidates are instructed in the invitation email to test their system and ensure they meet the minimum technical requirements to take a test on the Compmetrica online testing platform. As we will see below, this is because Robyn’s tests all take place in a secure environment. There are security features in place to prevent cheating and block access to other materials during the test. To be able to complete a test, the computer system must be properly configured; otherwise, the candidate will be disconnected from the online test automatically before he or she has a chance to view the content.
Applicants can use the “test your system” application on the platform to validate the configuration requirements. If there are any problems, step-by-step instructions are available online to resolve the situation. Users do not need any special knowledge to complete the configuration, which only takes a few minutes if needed.
Support team at the ready
EPSI’s support team is available to answer candidates’ questions at any time during the process, in English or in French. For Robyn’s process, it was agreed that basic technical support would be available to the candidates by email. Upon receiving a request, one of the support team’s metrics and assessment advisors would contact the person to answer his or her questions.
Any questions about the hiring process will be transferred to Robyn’s team, who will handle these specific issues. The success of any online process is largely dependent on the reliability of the system in place, as well as on a strong support structure that can address the various requests submitted by candidates.
Online testing process
Once their systems are properly configured, candidates enter the first access code to start the online test. At the end of the test, they enter another access code to launch the second test in this hiring process.
Before starting the test, applicants are asked to select the language in which they want to take the tests. Robyn’s tests are available in English and French and applicants are free to choose the testing language at their own discretion.
The system then asks them to confirm their identity to verify that the access code entered is indeed the one assigned to them. After agreeing to a series of statements relating to physical limitations and the handling of results and data from the current process, the test instructions appear on the monitor.
At this point, the test timer has not yet started to count down, and the candidate has not officially begun the online test. After reading through the instructions, the candidate is informed that the test will begin and that the timer will start.
“Full screen” testing
When the candidate starts the test, he or she will notice that the Internet window is displayed in full screen mode, meaning that the Windows taskbar and the web browser’s menus are hidden. From this point onward, the applicant can no longer access other programs on the computer or open other Internet windows. This mode prevents access to other programs and online materials; if a candidate attempts to work around this, he or she will be disconnected from the current test.
Each disconnection is recorded in the database, and the information can be accessed by the EPSI expert at any time to identify cases of possible cheating.
Data storage and test completion
Candidates’ answers are saved in several ways on the Compmetrica online testing platform. First, whenever a new test page is displayed, previous answers are automatically sent to the server. Candidates can also save their answers manually for the current page. Otherwise, answers for the current page will be saved automatically every five minutes. In that way, little or no information is lost in the online test in case of technical problems.
After the tests are done, the results are stored in the database and the access codes expire.
| 1. New strategy for online assessments 2. Integration of tests on the platform 3. Inviting candidates to take a test 4. Completing an online test 6. Managing responses and results 7. Lessons learned |
