Validation of CyberTest Future Soldiers

Authors:

  • Patrik Lif
  • Pär-Anders Albinsson
  • Christian Valassi
  • Daniel Eidenskog

Publish date: 2021-08-30

Report number: FOI-R--5165--SE

Pages: 24

Written in: Swedish

Keywords:

  • cyber test
  • validation
  • reliability
  • test fairness
  • CTFS 2020
  • CTFS
  • cyber defence

Abstract

The Swedish Defence Research Agency (FOI) has developed a cyber test on behalf of the Swedish Armed Forces in order to support the Swedish Defence Conscription and Assessment Agency in their selection of cyber soldier conscripts. The test has been utilized in the extended mustering in 2020 and 2021. It has been evaluated on the basis of an international standard, which describes quality assurance for psychological tests concerning validity, reliability and fairness. Selection of cyber soldier conscripts is based on the I-test taken during regular mustering combined with the theoretical cyber test developed by FOI and a practical test, both taken during extended mustering. The theoretical test will be evaluated in three phases: selection, education, and service. Thus far, it has only been possible to evaluate the test in the first phase, due to the fact that the education phase is yet to be completed. The analyses of the first phase indicate positive results and currently only minor corrections have been deemed necessary. These initial analyses also indicate that the relationship between I-test, theoretical test and practical test is as expected, which means that the three tests positively complement each other.