Designing surveys
Publish date: 2015-10-19
Report number: FOI-R--4106--SE
Pages: 32
Written in: Swedish
Keywords:
- Survey
- questionnaire
Abstract
When developing new systems and user interfaces, it is important to take into account how the system is supposed to be used. An iterative process of evaluation in stages is essential to develop a system that meets both the developer's and user's expectations of function and appearance. Subjective ratings are vital in evaluation focused on the use of systems and interfaces. Surveys can be used to collect subjective ratings, which can form the basis for a variety of analyses depending on how the survey (and the study as a whole) has been designed. Whatever the purpose of a study, it is important to select the appropriate method for the research question at hand. In some cases it may be suitable to use an observational study or an experiment, while in other cases a combination of methods is required to answer the question. This report describes important aspects to consider when designing questionnaires. Basic concepts are covered, typical mistakes are addressed, and specific recommendations are given. The report also discusses the general work around a study which includes the choice of samples and the method of investigation, opportunities for statistical processing, as well as aspects concerning computer-based questionnaires. Irrespective of method of investigation, it is important that the research questions can be answered and that the results obtained are reliable, valid and can be generalized to the intended population. In circumstances where prerequisites for classic experimental study design are not meet, it becomes even more important to create a survey that has high quality with respect to reliability and validity. The project "Brain Budget part 2- Methodology for innovative and efficient systems development" aims to study new approaches to assessment methodology, based on a combination of different sources of information. The objective is to link new, potentially useful measures with existing data collection methods such as subjective ratings through surveys. The work is funded by the National Aviation Engineering Research Programme (NFFP-6) jointly operated by the Swedish Armed Forces, the Swedish Defence Materiel Administration, and VINNOVA.