4  Data quality

This chapter contains variables that are indicators of data quality.

4.1 n_data

Indicates how many questionnaire tests were completed. The number of tests differs across the various years. Values are only available starting from test wave 4. A test is only stored and therefore counted if it was completed. This means that there are no data from incomplete tests. In addition, starting from wave 6, not every test/questionnaire was administered to every pupil; instead, some tests were randomly selected from a larger pool. Contrary to num_tests_taken, it also accounts for cases in which two datasets were merged (e.g., when there are two entries because something happened during the testing session).

var_name n_data
var_stat_dyn dynamic
var_content_group data_quality
var_info_type aux
item_level_data is_no_scale
analysis_set_core FALSE
analysis_set_extended FALSE

4.2 best_shot

For this item, participants indicate the extent to which they want to do their best on the tests and questions. This item is placed at the beginning of the questionnaire.

4.2.1 Variable Information

var_name best_shot
var_stat_dyn dynamic
var_content_group data_quality
var_info_type aux
item_level_data is_no_scale
analysis_set_core TRUE
analysis_set_extended TRUE
values “TRUE” = I want to do my best; “FALSE” = No, I do not want to do my best

4.3 num_restarts

Number of times the questionnaire was started within a test session. This serves as a measure of the technical problems experienced by a participant.

4.3.1 Variable Information

var_name num_restarts
var_stat_dyn dynamic
var_content_group data_quality
var_info_type aux
item_level_data is_no_scale
analysis_set_core FALSE
analysis_set_extended FALSE

4.4 num_tests_taken

num_tests_taken is the number of list elements in an individual results list. Each completed test has one entry, plus the session data (e.g., p_id, etc.). This variable has only been available since 2017.

4.4.1 Variable Information

var_name num_tests_taken
var_stat_dyn dynamic
var_content_group data_quality
var_info_type aux
item_level_data is_no_scale
analysis_set_core FALSE
analysis_set_extended FALSE

4.5 Student Opinion Scale (SOS)

The Student Opinion Scale (SOS) is a measure of participant motivation when completing questionnaires and tests. It is a validated self-report questionnaire and is only available in the 2017 test year.

4.5.1 Variable Information

var_name SOS.effort SOS.importance
var_stat_dyn dynamic dynamic
var_content_group data_quality data_quality
var_info_type aux aux
item_level_data FALSE FALSE
analysis_set_core FALSE FALSE
analysis_set_extended FALSE FALSE
description How much effort they put into completing the questionnaire. How important doing well on the questionnaire was for the students.
number of items 5 5
response format 5-point rating scales 5-point rating scales

4.5.2 References

Sundre, D. L., & Moore, D. L. (2002). The student opinion scale: A measure of examinee motivation. Assessment Update, 14, 8–9.

4.6 LIE: Social Desirability (Lie) Scale

The scale captures the tendency to describe oneself using socially desirable attributes. Only raw data are available for this measure; therefore, it is not included in the LongGold dataset.

4.6.1 Variable Information

var_name LIE
var_stat_dyn dynamic
var_content_group data_quality
var_info_type aux
item_level_data FALSE
analysis_set_core FALSE
analysis_set_extended FALSE
description How much effort they put into completing the questionnaire.
number of items 11
response format binary true/false judgements

4.6.2 References

Carifio, J. (1994). Sensitive data and students’ tendencies to give socially desirable responses. Journal of Alcohol and Drug Education, 39, 74–84.