Projects per year
Abstract
Background: Internet-based data collection relies on well-designed and validated questionnaires. The theory behind designing and validating questionnaires is well described, but few practical examples of how to approach validation are available in the literature.
Objective: We aimed to validate data collected in an ongoing Internet-based longitudinal health study through direct visits to participants and recall of their health records. We demonstrate that despite extensive pre-planning, social desirability can still affect data in unexpected ways and that anticipation of poor quality data may be confounded by positive validation.
Methods: Dogslife is a large-scale, Web-based longitudinal study of canine health, in which owners of Labrador Retrievers were recruited and questioned at regular intervals about the lifestyle and health of their dogs using an Internet-based questionnaire. The Dogslife questionnaire predominantly consists of closed-answer questions. In our work, two separate validation methodologies were used: (1) direct interviews with 43 participants during visits to their households and (2) comparison of owner-entered health reports with 139 historical health records.
Results: Our results indicate that user-derived measures should not be regarded as a single category; instead, each measurement should be considered separately as each presents its own challenge to participants. We recommend trying to ascertain the extent of recall decay within a study and, if necessary, using this to guide data collection timepoints and analyses. Finally, we recommend that multiple methods of communication facilitate validation studies and aid cohort engagement.
Conclusions: Our study highlighted how the theory underpinning online questionnaire design and validation translates into practical data issues when applied to Internet-based studies. Validation should be regarded as an extension of questionnaire design, and that validation work should commence as soon as sufficient data are available. We believe that validation is a crucial step and hope our suggested guidelines will help facilitate validation of other Internet-based cohort studies.
Objective: We aimed to validate data collected in an ongoing Internet-based longitudinal health study through direct visits to participants and recall of their health records. We demonstrate that despite extensive pre-planning, social desirability can still affect data in unexpected ways and that anticipation of poor quality data may be confounded by positive validation.
Methods: Dogslife is a large-scale, Web-based longitudinal study of canine health, in which owners of Labrador Retrievers were recruited and questioned at regular intervals about the lifestyle and health of their dogs using an Internet-based questionnaire. The Dogslife questionnaire predominantly consists of closed-answer questions. In our work, two separate validation methodologies were used: (1) direct interviews with 43 participants during visits to their households and (2) comparison of owner-entered health reports with 139 historical health records.
Results: Our results indicate that user-derived measures should not be regarded as a single category; instead, each measurement should be considered separately as each presents its own challenge to participants. We recommend trying to ascertain the extent of recall decay within a study and, if necessary, using this to guide data collection timepoints and analyses. Finally, we recommend that multiple methods of communication facilitate validation studies and aid cohort engagement.
Conclusions: Our study highlighted how the theory underpinning online questionnaire design and validation translates into practical data issues when applied to Internet-based studies. Validation should be regarded as an extension of questionnaire design, and that validation work should commence as soon as sufficient data are available. We believe that validation is a crucial step and hope our suggested guidelines will help facilitate validation of other Internet-based cohort studies.
Original language | English |
---|---|
Article number | e96 |
Journal | Journal of medical Internet research |
Volume | 17 |
Issue number | 4 |
DOIs | |
Publication status | Published - 16 Apr 2015 |
Fingerprint
Dive into the research topics of 'Validity of Internet-Based Longitudinal Study Data: The elephant in the virtual room'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Dogslife: An epidemiological study of canine health
Clements, D., Bronsvoort, M., Handel, I. & Summers, K.
1/01/10 → 30/06/14
Project: Research
-
Doctoral training grant for 16 students
Hume, D., Goldmann, W. & MacRae, V.
1/10/09 → 30/09/15
Project: Research
-
DOGSLIFE: A COHORT STUDY OF LABRADOR RETRIEVER HEALTH
Pugh, C., Summers, K., Bronsvoort, M., Handel, I. & Clements, D., 2015.Research output: Contribution to conference › Paper › peer-review
-
Dogslife: a cohort study of Labrador retrievers in the UK
Pugh, C., Bronsvoort, M., Handel, I., Summers, K. & Clements, D., 2015, In: Preventive Veterinary Medicine. 122, 4 Sp. Iss. S1, p. 426-435Research output: Contribution to journal › Article › peer-review
Open AccessFile -
Owner Reported Illness Signs
Pugh, C., Clements, D., Summers, K., Handel, I. & Bronsvoort, M., 2014.Research output: Contribution to conference › Paper
Press/Media
-
Labradors at risk from ‘middle age spread’, says Dr Dylan Clements
28/10/15
8 items of Media coverage
Press/Media: Research
Profiles
-
Dylan Clements
- Royal (Dick) School of Veterinary Studies - Personal Chair of Small Animal Orthopaedics
Person: Academic: Research Active