Skip to main content

Welkom bij St. Antonius Academie & Bohn Stafleu van Loghum

St. Antonius Academie heeft ervoor gezorgd dat je Mijn BSL eenvoudig en snel kunt raadplegen. Je kunt je links eenvoudig registreren. Met deze gegevens kun je thuis, of waar ook ter wereld toegang krijgen tot Mijn BSL. Heb je een vraag, neem dan contact op met René Schuwer.

Registreer

Om ook buiten de locaties van St. Antonius Academie, thuis bijvoorbeeld, van Mijn BSL gebruik te kunnen maken, moet u zich eenmalig registreren. Dit kan alleen vanaf een computer op een van de locaties van St. Antonius Academie.

Eenmaal geregistreerd kunt u thuis of waar ook ter wereld onbeperkt toegang krijgen tot Mijn BSL.

Login

Als u al geregistreerd bent, hoeft u alleen maar in te loggen om onbeperkt toegang te krijgen tot Mijn BSL.

Top

25-04-2025

Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review

Auteurs: Caroline Seo, Sophia Hu, Bellinda L. King-Kallimanis, Ashley E. Chang, Antoine Regnault, Amitai S. Miller, Manraj N. Kaur

Gepubliceerd in: Quality of Life Research

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Qualitative data that reflects patients’ experiences are the foundation of any patient-reported outcome measure (PROM) development and validation study; however, there is limited understanding of the type of data visualization techniques that facilitate communication of this data. The goal of this targeted literature review was to investigate data visualization methods that have been used in published PROM development and validation literature to report qualitative results.

Methods

A literature search in OVID via MEDLINE was conducted among the top 10 non-disease-specific journals publishing PROM qualitative development and validation studies. Studies that reported qualitative methods to develop/validate a PROM and included data visualization in the form of tables or figures were included. Article characteristics and data visualization types were extracted.

Results

A total of 185 articles were included in data extraction. Most articles (n = 109, 59.1%) included figures (n = 172, average 2 relevant figures per article) in the form of hierarchy/flowcharts (n = 124, 72.1%) and bar charts (n = 29, 16.9%). Information reported in figures included depiction of conceptual frameworks (n = 112, 65.1%) and concept frequency (n = 40, 24.4%). Most articles (n = 152, 81.7%) included tables (n = 307, average 2 relevant tables per article). Information reported in tables included concept frequency (n = 133, 43.3%) and cognitive debriefing and revisions (n = 91, 29.6%).

Conclusion

Data visualization techniques used to report qualitative results in the identified PROM qualitative development and validation studies were heterogeneous, and many studies did not utilize any data visualization techniques. This study will inform the development of guidance for using data visualizations to report qualitative PROM research.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
2.
go back to reference Wolff, A. C., Dresselhuis, A., Hejazi, S., Dixon, D., Gibson, D., Howard, A. F., et al. (2021). Healthcare provider characteristics that influence the implementation of individual-level Patient-Centered Outcome Measure (PROM) and Patient-Reported Experience Measure (PREM) data across practice settings: a protocol for a mixed methods systematic review with a narrative synthesis. Systematic Reviews, 10(1), 169. https://doi.org/10.1186/s13643-021-01725-2CrossRefPubMedPubMedCentral Wolff, A. C., Dresselhuis, A., Hejazi, S., Dixon, D., Gibson, D., Howard, A. F., et al. (2021). Healthcare provider characteristics that influence the implementation of individual-level Patient-Centered Outcome Measure (PROM) and Patient-Reported Experience Measure (PREM) data across practice settings: a protocol for a mixed methods systematic review with a narrative synthesis. Systematic Reviews, 10(1), 169. https://​doi.​org/​10.​1186/​s13643-021-01725-2CrossRefPubMedPubMedCentral
9.
go back to reference Krogsgaard, M. R., Brodersen, J., Christensen, K. B., Siersma, V., Jensen, J., Hansen, C. F., et al. (2021). How to translate and locally adapt a PROM. Assessment of cross-cultural differential item functioning. Scandinavian Journal of Medicine and Science in Sports, 31(5), 999–1008. https://doi.org/10.1111/sms.13854CrossRefPubMed Krogsgaard, M. R., Brodersen, J., Christensen, K. B., Siersma, V., Jensen, J., Hansen, C. F., et al. (2021). How to translate and locally adapt a PROM. Assessment of cross-cultural differential item functioning. Scandinavian Journal of Medicine and Science in Sports, 31(5), 999–1008. https://​doi.​org/​10.​1111/​sms.​13854CrossRefPubMed
12.
go back to reference Morse, J. M. (1994). Critical issues in qualitative research methods. Thousand Oaks: SAGE. Morse, J. M. (1994). Critical issues in qualitative research methods. Thousand Oaks: SAGE.
14.
go back to reference Slone, D. J. (2009). Visualizing qualitative information. Qual Rep, 14(3), 489–497. Slone, D. J. (2009). Visualizing qualitative information. Qual Rep, 14(3), 489–497.
20.
go back to reference Arnet, I., Messerli, M., Oezvegyi, J., Hersberger, K., & Sahm, L. (2020). Translation to English, cross-cultural adaptation, and pilot testing of the self-report questionnaire on swallowing difficulties with medication intake and coping strategies (SWAMECO) for adults with polypharmacy. British Medical Journal Open, 10(8), e036761. https://doi.org/10.1136/bmjopen-2020-036761CrossRef Arnet, I., Messerli, M., Oezvegyi, J., Hersberger, K., & Sahm, L. (2020). Translation to English, cross-cultural adaptation, and pilot testing of the self-report questionnaire on swallowing difficulties with medication intake and coping strategies (SWAMECO) for adults with polypharmacy. British Medical Journal Open, 10(8), e036761. https://​doi.​org/​10.​1136/​bmjopen-2020-036761CrossRef
22.
34.
42.
go back to reference Ruzich, E., Ritchie, J., Ginchereau Sowell, F., Mansur, A., Griffiths, P., Birkett, H., et al. (2024). A powerful partnership: researchers and patients working together to develop a patient-facing summary of clinical trial outcome data. Journal of the American Medical Informatics Association, 31(2), 363–374. https://doi.org/10.1093/jamia/ocad099CrossRefPubMed Ruzich, E., Ritchie, J., Ginchereau Sowell, F., Mansur, A., Griffiths, P., Birkett, H., et al. (2024). A powerful partnership: researchers and patients working together to develop a patient-facing summary of clinical trial outcome data. Journal of the American Medical Informatics Association, 31(2), 363–374. https://​doi.​org/​10.​1093/​jamia/​ocad099CrossRefPubMed
46.
go back to reference Nguyen, A. M., Humphrey, L., Kitchen, H., Rehman, T., & Norquist, J. M. (2015). A qualitative study to develop a patient-reported outcome for dysmenorrhea. Quality of Life Research, 24, 181–191.PubMedCrossRef Nguyen, A. M., Humphrey, L., Kitchen, H., Rehman, T., & Norquist, J. M. (2015). A qualitative study to develop a patient-reported outcome for dysmenorrhea. Quality of Life Research, 24, 181–191.PubMedCrossRef
47.
go back to reference Tatlock, S., Grant, L., Spertus, J. A., Khan, I., Arbuckle, R., Manvelian, G., & Sanchez, R. J. (2015). Development and content validity testing of a patient-reported treatment acceptance measure for use in patients receiving treatment via subcutaneous injection. Value Health, 18(8), 1000–1007.PubMedCrossRef Tatlock, S., Grant, L., Spertus, J. A., Khan, I., Arbuckle, R., Manvelian, G., & Sanchez, R. J. (2015). Development and content validity testing of a patient-reported treatment acceptance measure for use in patients receiving treatment via subcutaneous injection. Value Health, 18(8), 1000–1007.PubMedCrossRef
48.
go back to reference Borghs, S., Tomaszewski, E. L., Halling, K., & de la Loge, C. (2016). Understanding the patient perspective of seizure severity in epilepsy: development of a conceptual model. Patient, 9, 419–431.PubMedCrossRef Borghs, S., Tomaszewski, E. L., Halling, K., & de la Loge, C. (2016). Understanding the patient perspective of seizure severity in epilepsy: development of a conceptual model. Patient, 9, 419–431.PubMedCrossRef
51.
go back to reference Gater, A., Nelsen, L., Fleming, S., Lundy, J. J., Bonner, N., Hall, R., et al. (2016). Assessing asthma symptoms in adolescents and adults: qualitative research supporting development of the asthma daily symptom diary. Value Health, 19(4), 440–450.PubMedCrossRef Gater, A., Nelsen, L., Fleming, S., Lundy, J. J., Bonner, N., Hall, R., et al. (2016). Assessing asthma symptoms in adolescents and adults: qualitative research supporting development of the asthma daily symptom diary. Value Health, 19(4), 440–450.PubMedCrossRef
54.
go back to reference Tatlock, S., Rüdell, K., Panter, C., Arbuckle, R., Harrold, L. R., Taylor, W. J., & Symonds, T. (2017). What outcomes are important for gout patients? In-depth qualitative research into the gout patient experience to determine optimal endpoints for evaluating therapeutic interventions. Patient, 10(1), 65–79. https://doi.org/10.1007/s40271-016-0184-xCrossRefPubMed Tatlock, S., Rüdell, K., Panter, C., Arbuckle, R., Harrold, L. R., Taylor, W. J., & Symonds, T. (2017). What outcomes are important for gout patients? In-depth qualitative research into the gout patient experience to determine optimal endpoints for evaluating therapeutic interventions. Patient, 10(1), 65–79. https://​doi.​org/​10.​1007/​s40271-016-0184-xCrossRefPubMed
69.
go back to reference Fehnel, S. E., Ervin, C. M., Carson, R. T., Rigoni, G., Lackner, J. M., & Coons, S. J. (2017). Development of the diary for irritable bowel syndrome symptoms to assess treatment benefit in clinical trials: foundational qualitative research. Value Health, 20(4), 618–626.PubMedCrossRef Fehnel, S. E., Ervin, C. M., Carson, R. T., Rigoni, G., Lackner, J. M., & Coons, S. J. (2017). Development of the diary for irritable bowel syndrome symptoms to assess treatment benefit in clinical trials: foundational qualitative research. Value Health, 20(4), 618–626.PubMedCrossRef
70.
go back to reference Leffler, D. A., Acaster, S., Gallop, K., Dennis, M., Kelly, C. P., & Adelman, D. C. (2017). A novel patient-derived conceptual model of the impact of celiac disease in adults: implications for patient-reported outcome and health-related quality-of-life instrument development. Value Health, 20(4), 637–643.PubMedCrossRef Leffler, D. A., Acaster, S., Gallop, K., Dennis, M., Kelly, C. P., & Adelman, D. C. (2017). A novel patient-derived conceptual model of the impact of celiac disease in adults: implications for patient-reported outcome and health-related quality-of-life instrument development. Value Health, 20(4), 637–643.PubMedCrossRef
71.
go back to reference Kleinman, L., Talbot, G. H., Hunsche, E., Schüler, R., & Nord, C. E. (2018). The CDI-DaySyms: content development of a new patient-reported outcome questionnaire for symptoms of Clostridium difficile infection. Value Health, 21(4), 441–448.PubMedCrossRef Kleinman, L., Talbot, G. H., Hunsche, E., Schüler, R., & Nord, C. E. (2018). The CDI-DaySyms: content development of a new patient-reported outcome questionnaire for symptoms of Clostridium difficile infection. Value Health, 21(4), 441–448.PubMedCrossRef
72.
go back to reference Hudgens, S., Schüler, R., Stokes, J., Eremenco, S., Hunsche, E., & Leist, T. P. (2019). Development and validation of the FSIQ-RMS: a new patient-reported questionnaire to assess symptoms and impacts of fatigue in relapsing multiple sclerosis. Value Health, 22(4), 453–466.PubMedCrossRef Hudgens, S., Schüler, R., Stokes, J., Eremenco, S., Hunsche, E., & Leist, T. P. (2019). Development and validation of the FSIQ-RMS: a new patient-reported questionnaire to assess symptoms and impacts of fatigue in relapsing multiple sclerosis. Value Health, 22(4), 453–466.PubMedCrossRef
79.
go back to reference Howard, K., Berry, P., Petrillo, J., Wiklund, I., Roberts, L., Watkins, M., et al. (2012). Development of the Shortness of Breath with Daily Activities questionnaire (SOBDA). Value Health, 15(8), 1042–1050.PubMedCrossRef Howard, K., Berry, P., Petrillo, J., Wiklund, I., Roberts, L., Watkins, M., et al. (2012). Development of the Shortness of Breath with Daily Activities questionnaire (SOBDA). Value Health, 15(8), 1042–1050.PubMedCrossRef
80.
go back to reference Dowling, A., Slungaard, E., & Heneghan, N. R. (2021). Development of a patient-reported outcome measure for neck pain in military aircrew: qualitative interviews to inform design and content. British Medical Journal Open, 11(2), e039488. Dowling, A., Slungaard, E., & Heneghan, N. R. (2021). Development of a patient-reported outcome measure for neck pain in military aircrew: qualitative interviews to inform design and content. British Medical Journal Open, 11(2), e039488.
81.
go back to reference Lewis, S., Price, M., Dwyer, K. A., O’Brien, S., Heekin, R. D., Yates, P. J., et al. (2014). Development of a scale to assess performance following primary total knee arthroplasty. Value Health, 17(4), 350–359.PubMedCrossRef Lewis, S., Price, M., Dwyer, K. A., O’Brien, S., Heekin, R. D., Yates, P. J., et al. (2014). Development of a scale to assess performance following primary total knee arthroplasty. Value Health, 17(4), 350–359.PubMedCrossRef
87.
go back to reference Hamilton, C. B., Hoens, A. M., McQuitty, S., McKinnon, A. M., English, K., Backman, C. L., et al. (2018). Development and pre-testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS ONE, 13(11), e0206588.PubMedPubMedCentralCrossRef Hamilton, C. B., Hoens, A. M., McQuitty, S., McKinnon, A. M., English, K., Backman, C. L., et al. (2018). Development and pre-testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS ONE, 13(11), e0206588.PubMedPubMedCentralCrossRef
88.
go back to reference Holm-Larsen, T., Andersson, F., van der Meulen, E., Yankov, V., Rosen, R. C., & Nørgaard, J. P. (2014). The nocturia impact diary: a self-reported impact measure to complement the voiding diary. Value Health, 17(6), 696–706.PubMedCrossRef Holm-Larsen, T., Andersson, F., van der Meulen, E., Yankov, V., Rosen, R. C., & Nørgaard, J. P. (2014). The nocturia impact diary: a self-reported impact measure to complement the voiding diary. Value Health, 17(6), 696–706.PubMedCrossRef
89.
go back to reference Toupin April, K., Stinson, J., Boon, H., Duffy, C. M., Huber, A. M., Gibbon, M., et al. (2016). Development and preliminary face and content validation of the “Which health approaches and treatments are you using?”(WHAT) Questionnaires assessing complementary and alternative medicine use in pediatric rheumatology. PLoS ONE, 11(3), e0149809.PubMedPubMedCentralCrossRef Toupin April, K., Stinson, J., Boon, H., Duffy, C. M., Huber, A. M., Gibbon, M., et al. (2016). Development and preliminary face and content validation of the “Which health approaches and treatments are you using?”(WHAT) Questionnaires assessing complementary and alternative medicine use in pediatric rheumatology. PLoS ONE, 11(3), e0149809.PubMedPubMedCentralCrossRef
90.
go back to reference Alberts, J., Löwe, B., Glahn, M. A., Petrie, K., Laferton, J., Nestoriuc, Y., & Shedden-Mora, M. (2020). Development of the generic, multidimensional Treatment Expectation Questionnaire (TEX-Q) through systematic literature review, expert surveys and qualitative interviews. British Medical Journal Open, 10(8), e036169. Alberts, J., Löwe, B., Glahn, M. A., Petrie, K., Laferton, J., Nestoriuc, Y., & Shedden-Mora, M. (2020). Development of the generic, multidimensional Treatment Expectation Questionnaire (TEX-Q) through systematic literature review, expert surveys and qualitative interviews. British Medical Journal Open, 10(8), e036169.
93.
go back to reference Williams, L. A., Whisenant, M. S., Mendoza, T. R., Haq, S., Keating, K. N., Cuffel, B., & Cleeland, C. S. (2018). Modification of existing patient-reported outcome measures: qualitative development of the MD Anderson Symptom Inventory for Malignant Pleural Mesothelioma (MDASI-MPM). Quality of Life Research, 27(12), 3229–3241. https://doi.org/10.1007/s11136-018-1982-5CrossRefPubMed Williams, L. A., Whisenant, M. S., Mendoza, T. R., Haq, S., Keating, K. N., Cuffel, B., & Cleeland, C. S. (2018). Modification of existing patient-reported outcome measures: qualitative development of the MD Anderson Symptom Inventory for Malignant Pleural Mesothelioma (MDASI-MPM). Quality of Life Research, 27(12), 3229–3241. https://​doi.​org/​10.​1007/​s11136-018-1982-5CrossRefPubMed
96.
go back to reference Carney, M. J., Golden, K. E., Weissler, J. M., Lanni, M. A., Bauder, A. R., Cakouros, B., et al. (2018). Patient-reported outcomes following ventral hernia repair: designing a qualitative assessment tool. Patient, 11, 225–234.PubMedCrossRef Carney, M. J., Golden, K. E., Weissler, J. M., Lanni, M. A., Bauder, A. R., Cakouros, B., et al. (2018). Patient-reported outcomes following ventral hernia repair: designing a qualitative assessment tool. Patient, 11, 225–234.PubMedCrossRef
98.
go back to reference McKenna, S. P., Meads, D. M., Doward, L. C., Twiss, J., Pokrzywinski, R., Revicki, D., et al. (2011). Development and validation of the living with chronic obstructive pulmonary disease questionnaire. Quality of Life Research, 20, 1043–1052.PubMedCrossRef McKenna, S. P., Meads, D. M., Doward, L. C., Twiss, J., Pokrzywinski, R., Revicki, D., et al. (2011). Development and validation of the living with chronic obstructive pulmonary disease questionnaire. Quality of Life Research, 20, 1043–1052.PubMedCrossRef
99.
go back to reference Abetz, L., Rajagopalan, K., Mertzanis, P., Begley, C., Barnes, R., Chalmers, R., The impact of dry eye on everyday life (IDEEL) Study Group. (2011). Development and validation of the Impact of Dry Eye on Everyday Life (IDEEL) questionnaire, a Patient-Reported Outcomes (PRO) measure for the assessment of the burden of dry eye on patients. Health and Quality of Life Outcomes, 9(1), 111. https://doi.org/10.1186/1477-7525-9-111CrossRefPubMedPubMedCentral Abetz, L., Rajagopalan, K., Mertzanis, P., Begley, C., Barnes, R., Chalmers, R., The impact of dry eye on everyday life (IDEEL) Study Group. (2011). Development and validation of the Impact of Dry Eye on Everyday Life (IDEEL) questionnaire, a Patient-Reported Outcomes (PRO) measure for the assessment of the burden of dry eye on patients. Health and Quality of Life Outcomes, 9(1), 111. https://​doi.​org/​10.​1186/​1477-7525-9-111CrossRefPubMedPubMedCentral
101.
go back to reference Brod, M., Blum, S. I., Bushnell, D. M., & Ramasamy, A. (2015). Development and validation of the Diabetic Peripheral Neuropathic Pain Impact (DPNPI) measure, a patient-reported outcome measure. Quality of Life Research, 24, 3001–3014.PubMedCrossRef Brod, M., Blum, S. I., Bushnell, D. M., & Ramasamy, A. (2015). Development and validation of the Diabetic Peripheral Neuropathic Pain Impact (DPNPI) measure, a patient-reported outcome measure. Quality of Life Research, 24, 3001–3014.PubMedCrossRef
103.
go back to reference Howells, L. M., Chalmers, J. R., Cowdell, F., Ratib, S., Santer, M., & Thomas, K. S. (2017). ‘When it goes back to my normal I suppose’: a qualitative study using online focus groups to explore perceptions of ‘control’among people with eczema and parents of children with eczema in the UK. British Medical Journal Open, 7(11), e017731. Howells, L. M., Chalmers, J. R., Cowdell, F., Ratib, S., Santer, M., & Thomas, K. S. (2017). ‘When it goes back to my normal I suppose’: a qualitative study using online focus groups to explore perceptions of ‘control’among people with eczema and parents of children with eczema in the UK. British Medical Journal Open, 7(11), e017731.
104.
go back to reference Leidy, N. K., Wilcox, T. K., Jones, P. W., Murray, L., Winnette, R., Howard, K., et al. (2010). Development of the EXAcerbations of Chronic Obstructive Pulmonary Disease Tool (EXACT): a Patient-Reported Outcome (PRO) measure. Value Health, 13(8), 965–975.PubMedCrossRef Leidy, N. K., Wilcox, T. K., Jones, P. W., Murray, L., Winnette, R., Howard, K., et al. (2010). Development of the EXAcerbations of Chronic Obstructive Pulmonary Disease Tool (EXACT): a Patient-Reported Outcome (PRO) measure. Value Health, 13(8), 965–975.PubMedCrossRef
105.
go back to reference Luquiens, A., Whalley, D., Crawford, S. R., Laramée, P., Doward, L., Price, M., et al. (2015). Development of the Alcohol Quality of Life Scale (AQoLS): a new patient-reported outcome measure to assess health-related quality of life in alcohol use disorder. Quality of Life Research, 24(6), 1471–1481. https://doi.org/10.1007/s11136-014-0865-7CrossRefPubMed Luquiens, A., Whalley, D., Crawford, S. R., Laramée, P., Doward, L., Price, M., et al. (2015). Development of the Alcohol Quality of Life Scale (AQoLS): a new patient-reported outcome measure to assess health-related quality of life in alcohol use disorder. Quality of Life Research, 24(6), 1471–1481. https://​doi.​org/​10.​1007/​s11136-014-0865-7CrossRefPubMed
107.
114.
go back to reference Krenz, U., Timmermann, D., Gorbunova, A., Lendt, M., Schmidt, S., & von Steinbuechel, N. (2021). Health-related quality of life after pediatric traumatic brain injury: a qualitative comparison between children’s and parents’ perspectives. PLoS ONE, 16(2), e0246514.PubMedPubMedCentralCrossRef Krenz, U., Timmermann, D., Gorbunova, A., Lendt, M., Schmidt, S., & von Steinbuechel, N. (2021). Health-related quality of life after pediatric traumatic brain injury: a qualitative comparison between children’s and parents’ perspectives. PLoS ONE, 16(2), e0246514.PubMedPubMedCentralCrossRef
118.
go back to reference Robertson, A. O., Tadić, V., & Rahi, J. S. (2021). This is me: a qualitative investigation of young people’s experience of growing up with visual impairment. PLoS ONE, 16(7), e0254009.PubMedPubMedCentralCrossRef Robertson, A. O., Tadić, V., & Rahi, J. S. (2021). This is me: a qualitative investigation of young people’s experience of growing up with visual impairment. PLoS ONE, 16(7), e0254009.PubMedPubMedCentralCrossRef
119.
120.
go back to reference McCaffrey, N., Skuza, P., Breaden, K., Eckermann, S., Hardy, J., Oaten, S., et al. (2014). Preliminary development and validation of a new end-of-life patient-reported outcome measure assessing the ability of patients to finalise their affairs at the end of life. PLoS ONE, 9(4), e94316.PubMedPubMedCentralCrossRef McCaffrey, N., Skuza, P., Breaden, K., Eckermann, S., Hardy, J., Oaten, S., et al. (2014). Preliminary development and validation of a new end-of-life patient-reported outcome measure assessing the ability of patients to finalise their affairs at the end of life. PLoS ONE, 9(4), e94316.PubMedPubMedCentralCrossRef
121.
go back to reference Deal, L. S., Williams, V. S., & Fehnel, S. E. (2011). Development of an electronic daily uterine fibroid symptom diary. Patient, 4, 31–44.PubMedCrossRef Deal, L. S., Williams, V. S., & Fehnel, S. E. (2011). Development of an electronic daily uterine fibroid symptom diary. Patient, 4, 31–44.PubMedCrossRef
122.
go back to reference Eberhart, N. K., Sherbourne, C. D., Edelen, M. O., Stucky, B. D., Sin, N. L., & Lara, M. (2014). Development of a measure of asthma-specific quality of life among adults. Quality of Life Research, 23, 837–848.PubMedCrossRef Eberhart, N. K., Sherbourne, C. D., Edelen, M. O., Stucky, B. D., Sin, N. L., & Lara, M. (2014). Development of a measure of asthma-specific quality of life among adults. Quality of Life Research, 23, 837–848.PubMedCrossRef
124.
go back to reference Dür, M., Coenen, M., Stoffer, M. A., Fialka-Moser, V., Kautzky-Willer, A., Kjeken, I., et al. (2015). Do patient-reported outcome measures cover personal factors important to people with rheumatoid arthritis? A mixed methods design using the International Classification of Functioning, Disability and Health as frame of reference. Health and Quality of Life Outcomes, 13(1), 27. https://doi.org/10.1186/s12955-015-0214-8CrossRefPubMedPubMedCentral Dür, M., Coenen, M., Stoffer, M. A., Fialka-Moser, V., Kautzky-Willer, A., Kjeken, I., et al. (2015). Do patient-reported outcome measures cover personal factors important to people with rheumatoid arthritis? A mixed methods design using the International Classification of Functioning, Disability and Health as frame of reference. Health and Quality of Life Outcomes, 13(1), 27. https://​doi.​org/​10.​1186/​s12955-015-0214-8CrossRefPubMedPubMedCentral
126.
go back to reference Sinclair, S., Jaggi, P., Hack, T. F., Russell, L., McClement, S. E., Cuthbertson, L., et al. (2020). Initial validation of a patient-reported measure of compassion: determining the content validity and clinical sensibility among patients living with a life-limiting and incurable illness. Patient, 13(3), 327–337. https://doi.org/10.1007/s40271-020-00409-8CrossRefPubMed Sinclair, S., Jaggi, P., Hack, T. F., Russell, L., McClement, S. E., Cuthbertson, L., et al. (2020). Initial validation of a patient-reported measure of compassion: determining the content validity and clinical sensibility among patients living with a life-limiting and incurable illness. Patient, 13(3), 327–337. https://​doi.​org/​10.​1007/​s40271-020-00409-8CrossRefPubMed
129.
go back to reference Sarda, S. P., De La Cruz, M., Flood, E. M., Vanya, M., Hwang, D. G., Ta, C. N., & Narvekar, A. (2019). Content validity of a novel patient-reported and observer-reported outcomes assessment to evaluate ocular symptoms associated with infectious conjunctivitis in both adult and pediatric populations. Health and Quality of Life Outcomes, 17(1), 163. https://doi.org/10.1186/s12955-019-1223-9CrossRefPubMedPubMedCentral Sarda, S. P., De La Cruz, M., Flood, E. M., Vanya, M., Hwang, D. G., Ta, C. N., & Narvekar, A. (2019). Content validity of a novel patient-reported and observer-reported outcomes assessment to evaluate ocular symptoms associated with infectious conjunctivitis in both adult and pediatric populations. Health and Quality of Life Outcomes, 17(1), 163. https://​doi.​org/​10.​1186/​s12955-019-1223-9CrossRefPubMedPubMedCentral
130.
go back to reference Tractenberg, R. E., Garver, A., Ljungberg, I. H., Schladen, M. M., & Groah, S. L. (2017). Maintaining primacy of the patient perspective in the development of patient-centered patient reported outcomes. PLoS ONE, 12(3), e0171114.PubMedPubMedCentralCrossRef Tractenberg, R. E., Garver, A., Ljungberg, I. H., Schladen, M. M., & Groah, S. L. (2017). Maintaining primacy of the patient perspective in the development of patient-centered patient reported outcomes. PLoS ONE, 12(3), e0171114.PubMedPubMedCentralCrossRef
136.
137.
go back to reference Pierzynski, J. A., Clegg, J. L., Sim, J., Forrest, C. B., Robison, L. L., Hudson, M. M., et al. (2020). Patient-reported outcomes in paediatric cancer survivorship: a qualitative study to elicit the content from cancer survivors and caregivers. British Medical Journal Open, 10(5), e032414. Pierzynski, J. A., Clegg, J. L., Sim, J., Forrest, C. B., Robison, L. L., Hudson, M. M., et al. (2020). Patient-reported outcomes in paediatric cancer survivorship: a qualitative study to elicit the content from cancer survivors and caregivers. British Medical Journal Open, 10(5), e032414.
140.
go back to reference Jones, J., Hughes, M., Pauling, J., Gooberman-Hill, R., & Moore, A. J. (2020). What narrative devices do people with systemic sclerosis use to describe the experience of pain from digital ulcers: a multicentre focus group study at UK scleroderma centres. British Medical Journal Open, 10(6), e037568. Jones, J., Hughes, M., Pauling, J., Gooberman-Hill, R., & Moore, A. J. (2020). What narrative devices do people with systemic sclerosis use to describe the experience of pain from digital ulcers: a multicentre focus group study at UK scleroderma centres. British Medical Journal Open, 10(6), e037568.
141.
go back to reference Osborne, R. H., Norquist, J. M., Elsworth, G. R., Busija, L., Mehta, V., Herring, T., & Gupta, S. B. (2011). Development and validation of the influenza intensity and impact questionnaire (FluiiQ™). Value Health, 14(5), 687–699.PubMedCrossRef Osborne, R. H., Norquist, J. M., Elsworth, G. R., Busija, L., Mehta, V., Herring, T., & Gupta, S. B. (2011). Development and validation of the influenza intensity and impact questionnaire (FluiiQ™). Value Health, 14(5), 687–699.PubMedCrossRef
143.
go back to reference Rothrock, N. E., Jensen, S. E., Beaumont, J. L., Abernethy, A. P., Jacobsen, P. B., Syrjala, K., & Cella, D. (2013). Development and initial validation of the NCCN/FACT symptom index for advanced kidney cancer. Value Health, 16(5), 789–796.PubMedPubMedCentralCrossRef Rothrock, N. E., Jensen, S. E., Beaumont, J. L., Abernethy, A. P., Jacobsen, P. B., Syrjala, K., & Cella, D. (2013). Development and initial validation of the NCCN/FACT symptom index for advanced kidney cancer. Value Health, 16(5), 789–796.PubMedPubMedCentralCrossRef
144.
go back to reference Stokes, J., Evans, C. J., Pompilus, F., Shields, A. L., & Summers, K. H. (2013). Development of a questionnaire to assess the impact of chronic low back pain for use in regulated clinical trials. Patient, 6, 291–305.PubMedCrossRef Stokes, J., Evans, C. J., Pompilus, F., Shields, A. L., & Summers, K. H. (2013). Development of a questionnaire to assess the impact of chronic low back pain for use in regulated clinical trials. Patient, 6, 291–305.PubMedCrossRef
150.
go back to reference Flythe, J. E., Dorough, A., Narendra, J. H., Wingard, R. L., Dalrymple, L. S., & DeWalt, D. A. (2019). Development and content validity of a hemodialysis symptom patient-reported outcome measure. Quality of Life Research, 28, 253–265.PubMedCrossRef Flythe, J. E., Dorough, A., Narendra, J. H., Wingard, R. L., Dalrymple, L. S., & DeWalt, D. A. (2019). Development and content validity of a hemodialysis symptom patient-reported outcome measure. Quality of Life Research, 28, 253–265.PubMedCrossRef
155.
go back to reference Witjes, S., Van Geenen, R. C. I., Koenraadt, K. L. M., Van Der Hart, C. P., Blankevoort, L., Kerkhoffs, G. M. M. J., & Kuijer, P. P. F. M. (2017). Expectations of younger patients concerning activities after knee arthroplasty: are we asking the right questions? Quality of Life Research, 26(2), 403–417. https://doi.org/10.1007/s11136-016-1380-9CrossRefPubMed Witjes, S., Van Geenen, R. C. I., Koenraadt, K. L. M., Van Der Hart, C. P., Blankevoort, L., Kerkhoffs, G. M. M. J., & Kuijer, P. P. F. M. (2017). Expectations of younger patients concerning activities after knee arthroplasty: are we asking the right questions? Quality of Life Research, 26(2), 403–417. https://​doi.​org/​10.​1007/​s11136-016-1380-9CrossRefPubMed
157.
go back to reference Forrest, C. B., Forrest, K. D., Clegg, J. L., De La Motte, A., Amaral, S., Grossman, A. B., & Furth, S. L. (2020). Establishing the content validity of PROMIS Pediatric pain interference, fatigue, sleep disturbance, and sleep-related impairment measures in children with chronic kidney disease and Crohn’s disease. J Patient Rep Outcomes, 4(1), 11. https://doi.org/10.1186/s41687-020-0178-2CrossRefPubMedPubMedCentral Forrest, C. B., Forrest, K. D., Clegg, J. L., De La Motte, A., Amaral, S., Grossman, A. B., & Furth, S. L. (2020). Establishing the content validity of PROMIS Pediatric pain interference, fatigue, sleep disturbance, and sleep-related impairment measures in children with chronic kidney disease and Crohn’s disease. J Patient Rep Outcomes, 4(1), 11. https://​doi.​org/​10.​1186/​s41687-020-0178-2CrossRefPubMedPubMedCentral
159.
go back to reference England, R. W., Bailey, C. R., Anatchkova, M. D., Skalicky, A. M., Meissner, M. H., Rosenblatt, M., et al. (2020). Qualitative study of patients with venous malformations: symptom experiences and content validity of patient-reported outcome measures. Quality of Life Research, 29(6), 1707–1719. https://doi.org/10.1007/s11136-020-02435-3CrossRefPubMed England, R. W., Bailey, C. R., Anatchkova, M. D., Skalicky, A. M., Meissner, M. H., Rosenblatt, M., et al. (2020). Qualitative study of patients with venous malformations: symptom experiences and content validity of patient-reported outcome measures. Quality of Life Research, 29(6), 1707–1719. https://​doi.​org/​10.​1007/​s11136-020-02435-3CrossRefPubMed
160.
go back to reference Aber, A., Phillips, P., Lumley, E., Radley, S., Thomas, S. M., Nawaz, S., et al. (2020). Mixed methods study to develop the content validity and the conceptual framework of the electronic patient-reported outcome measure for vascular conditions. British Medical Journal Open, 10(8), e034154. Aber, A., Phillips, P., Lumley, E., Radley, S., Thomas, S. M., Nawaz, S., et al. (2020). Mixed methods study to develop the content validity and the conceptual framework of the electronic patient-reported outcome measure for vascular conditions. British Medical Journal Open, 10(8), e034154.
161.
go back to reference Cruickshank, M., Newlands, R., Blazeby, J., Ahmed, I., Bekheit, M., Brazzelli, M., et al. (2021). Identification and categorisation of relevant outcomes for symptomatic uncomplicated gallstone disease: in-depth analysis to inform the development of a core outcome set. British Medical Journal Open, 11(6), e045568. Cruickshank, M., Newlands, R., Blazeby, J., Ahmed, I., Bekheit, M., Brazzelli, M., et al. (2021). Identification and categorisation of relevant outcomes for symptomatic uncomplicated gallstone disease: in-depth analysis to inform the development of a core outcome set. British Medical Journal Open, 11(6), e045568.
164.
168.
go back to reference Kleinman, L., Benjamin, K., Viswanathan, H., Mattera, M. S., Bosserman, L., Blayney, D. W., & Revicki, D. A. (2012). The Anemia Impact Measure (AIM): development and content validation of a patient-reported outcome measure of anemia symptoms and symptom impacts in cancer patients receiving chemotherapy. Quality of Life Research, 21(7), 1255–1266. https://doi.org/10.1007/s11136-011-0034-1CrossRefPubMed Kleinman, L., Benjamin, K., Viswanathan, H., Mattera, M. S., Bosserman, L., Blayney, D. W., & Revicki, D. A. (2012). The Anemia Impact Measure (AIM): development and content validation of a patient-reported outcome measure of anemia symptoms and symptom impacts in cancer patients receiving chemotherapy. Quality of Life Research, 21(7), 1255–1266. https://​doi.​org/​10.​1007/​s11136-011-0034-1CrossRefPubMed
169.
go back to reference Forinder, U., Claesson, L., Szybek, K., & Lindahl Norberg, A. (2015). Exploring the content of post-traumatic stress symptoms among parents after paediatric stem cell transplant. PLoS ONE, 10(5), e0126905.PubMedPubMedCentralCrossRef Forinder, U., Claesson, L., Szybek, K., & Lindahl Norberg, A. (2015). Exploring the content of post-traumatic stress symptoms among parents after paediatric stem cell transplant. PLoS ONE, 10(5), e0126905.PubMedPubMedCentralCrossRef
174.
go back to reference Boesen, V. B., Nissen, S. B., Groenvold, M., Bjorner, J. B., Hegedüs, L., Bonnema, S. J., et al. (2018). Conversion of standard retrospective patient-reported outcomes to momentary versions: cognitive interviewing reveals varying degrees of momentary compatibility. Quality of Life Research, 27, 1065–1076.PubMedCrossRef Boesen, V. B., Nissen, S. B., Groenvold, M., Bjorner, J. B., Hegedüs, L., Bonnema, S. J., et al. (2018). Conversion of standard retrospective patient-reported outcomes to momentary versions: cognitive interviewing reveals varying degrees of momentary compatibility. Quality of Life Research, 27, 1065–1076.PubMedCrossRef
176.
go back to reference Bloemeke, J., Sommer, R., Witt, S., Bullinger, M., Nordon, C., Badia, F. J., et al. (2019). Cross-cultural selection and validation of instruments to assess patient-reported outcomes in children and adolescents with achondroplasia. Quality of Life Research, 28, 2553–2563.PubMedCrossRef Bloemeke, J., Sommer, R., Witt, S., Bullinger, M., Nordon, C., Badia, F. J., et al. (2019). Cross-cultural selection and validation of instruments to assess patient-reported outcomes in children and adolescents with achondroplasia. Quality of Life Research, 28, 2553–2563.PubMedCrossRef
177.
go back to reference Krohe, M., Tang, D. H., Klooster, B., Revicki, D., Galipeau, N., & Cella, D. (2019). Content validity of the National Comprehensive Cancer Network – Functional Assessment of Cancer Therapy – Breast Cancer Symptom Index (NFBSI-16) and Patient-Reported Outcomes Measurement Information System (PROMIS) physical function short form with advanced breast cancer patients. BMC Health Services Research, 17(1), 92. https://doi.org/10.1186/s12955-019-1162-5CrossRef Krohe, M., Tang, D. H., Klooster, B., Revicki, D., Galipeau, N., & Cella, D. (2019). Content validity of the National Comprehensive Cancer Network – Functional Assessment of Cancer Therapy – Breast Cancer Symptom Index (NFBSI-16) and Patient-Reported Outcomes Measurement Information System (PROMIS) physical function short form with advanced breast cancer patients. BMC Health Services Research, 17(1), 92. https://​doi.​org/​10.​1186/​s12955-019-1162-5CrossRef
191.
go back to reference Fischer, J., Jansen, B., Rivera, A., Gómez, L. J., Barbosa, M. C., Bilbao, J. L., et al. (2019). Validation of a cross-NTD toolkit for assessment of NTD-related morbidity and disability. A cross-cultural qualitative validation of study instruments in Colombia. PLoS ONE, 14(12), e0223042.PubMedPubMedCentralCrossRef Fischer, J., Jansen, B., Rivera, A., Gómez, L. J., Barbosa, M. C., Bilbao, J. L., et al. (2019). Validation of a cross-NTD toolkit for assessment of NTD-related morbidity and disability. A cross-cultural qualitative validation of study instruments in Colombia. PLoS ONE, 14(12), e0223042.PubMedPubMedCentralCrossRef
192.
go back to reference Mitchell, P. M., Caskey, F. J., Scott, J., Sanghera, S., & Coast, J. (2020). Response process validity of three patient reported outcome measures for people requiring kidney care: a think-aloud study using the EQ-5D-5L ICECAP-A and ICECAP-O. British Medical Journal Open, 10(5), e034569. Mitchell, P. M., Caskey, F. J., Scott, J., Sanghera, S., & Coast, J. (2020). Response process validity of three patient reported outcome measures for people requiring kidney care: a think-aloud study using the EQ-5D-5L ICECAP-A and ICECAP-O. British Medical Journal Open, 10(5), e034569.
193.
go back to reference Høeg, B. L., Saltbæk, L., Christensen, K. B., Karlsen, R. V., Johansen, C., Dalton, S. O., et al. (2021). The development and initial validation of the Breast Cancer Recurrence instrument (BreastCaRe)—a patient-reported outcome measure for detecting symptoms of recurrence after breast cancer. Quality of Life Research, 30, 2671–2682.PubMedCrossRef Høeg, B. L., Saltbæk, L., Christensen, K. B., Karlsen, R. V., Johansen, C., Dalton, S. O., et al. (2021). The development and initial validation of the Breast Cancer Recurrence instrument (BreastCaRe)—a patient-reported outcome measure for detecting symptoms of recurrence after breast cancer. Quality of Life Research, 30, 2671–2682.PubMedCrossRef
195.
go back to reference Hill, J. C., Thomas, E., Hill, S., Foster, N. E., & Van Der Windt, D. A. (2015). Development and validation of the keele Musculoskeletal Patient Reported Outcome Measure (MSK-PROM). PLoS ONE, 10(4), e0124557.PubMedPubMedCentralCrossRef Hill, J. C., Thomas, E., Hill, S., Foster, N. E., & Van Der Windt, D. A. (2015). Development and validation of the keele Musculoskeletal Patient Reported Outcome Measure (MSK-PROM). PLoS ONE, 10(4), e0124557.PubMedPubMedCentralCrossRef
202.
go back to reference Hornsey, S., Stuart, B., Muller, I., Layton, A. M., Morrison, L., King, J., et al. (2021). Patient-Reported outcome measures for acne: a mixed-methods validation study (acne PROMs). British Medical Journal Open, 11(3), e034047. Hornsey, S., Stuart, B., Muller, I., Layton, A. M., Morrison, L., King, J., et al. (2021). Patient-Reported outcome measures for acne: a mixed-methods validation study (acne PROMs). British Medical Journal Open, 11(3), e034047.
Metagegevens
Titel
Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review
Auteurs
Caroline Seo
Sophia Hu
Bellinda L. King-Kallimanis
Ashley E. Chang
Antoine Regnault
Amitai S. Miller
Manraj N. Kaur
Publicatiedatum
25-04-2025
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-025-03964-5