Advertisement
Original Research| Volume 107, P153-163, January 2019

General population normative data for the EORTC QLQ-C30 health-related quality of life questionnaire based on 15,386 persons across 13 European countries, Canada and the Unites States

  • S. Nolte
    Correspondence
    Corresponding author: Sandra Nolte, PhD, Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany.
    Affiliations
    Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany

    Population Health Strategic Research Centre, School of Health and Social Development, Deakin University, Burwood, VIC, Australia
    Search for articles by this author
  • G. Liegl
    Affiliations
    Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
    Search for articles by this author
  • M.A. Petersen
    Affiliations
    Department of Palliative Medicine, Bispebjerg Hospital, Copenhagen, Denmark
    Search for articles by this author
  • N.K. Aaronson
    Affiliations
    Division of Psychosocial Research & Epidemiology, The Netherlands Cancer Institute, Amsterdam, the Netherlands
    Search for articles by this author
  • A. Costantini
    Affiliations
    Psycho-Oncology Unit, Sant'Andrea Hospital Sapienza, University of Rome, Rome, Italy
    Search for articles by this author
  • P.M. Fayers
    Affiliations
    Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
    Search for articles by this author
  • M. Groenvold
    Affiliations
    Department of Palliative Medicine, Bispebjerg Hospital, Copenhagen, Denmark

    Department of Public Health, University of Copenhagen, Copenhagen, Denmark
    Search for articles by this author
  • B. Holzner
    Affiliations
    Department of Psychiatry, Psychotherapy and Psychosomatics, Innsbruck Medical University, Innsbruck, Austria
    Search for articles by this author
  • C.D. Johnson
    Affiliations
    University of Southampton, Southampton, United Kingdom
    Search for articles by this author
  • G. Kemmler
    Affiliations
    Department of Psychiatry, Psychotherapy and Psychosomatics, Innsbruck Medical University, Innsbruck, Austria
    Search for articles by this author
  • K.A. Tomaszewski
    Affiliations
    Health Outcomes Research Unit, Department of Gerontology, Geriatrics, and Social Work, Faculty of Education, Ignatianum Academy, Krakow, Poland
    Search for articles by this author
  • A. Waldmann
    Affiliations
    Institute of Social Medicine and Epidemiology, University of Luebeck, Luebeck, Germany

    Ministry for Health and Consumer Protection, Hamburg Cancer Registry, Hamburg, Germany
    Search for articles by this author
  • T.E. Young
    Affiliations
    East & North Hertfordshire NHS Trust Including Mount Vernon Cancer Centre, Northwood, Middlesex, United Kingdom
    Search for articles by this author
  • M. Rose
    Affiliations
    Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany

    Quantitative Health Sciences, Outcomes Measurement Science, University of Massachusetts Medical School, Worcester, MA, USA
    Search for articles by this author
  • on behalf ofthe EORTC Quality of Life Group
Open AccessPublished:December 19, 2018DOI:https://doi.org/10.1016/j.ejca.2018.11.024

      Highlights

      • Updated general population norm data for EORTC QLQ-C 30 based on 15,386 persons across 13 European countries, Canada, and USA.
      • Study strength: all individual country QLQ-C30 norm data collected based on a common sampling strategy and survey design.
      • New normative data facilitate valid intracountry and especially intercountry comparisons and QLQ-C30 score interpretation.

      Abstract

      Objective

      The European Organisation for Research and Treatment of Cancer (EORTC) QLQ-C30 health-related quality of life questionnaire is one of the most widely used cancer-specific health-related quality of life questionnaires worldwide. General population norm data can facilitate the interpretation of QLQ-C30 data obtained from cancer patients. This study aimed at systematically collecting norm data from the general population to develop European QLQ-C30 norm scores and to generate comparable norm data for individual countries in Europe and North America.

      Methods

      We collected QLQ-C30 data from the general population across 11 European Union (EU) countries, Russia, Turkey, Canada and United States (n ≥ 1000/country). Representative samples were stratified by sex and age groups (18–39, 40–49, 50–59, 60–69 and ≥ 70 years). After applying weights based on the United Nations population distribution statistics, we calculated QLQ-C30 domain scores to generate a ‘European QLQ-C30 Norm’ based on the EU countries. Further, we calculated QLQ-C30 norm scores for all 15 individual countries.

      Results

      A total of 15,386 respondents completed the online survey. For the EU sample, most QLQ-C30 domains showed differences by sex/age, with men scoring somewhat better health than women, while age effects varied across domains. Substantially larger differences were seen in inter-country comparisons, with Austrian and Dutch respondents reporting consistently better health compared with British and Polish respondents.

      Conclusions

      This study is the first to systematically collect EORTC QLQ-C30 general population norm data across Europe and North America applying a consistent data collection method across 15 countries. These new norm data facilitate valid intra-country as well as inter-country comparisons and QLQ-C30 score interpretation.

      Keywords

      1. Introduction

      The importance of including the patients’ voice in clinical practice and research has been recognised widely for several decades [
      • Snyder C.F.
      • Aaronson N.K.
      Use of patient-reported outcomes in clinical practice.
      ,
      • Blazeby J.M.
      • Avery K.
      • Sprangers M.
      • Pikhart H.
      • Fayers P.
      • Donovan J.
      Health-related quality of life measurement in randomized clinical trials in surgical oncology.
      ]. In more recent years, patient-reported outcomes (PROs) have also been increasingly acknowledged in drug development and regulatory decision-making [
      • Basch E.
      • Dueck A.C.
      Patient-reported outcome measurement in drug discovery: a tool to improve accuracy and completeness of efficacy and safety data.
      ,
      • Shields A.L.
      • Hao Y.
      • Krohe M.
      • Yaworsky A.
      • Mazar I.
      • Foley C.
      • et al.
      Patient-reported outcomes in oncology drug labeling in the United States: a framework for navigating early challenges.
      ,
      • Kluetz P.G.
      • O'Connor D.J.
      • Soltys K.
      Incorporating the patient experience into regulatory decision making in the USA, Europe, and Canada.
      ]. Given this growing relevance of PROs, it is not surprising that efforts are undertaken to standardise PRO data, with several initiatives worldwide tackling the issue in different ways. One possible approach—as taken by the International Consortium for Health Outcomes Measurement (ICHOM)—is to define standard sets of existing PRO instruments to enable comparison of outcomes across health-care providers and geographies [
      • Porter M.E.
      • Larsson S.
      • Lee T.H.
      Standardizing patient outcomes measurement.
      ]. A more elaborate approach is to measure PROs by applying modern test theory methods where items measuring the same latent construct are calibrated on the same metric. This serves as the foundation of the application of computer-adaptive tests (CATs) [
      • Cella D.
      • Yount S.
      • Rothrock N.
      • Gershon R.
      • Cook K.
      • Reeve B.
      • et al.
      The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years.
      ,
      • Petersen M.A.
      • Aaronson N.K.
      • Arraras J.I.
      • Chie W.C.
      • Conroy T.
      • Costantini A.
      • et al.
      The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire.
      ,
      • Fischer H.F.
      • Rose M.
      www.common-metrics.org: a web application to estimate scores from different patient-reported outcome measures on a common scale.
      ].
      The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (QLG) has a long track record of developing and validating PRO instruments for use in oncology. Their quality of life (QoL) core questionnaire, the QLQ-C30, was developed more than 25 years ago and is one of the most widely used cancer-specific PRO instruments [
      • Aaronson N.K.
      • Ahmedzai S.
      • Bergman B.
      • Bullinger M.
      • Cull A.
      • Duez N.J.
      • et al.
      The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
      ,
      • Fayers P.
      • Bottomley A.
      On behalf of the EORTC quality of life group and of the quality of life unit. Quality of life research within the EORTC-the EORTC QLQ-C30.
      ]. Regarding standardisation, use of the QLQ-C30 as part of clinical routine is frequently recommended in ICHOM standard sets for malignant neoplasms (e.g. [
      • Zerillo J.A.
      • Schouwenburg M.G.
      • van Bommel A.C.M.
      • Stowell C.
      • Lippa J.
      • Bauer D.
      • et al.
      An international collaborative standardizing a comprehensive patient-centered outcomes measurement set for colorectal cancer.
      ,
      • Ong W.L.
      • Schouwenburg M.G.
      • van Bommel A.C.M.
      • Stowell C.
      • Allison K.H.
      • Benn K.E.
      • et al.
      A standard set of value-based patient-centered outcomes for breast cancer: the international Consortium for health outcomes measurement (ICHOM) initiative.
      ]). Further, the EORTC QLG developed a QLQ-C30 CAT version, the EORTC CAT Core [
      • Petersen M.A.
      • Aaronson N.K.
      • Arraras J.I.
      • Chie W.C.
      • Conroy T.
      • Costantini A.
      • et al.
      The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire.
      ]. Through tailoring items to the individual respondent, CATs can achieve the same measurement precision as static instruments while using fewer items; CATs also minimise floor/ceiling effects [
      • Revicki D.A.
      • Cella D.F.
      Health status assessment for the twenty-first century: item response theory, item banking and computer adaptive testing.
      ].
      While these initiatives are crucial steps toward improving quality and comparability of PRO data, data analysis and interpretation is further enhanced by using a sensible reference for comparative purposes. Depending on the objective of such comparison, a useful reference can be data obtained from cancer patients or norm data collected from the general population. If these data are not available, interpretation of PRO data may be arbitrary. For the comparison of QLQ-C30 scores with cancer-patient data, the EORTC QLG has published reference values generated for various cancer populations [
      • Scott N.W.
      • Fayers P.M.
      • Aaronson N.K.
      • Bottomley A.
      • de Graeff A.
      • Groenvold M.
      • et al.
      EORTC QLQ-C30 reference values.
      ]. In addition, general population norm data have been collected in different countries over the last two decades, with European data available for Denmark [
      • Klee M.
      • Groenvold M.
      • Machin D.
      Quality of life of Danish women: population-based norms of the EORTC QLQ-C30.
      ,
      • Juul T.
      • Petersen M.A.
      • Holzner B.
      • Laurberg S.
      • Christensen P.
      • Gronvold M.
      Danish population-based reference data for the EORTC QLQ-C30: associations with gender, age and morbidity.
      ], Germany [
      • Schwarz R.
      • Hinz A.
      Reference data for the quality of life questionnaire EORTC QLQ-C30 in the general German population.
      ,
      • Waldmann A.
      • Schubert D.
      • Katalinic A.
      Normative data of the EORTC QLQ-C30 for the German population: a population-based survey.
      ,
      • Hinz A.
      • Singer S.
      • Brahler E.
      European reference values for the quality of life questionnaire EORTC QLQ-C30: results of a German investigation and a summarizing analysis of six European general population normative studies.
      ], the Netherlands [
      • van de Poll-Franse L.V.
      • Mols F.
      • Gundy C.M.
      • Creutzberg C.L.
      • Nout R.A.
      • Verdonck-de Leeuw I.M.
      • et al.
      Normative data for the EORTC QLQ-C30 and EORTC-sexuality items in the general Dutch population.
      ,
      • Mols F.
      • Husson O.
      • Oudejans M.
      • Vlooswijk C.
      • Horevoorts N.
      • van de Poll-Franse L.V.
      Reference data of the EORTC QLQ-C30 questionnaire: five consecutive annual assessments of approximately 2000 representative Dutch men and women.
      ], Norway [
      • Hjermstad M.J.
      • Fayers P.M.
      • Bjordal K.
      • Kaasa S.
      Health-related quality of life in the general Norwegian population assessed by the european organization for research and treatment of cancer core quality-of-life questionnaire: the QLQ=C30 (+ 3).
      ,
      • Hjermstad M.J.
      • Fayers P.M.
      • Bjordal K.
      • Kaasa S.
      Using reference data on quality of life – the importance of adjusting for age and gender, exemplified by the EORTC QLQ-C30 (+3).
      ], Slovenia [
      • Velenik V.
      • Secerov-Ermenc A.
      • But-Hadzic J.
      • Zadnik V.
      Health-related quality of life assessed by the EORTC QLQ-C30 questionnaire in the general slovenian population.
      ] and Sweden [
      • Michelson H.
      • Bolund C.
      • Nilsson B.
      • Brandberg Y.
      Health-related quality of life measured by the EORTC QLQ-C30--reference values from a large sample of Swedish population.
      ,
      • Derogar M.
      • van der Schaaf M.
      • Lagergren P.
      Reference values for the EORTC QLQ-C30 quality of life questionnaire in a random sample of the Swedish population.
      ], with the latest German publication providing a European norm by collating data from different samples [
      • Hinz A.
      • Singer S.
      • Brahler E.
      European reference values for the quality of life questionnaire EORTC QLQ-C30: results of a German investigation and a summarizing analysis of six European general population normative studies.
      ]. However, a major drawback of this work is that inter-country comparisons are hampered because of the lack of a common sampling methodology across studies.
      Given the dearth of research regarding European QLQ-C30 general population norm data for use in inter-country comparisons, the EORTC QLG set out to systematically collect general population data in 13 European countries, Canada and the United States using a common methodology to generate norm data for the QLQ-C30 and the CAT Core [
      • Petersen M.A.
      • Aaronson N.K.
      • Arraras J.I.
      • Chie W.C.
      • Conroy T.
      • Costantini A.
      • et al.
      The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire.
      ]. This article presents European QLQ-C30 general population norm data and individual country norms for 15 countries.

      2. Material and methods

      2.1 Country selection

      Country selection was based on several criteria, including population size and balance of geographical location, whilst considering budgetary constraints. The final selection included 11 European Union (EU) countries (Austria, Denmark, France, Germany, Hungary, Italy, the Netherlands, Poland, Spain, Sweden and United Kingdom). For comparative purposes, we also collected data in Russia, Turkey, Canada and the United States.

      2.2 Item selection and sociodemographic data

      The QLQ-C30 consists of 30 items covering five function subscales (physical, role, emotional, cognitive and social), nine symptom subscales/items (fatigue, nausea/vomiting, pain, dyspnoea, insomnia, appetite loss, constipation, diarrhoea and financial difficulties) and a global health/QoL subscale. Further details of the full-scale survey are reported elsewhere [
      • Liegl G.
      • Petersen M.A.
      • Groenvold M.
      • Aaronson N.K.
      • Costantini A.
      • Fayers P.M.
      • et al.
      Establishing the European Norm for the health-related quality of life domains of the computer-adaptive test EORTC CAT Core.
      ]. A range of sociodemographic data were collected, including sex, age, education, employment, relationship status and presence of health conditions.

      2.3 Translation and cultural adaptation of included variables

      All QLQ-C30 items were available for the languages spoken in the selected countries. In contrast, the sociodemographic variables had to be developed and translated. During this process, assessment of educational attainment proved to be challenging. After a comprehensive consensus process, including review of the International Standard Classification of Education (2011), the final categorisation was deemed adequate by the study collaborators.

      2.4 Sampling

      To generate sufficiently large sample sizes for estimating stable norms for a range of subgroups, we stratified samples by sex and age group (18–39, 40–49, 50–59, 60–69 and ≥ 70 years) with sample sizes of n = 100/stratum, i.e. n = 1000/country. Sampling of an equal distribution of sex and age groups provides norm data for purposes of comparing cancer-patient data with sex- and age-matched peers from the general population. Further details regarding the rationale for the sample size are reported elsewhere [
      • Liegl G.
      • Petersen M.A.
      • Groenvold M.
      • Aaronson N.K.
      • Costantini A.
      • Fayers P.M.
      • et al.
      Establishing the European Norm for the health-related quality of life domains of the computer-adaptive test EORTC CAT Core.
      ].

      2.5 Data collection

      To ensure a consistent data collection method and representative samples throughout, we subcontracted data collection to GfK SE (www.gfk.com), a panel research company experienced in multinational/multilanguage online surveys. These internet panels are representative for the general population (with internet access) in a given country in terms of sex, age, region, hometown size, household size and socioeconomic status. While GfK achieved most quotas via internet panels, n = 290 respondents (≥ 60 years) provided data via computer-assisted telephone interviews to achieve quotas in Turkey.
      Data were collected in March/April 2017. As GfK panel members are registered voluntarily and generally participate when contacted, GfK attains response rates between 75 and 90%.

      2.6 Establishing European norm data for the EORTC QLQ-C30

      For the final definition of the ‘European QLQ-C30 Norm’, we included the 11 EU countries. We weighted data by respective country's population size, sex and age distribution based on official 2015 population distribution statistics published by the United Nations [
      • United Nations Department of Economic and Social Affairs Population Division
      World population Prospects: the 2017 revision.
      ].

      2.7 Statistical analyses

      We calculated mean scores and 95% confidence intervals (CIs) of the QLQ-C30 subscales ranging between 0 and 100 following the QLQ-C30 scoring manual [
      • Fayers P.
      • Aaronson N.
      • Bjordal K.
      • Groenvold M.
      • Curran D.
      • Bottomley A.
      • et al.
      The EORTC QLQ-C30 scoring manual.
      ]. We calculated norm scores for the sex/age strata of the combined EU sample weighted by country size and sex/age distribution. Given the large samples, we further divided the youngest age group into 18–29 and 30–39 years, respectively. Finally, we calculated national norm data for all 15 countries, weighted by respective country's sex/age distribution. For all analyses, we used IBM SPSS Statistics®, version 25.

      3. Results

      Stratified quotas were achieved in all 15 countries, with n ≥ 100 individuals completing the survey in each sex*age*country subgroup. Country sample sizes ranged between n = 1000 (the Netherlands) and n = 1165 (Spain), leading to a final sample size of N = 15,386 for the full and n = 11,343 for the EU sample (Table 1).
      Table 1Sociodemographic data of full sample (13 European countries, Canada, USA) and “EORTC QLQ-C30 Norm” sample (11 EU countries).
      Sociodemographic variableFull sample (15 countries)

      N = 15,386
      EORTC QLQ-C30 Norm (11 EU countries)

      n = 11,343
      n%n%
      Sex
       Female765049.7562349.6
       Male773650.3572050.4
      Age categories (years)
       18–2911777.68837.8
       30–39190212.4137012.1
       40–49304919.8224819.8
       50–59305919.9225319.9
       60–69313820.4233720.6
       ≥70306119.9225219.9
      Education
       Less than compulsory education1831.2950.9
       Compulsory (left school at the minimum school leaving age)15099.98978.0
       Some post compulsory (some school after reaching school leaving age without reaching university entrance qualifications (e.g., A-levels))205013.5195417.5
       Post compulsory below university (e.g. reaching A levels)440529.0340830.5
       University degree (bachelor's degree or equivalent level)371624.4268924.1
       Postgraduate degree (master's degree, doctorate or equivalent level)333722.0213119.1
       Prefer not to answer
      For the calculation of percentage distributions, the category “prefer not to answer” is treated as missing data.
      186169
      Employment status
       Employed full-time553236.2408736.3
       Employed part-time12568.29848.7
       Homemaker7955.24854.3
       Student3892.53282.9
       Unemployed8115.36145.5
       Retired523834.3382734.0
       Self-employed8335.56205.5
       Other4222.83052.7
       Prefer not to answer11093
      Relationship status
       Single/not in a steady relationship258917.0195117.4
       Married or in a steady relationship10,26367.4764068.1
       Separated/divorced/widowed237615.6163314.5
       Prefer not to answer158119
      Health status
      The sample sizes were reduced by n = 114 (0.7%) in the full sample and n = 79 (0.7%) in the EU subsample, respectively, as respondents had provided implausible data to the question on presence of disease.
      ,
      The sum of health conditions is larger than the total sample of N = 15,386 (full sample) and n = 11,343 (EU subsample), respectively, as respondents were able to check multiple response options.
       No health condition/disease536136.6420439.0
       Chronic pain358224.5246822.9
       Heart disease12268.48047.5
       Cancer (excluding basal cell carcinoma)4162.83082.9
       Depression14529.99038.4
       Chronic obstructive pulmonary disease (COPD)5323.63733.5
       Arthritis211414.4142713.2
       Diabetes154610.6109510.2
       Asthma9246.36586.1
       Anxiety disorder12188.37857.3
       Obesity151310.310729.9
       Drug/alcohol use disorder1531.0960.9
       Other263418.0186317.3
       Prefer not to answer631486
      Country
       Austria
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10026.510028.8
       Canada10046.5
       Denmark
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10036.510038.8
       France
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10016.510018.8
       Germany
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10066.510068.9
       Hungary
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10536.810539.3
       Italy
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10366.710369.1
       The Netherlands
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10006.510008.8
       Poland
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10246.710249.0
       Russia10076.5
       Spain
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      11657.6116510.3
       Sweden
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10276.710279.1
       Turkey10236.6
       United Kingdom
      Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      10266.710269.0
       USA10096.6
      a For the calculation of percentage distributions, the category “prefer not to answer” is treated as missing data.
      b The sample sizes were reduced by n = 114 (0.7%) in the full sample and n = 79 (0.7%) in the EU subsample, respectively, as respondents had provided implausible data to the question on presence of disease.
      c The sum of health conditions is larger than the total sample of N = 15,386 (full sample) and n = 11,343 (EU subsample), respectively, as respondents were able to check multiple response options.
      d Countries included in the calculation of the “EORTC QLQ-C30 Norm”.
      Sociodemographic characteristics of the two samples were comparable. As per sampling, there was an equal distribution of females/males and age groups. Respondents’ age ranged between 18 and 99 years, with mean age 53.6 years. Around 90% of respondents indicated to have at least some post-compulsory education. Across samples, 36% of respondents were working full-time; 34% were retired. About two-thirds reported being married/in a steady relationship. Finally, the most frequently reported diseases were chronic pain, arthritis, diabetes, obesity and depression, with 63% (full sample) and 61% (EU sample), respectively, reporting to have at least one health condition (Table 1).
      As shown in Table 2, self-rated function in our EU sample was relatively high. Across subscales, sample mean scores ranged between 84.3 and 86.2 (on a 100-point scale), with 95% CIs between ±0.50 and ± 0.65. The only exception was emotional function, with a mean score of 74.2 (95% CI, ±0.66). Women and men rated themselves similarly, except for emotional function where men rated themselves 4.7 points higher than women. Age effects varied. For physical and role function, women reported decreasing function with increasing age; men did not show age differences. For the remaining function subscales, age effects tended to be in the opposite direction, with older respondents reporting higher function than younger respondents. For some symptom subscales, marked floor effects were observed, with > 80% selecting the lowest/best score for nausea/vomiting, appetite loss, diarrhoea and financial difficulties. Scores ranged between 5.9 (nausea/vomiting) and 29.5 (fatigue), with 95% CIs between ±0.48 and ± 0.79. Men tended to rate themselves lower/better than women, with largest differences observed for insomnia, fatigue and pain. Age effects varied. For pain and dyspnoea, women reported more symptoms with increasing age. In contrast, for fatigue, nausea/vomiting and appetite loss, older respondents tended to score lower/better than younger respondents; for diarrhoea and financial difficulties, this age effect was only seen in men. For global health/QoL, men reported higher scores than women (68.0 for men, 95% CI, ±0.81; 64.3 for women, 95% CI, ±0.74). Respondents aged 50–59 years reported lowest global health/QoL scores (65.8 for men; 62.6 for women; 95% CI, ±1.63 each).
      Table 2European EORTC QLQ-C30 general population norm data
      The European norm scores for the EORTC QLQ-C30 are based on 11 EU countries (as listed in Table 1).
      . Mean scores (M)/standard deviations (SD) by subscales stratified by sex and age weighted by sex, age and country according to the United Nations (UN), Department of Economic and Social Affairs population distribution statistics for the year 2015
      United Nations, Department of Economic and Social Affairs, Population Division (2017). World Population Prospects: The 2017 Revision, DVD Edition.
      .
      DomainTotalFemaleMale
      All female18-29 years30-39 years40-49 years50-59 years60-69 years≥70 yearsAll male18-29 years30-39 years40-49 years50-59 years60-69 years≥70 years
      Function subscales
      Physical function
      M85.184.388.986.785.883.482.178.586.085.687.387.986.884.982.7
      SD18.918.514.518.018.818.818.719.819.321.619.018.018.218.319.6
      Role function
      M84.384.189.184.684.182.383.580.784.582.585.285.384.385.484.8
      SD24.624.620.224.625.125.525.326.424.526.323.424.525.123.522.7
      Emotional function
      M74.271.966.267.869.171.077.879.976.673.771.174.375.982.285.7
      SD24.725.328.226.826.424.121.919.823.826.426.524.023.518.915.5
      Cognitive function
      M84.884.382.882.982.783.287.986.685.281.384.585.786.487.987.7
      SD21.320.922.423.522.721.116.617.221.727.523.320.720.816.614.9
      Social function
      M86.285.786.183.783.283.888.189.086.784.484.885.387.689.890.2
      SD24.124.624.726.426.825.722.720.423.626.625.224.122.120.819.3
      Symptom subscales/ items
      Fatigue
      M29.531.734.434.633.932.126.628.127.130.729.627.526.723.521.9
      SD25.525.925.327.327.126.224.524.224.825.225.024.525.123.923.3
      Nausea/vomiting
      M5.95.77.28.56.34.93.73.36.111.99.45.23.42.31.2
      SD16.014.917.417.816.112.811.611.617.124.920.315.011.09.45.5
      Pain
      M23.525.320.623.325.228.725.428.821.621.322.121.422.922.119.7
      SD27.127.924.927.728.129.228.628.226.026.625.926.026.326.025.0
      Dyspnoea
      M15.916.312.616.116.217.016.619.315.516.215.114.014.616.916.4
      SD24.624.520.823.624.824.725.027.324.726.124.723.023.625.525.0
      Insomnia
      M26.629.326.028.930.435.229.227.123.620.427.126.025.622.320.3
      SD30.330.729.830.931.232.530.728.729.629.530.829.830.428.127.5
      Appetite loss
      M10.010.311.613.511.49.67.68.39.615.812.17.67.56.45.2
      SD21.621.623.224.823.119.718.718.721.628.422.618.119.217.215.8
      Constipation
      M12.514.114.117.814.714.111.812.310.913.612.910.08.69.010.1
      SD23.324.425.327.025.324.421.422.321.925.924.120.819.118.919.4
      Diarrhoea
      M9.59.09.012.58.89.46.57.710.014.313.510.38.75.94.4
      SD20.920.320.223.520.420.417.019.521.426.423.821.220.215.413.1
      Financial difficulties
      M10.610.99.512.913.612.59.38.010.413.612.811.08.98.05.7
      SD23.624.224.125.427.324.822.420.122.925.924.923.921.420.216.7
      Global health / Quality of Life
      M66.164.366.463.462.962.665.664.868.071.167.466.365.867.069.6
      SD21.721.820.521.722.922.522.320.921.421.720.921.122.720.820.3
      a The European norm scores for the EORTC QLQ-C30 are based on 11 EU countries (as listed in Table 1).
      b United Nations, Department of Economic and Social Affairs, Population Division (2017). World Population Prospects: The 2017 Revision, DVD Edition.
      Compared with differences between sex/age groups, inter-country comparisons suggest larger group differences (Table 3, Fig. 1, Fig. 2). Austrian and Dutch respondents reported the best scores, i.e. highest for function and lowest for symptoms. In contrast, Polish and British respondents for the EU sample and Russian, Turkish and United States respondents for the full sample regularly reported worse scores, with differences reaching or exceeding 10 points, a difference that is often applied to indicate clinical relevance [
      • Osoba D.
      • Rodrigues G.
      • Myles J.
      • Zee B.
      • Pater J.
      Interpreting the significance of changes in health-related quality-of-life scores.
      ]. On the global health/QoL subscale, differences between lowest (Poland, Russia, Turkey and United Kingdom) and highest scoring nations (Austria and Netherlands) again exceeded 10 points.
      Table 3Country general population norm data for the EORTC QLQ-C30. Mean scores (M)/standard deviations (SD) by subscales weighted by individual country weights and sex and age distributions according to the UN Department of Economic and Social Affairs population distribution statistics for the year 2015
      United Nations, Department of Economic and Social Affairs, Population Division (2017). World Population Prospects: The 2017 Revision, DVD Edition.
      .
      DomainAUT
      Country codes: AUT = Austria, CAN=Canada, DNK = Denmark, FRA=France, DEU = Germany, HUN=Hungary, ITA=Italy, NLD=Netherlands, POL=Poland, RUS = Russia, ESP = Spain, SWE=Sweden, TUR = Turkey, GBR = United Kingdom, USA=United Stated of America.
      CANDNKFRADEUHUNITANLDPOLRUSESPSWETURGBRUSA
      Function subscales
      Physical function
      M89.785.484.289.182.889.185.290.781.376.386.888.975.881.880.8
      SD13.919.320.415.921.214.017.014.916.516.416.814.616.723.525.2
      Role function
      M88.983.782.487.880.887.586.189.183.481.086.188.082.380.281.7
      SD20.325.625.922.427.220.522.221.522.121.021.521.422.429.128.2
      Emotional function
      M78.175.579.276.773.972.173.582.368.368.177.176.765.871.073.3
      SD22.323.525.124.324.722.922.721.225.023.722.421.725.528.428.0
      Cognitive function
      M89.184.783.786.783.987.487.090.381.279.585.787.175.580.580.9
      SD17.820.822.619.522.717.718.617.122.019.019.418.623.225.225.6
      Social function
      M92.284.986.590.584.890.288.191.980.883.387.891.483.180.381.6
      SD17.126.324.220.825.519.420.619.025.423.722.519.123.629.429.4
      Symptom subscales/ items
      Fatigue
      M24.129.129.927.731.530.228.523.735.941.523.925.639.432.231.9
      SD22.724.126.726.227.222.623.923.022.723.922.722.224.027.627.8
      Nausea/vomiting
      M2.06.77.94.16.03.86.53.57.47.44.94.011.38.110.9
      SD8.316.618.313.517.211.915.911.817.515.214.511.218.918.922.6
      Pain
      M20.024.423.419.627.623.520.217.726.027.122.720.424.926.727.5
      SD24.327.226.524.730.923.823.922.923.723.924.025.022.931.230.2
      Dyspnoea
      M10.916.313.714.418.79.115.79.513.423.112.428.118.219.519.9
      SD20.624.523.523.827.319.123.019.721.425.020.726.824.827.928.5
      Insomnia
      M20.030.828.525.927.622.122.921.328.631.325.221.831.632.630.8
      SD27.830.631.230.633.127.427.126.128.329.728.027.628.532.833.2
      Appetite loss
      M4.411.311.88.010.18.08.54.913.013.89.57.619.214.214.1
      SD16.122.824.219.723.318.419.015.123.222.719.917.624.625.225.3
      Constipation
      M6.214.610.811.19.610.314.24.918.814.715.36.723.214.718.6
      SD17.325.023.021.222.320.723.413.626.224.424.117.028.626.228.6
      Diarrhoea
      M7.511.110.77.310.49.69.36.912.012.27.87.913.511.213.7
      SD18.721.122.018.822.720.219.517.823.321.918.117.222.323.027.1
      Financial difficulties
      M5.012.712.26.711.314.89.74.915.520.59.55.817.614.517.5
      SD17.627.026.219.325.026.221.617.124.929.020.718.225.828.730.8
      Global health / QoL
      M75.665.967.068.267.066.364.977.460.059.766.869.260.762.363.9
      SD20.020.623.420.121.820.420.319.820.619.721.522.122.723.722.9
      a United Nations, Department of Economic and Social Affairs, Population Division (2017). World Population Prospects: The 2017 Revision, DVD Edition.
      b Country codes: AUT = Austria, CAN=Canada, DNK = Denmark, FRA=France, DEU = Germany, HUN=Hungary, ITA=Italy, NLD=Netherlands, POL=Poland, RUS = Russia, ESP = Spain, SWE=Sweden, TUR = Turkey, GBR = United Kingdom, USA=United Stated of America.
      Fig. 1
      Fig. 1EORTC QLQ-C30 country reference values for function subscales and global health status/quality of life (for country codes, please refer to ). EORTC QLQ-C30, European Organisation for Research and Treatment of Cancer quality of life core.
      Fig. 2
      Fig. 2EORTC QLQ-C30 country reference values for symptom subscales/items (for country codes, please refer to ). EORTC QLQ-C30, European Organisation for Research and Treatment of Cancer quality of life core.

      4. Discussion

      This study is the first to systematically collect European and individual country general population norm data for the EORTC QLQ-C30 using consistent data collection methods across 15 countries in Europe and North America. The ‘European QLQ-C30 Norm’ enables valid inter-country comparisons for cancer-patient data. Data from cancer patients can be compared with sex-/age-matched peers from the general population. In addition, the country-specific norm data for 15 countries, especially for those where no QLQ-C30 norm data yet existed, can be used for country-level comparisons.
      To generate these norm data, we subcontracted data collection via online surveys to a panel research company (GfK). Such internet panels are an efficient and cost-effective method to generate norm data, and there is evidence from a comparable study carried out in the context of the United States Patient-Reported Outcomes Measurement Information System (PROMIS) initiative that data are representative of the general population provided that scores are weighted [
      • Liu H.
      • Cella D.
      • Gershon R.
      • Shen J.
      • Morales L.S.
      • Riley W.
      • et al.
      Representativeness of the patient-reported outcomes measurement information System internet panel.
      ], which is consistent with the methods we applied. As 15 individual samples, however, are more heterogenous compared with aforementioned single-country survey, we compared our sample characteristics with official population statistics where available. For example, in our EU sample, 6.8% of respondents indicated that they were unemployed (weighted data, not shown), which matches the official 2017 EU unemployment rate of 6.7% for individuals older than 25 years [
      • OECD. Harmonised Unemployment Rates (HURs)
      OECD - updated: june 2018.
      ]. Further, 64.4% of respondents reported being married/in a steady relationship, which is slightly higher than the EU average of 59.3% [
      • OECD. SF3.3
      Cohabitation rate and prevalence of other forms of partnership.
      ]. Finally, self-reported prevalence of several health conditions is largely in-line with prevalence rates published in the literature [
      • Breivik H.
      • Collett B.
      • Ventafridda V.
      • Cohen R.
      • Gallacher D.
      Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment.
      ,
      • Gallus S.
      • Lugo A.
      • Murisic B.
      • Bosetti C.
      • Boffetta P.
      • La Vecchia C.
      Overweight and obesity in 16 European countries.
      ,
      • Wittchen H.U.
      • Jacobi F.
      • Rehm J.
      • Gustavsson A.
      • Svensson M.
      • Jonsson B.
      • et al.
      The size and burden of mental disorders and other disorders of the brain in Europe 2010.
      ]. In contrast, individuals with lower educational levels appear underrepresented in our EU sample, with around 90% reporting at least some post-compulsory education. This is generally lower than in most European countries; however, percentage distribution varies widely by country [
      • eurostat
      Share of the population by level of educational attainment, by selected age groups and country.
      ].
      Some observed subgroup and country differences warrant further discussion. For example, in emotional function, several symptom subscales and overall QoL, men reported somewhat better scores than women, a finding also observed in other QLQ-C30 norm data studies [
      • Hinz A.
      • Singer S.
      • Brahler E.
      European reference values for the quality of life questionnaire EORTC QLQ-C30: results of a German investigation and a summarizing analysis of six European general population normative studies.
      ]. Further, in some instances, older respondents reported remarkably high function. For physical function, further subgroup analyses within our oldest age group suggest that decline in self-reported physical function occurs primarily from ≥ 80 years (data not shown). Unfortunately, we did not have sufficient numbers in this age group, as our oldest stratified age group was ≥ 70 years. Also, older respondents' self-reported cognitive function appears high. This finding may be explained by people adjusting health expectations with increasing age. Research also suggests that older persons value different factors compared with younger persons when assessing their health and that younger persons' health perceptions are more affected by health limitations than those of older persons [
      • Idler E.
      • Cartwright K.
      What do we rate when we rate our health? Decomposing age-related contributions to self-rated health.
      ]. Additionally, given that in the oldest age group, over 90% were retired, everyday demands on cognitive function may be lower than that of younger respondents, especially those in the workforce. Hence, the construct we are trying to measure may differ depending on respondents' age. The high cognitive function reported by older respondents may also reflect some degree of selection bias, given that respondents had to have internet access and some computer skills. Finally, several reasons might explain the observed country differences. It is conceivable that items and/or response scales have different meanings in different cultures; however, given EORTC's long-standing experience with translations/linguistic validations, it is unlikely that this explains observed differences [
      • Scott N.W.
      • Fayers P.M.
      • Bottomley A.
      • Aaronson N.K.
      • de Graeff A.
      • Groenvold M.
      • et al.
      Comparing translations of the EORTC QLQ-C30 using differential item functioning analyses.
      ]. It is more likely that differences are indeed true differences between countries and that factors such as the welfare state characteristic [
      • Bergqvist K.
      • Yngwe M.Å.
      • Lundberg O.
      Understanding the role of welfare state characteristics for health and inequalities – an analytical review.
      ] play a role in people's self-reported health.
      This study has several limitations that should be noted. First, as indicated above, targeting older age groups, i.e. ≥ 80 years, could provide further insight into changes in QoL as a consequence of aging. It was beyond the scope of our study to collect these data as costs are disproportionately high because of the need to often conduct personal/telephone interviews instead of online surveys in older age groups. Second, we observed marked floor effects for several symptoms. Such effects are unavoidable when data are obtained from the general (i.e. relatively healthy) population, especially if fixed-length questionnaires, including some single-item subscales, are used. One possible solution to reduce floor/ceiling effects is the use of CAT such as the EORTC CAT Core [
      • Petersen M.A.
      • Aaronson N.K.
      • Arraras J.I.
      • Chie W.C.
      • Conroy T.
      • Costantini A.
      • et al.
      The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire.
      ]. Finally, while our norm data are assumed to be representative of the general population, our sample was relatively highly educated. In our EORTC CAT Core norm data article [
      • Liegl G.
      • Petersen M.A.
      • Groenvold M.
      • Aaronson N.K.
      • Costantini A.
      • Fayers P.M.
      • et al.
      Establishing the European Norm for the health-related quality of life domains of the computer-adaptive test EORTC CAT Core.
      ], we explore the influence of educational level on scores. While significant differences were found, with more highly educated respondents reporting better health, the practical relevance of these differences was very small as indicated by small effect sizes. Also, it was difficult to harmonise educational levels across countries; hence, it is plausible that ‘post-compulsory’ has different meanings in different countries. Despite all of these limitations, online surveys represent an efficient, cost-effective method of obtaining large, representative general population samples. While it comes with disadvantages such as difficulty with reaching older age groups, as seen with the Turkish sample, there are many convincing advantages to this method over personal and telephone interviews (e.g. higher response rates and avoidance of interviewer bias). With the steadily increasing use of the internet in recent years, this method is gaining in popularity [
      • Liu H.
      • Cella D.
      • Gershon R.
      • Shen J.
      • Morales L.S.
      • Riley W.
      • et al.
      Representativeness of the patient-reported outcomes measurement information System internet panel.
      ]. Using internet panels, we were able to obtain a large sample of N = 15,386 persons generating norm data for 15 countries, thereby providing a valuable resource for studies using the QLQ-C30. These general population norm scores are robust, even for stratified analyses, as is evidenced by the generally very small 95% CIs.

      5. Conclusions

      This study generated European (and North American) and individual country norm data for the EORTC QLQ-C30 based on a common sampling strategy and survey design. We recommend that the ‘European QLQ-C30 Norm’ be used to compare self-reported health-related quality of life of cancer patients with general population data, especially in multinational projects.

      Ethical statement

      Ethical approval was not sought as this study is solely based on panel research data. As opposed to medical research where medical professional codes of conduct apply, there is widespread agreement that health research involving volunteers from the general population is not subject to ethical approval. Both the European Pharmaceutical Market Research Association (EphMRA) and the NHS Health Research Authority specify that this type of research does not require ethical approval as long as the research conforms to ethical guidelines. Our online survey was carried out by the panel research company GfK SE which is member of EphMRA. The multinational survey conformed to the required ethical standards by obtaining informed consent from all participants and collecting data completely anonymously. Any identification of the respondents through the authors is impossible.

      Acknowledgements

      This research was funded by the European Organisation for Research and Treatment of Cancer Quality of Life Group (grant number 001 2015). The work of Bernhard Holzner was partially funded by the Austrian Science Fund (FWF #P26930). The authors thank the many translators who kindly volunteered their time to embark on the task of standardising the sociodemographic variables across languages and cultures. In addition to the collaborators of this project, special thanks go to Susan Bartlett for making the variables in English and French suitable for the Canadian context; Eveline Bleiker, Jacobien Kieffer, Marieke van Leeuwen for Dutch; Thierry Conroy for French; Agnes Czimbalmos for Hungarian; Alice Iuso for Italian; Tatyana Ionova for Russian; Juan Ignacio Arraras for Spanish; Eva Hammerlid, Yvonne Brandberg for Swedish; Deniz Yüce for Turkish; and Claire Snyder for English for the U.S.-American context.

      Conflict of interest statement

      None declared

      References

        • Snyder C.F.
        • Aaronson N.K.
        Use of patient-reported outcomes in clinical practice.
        Lancet. 2009; 374: 369-370
        • Blazeby J.M.
        • Avery K.
        • Sprangers M.
        • Pikhart H.
        • Fayers P.
        • Donovan J.
        Health-related quality of life measurement in randomized clinical trials in surgical oncology.
        J Clin Oncol. 2006; 24: 3178-3186
        • Basch E.
        • Dueck A.C.
        Patient-reported outcome measurement in drug discovery: a tool to improve accuracy and completeness of efficacy and safety data.
        Expet Opin Drug Discov. 2016; 11: 753-758
        • Shields A.L.
        • Hao Y.
        • Krohe M.
        • Yaworsky A.
        • Mazar I.
        • Foley C.
        • et al.
        Patient-reported outcomes in oncology drug labeling in the United States: a framework for navigating early challenges.
        Am Health Drug Benefits. 2016; 9: 188-197
        • Kluetz P.G.
        • O'Connor D.J.
        • Soltys K.
        Incorporating the patient experience into regulatory decision making in the USA, Europe, and Canada.
        Lancet Oncol. 2018; 19: e267-e274
        • Porter M.E.
        • Larsson S.
        • Lee T.H.
        Standardizing patient outcomes measurement.
        N Engl J Med. 2016; 374: 504-506
        • Cella D.
        • Yount S.
        • Rothrock N.
        • Gershon R.
        • Cook K.
        • Reeve B.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years.
        Med Care. 2007; 45: S3-S11
        • Petersen M.A.
        • Aaronson N.K.
        • Arraras J.I.
        • Chie W.C.
        • Conroy T.
        • Costantini A.
        • et al.
        The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire.
        Eur J Canc. 2018; 100: 8-16
        • Fischer H.F.
        • Rose M.
        www.common-metrics.org: a web application to estimate scores from different patient-reported outcome measures on a common scale.
        BMC Med Res Methodol. 2016; 16: 142
        • Aaronson N.K.
        • Ahmedzai S.
        • Bergman B.
        • Bullinger M.
        • Cull A.
        • Duez N.J.
        • et al.
        The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
        J Natl Cancer Inst. 1993; 85: 365-376
        • Fayers P.
        • Bottomley A.
        On behalf of the EORTC quality of life group and of the quality of life unit. Quality of life research within the EORTC-the EORTC QLQ-C30.
        Eur J Canc. 2002; 38: S125-S133
        • Zerillo J.A.
        • Schouwenburg M.G.
        • van Bommel A.C.M.
        • Stowell C.
        • Lippa J.
        • Bauer D.
        • et al.
        An international collaborative standardizing a comprehensive patient-centered outcomes measurement set for colorectal cancer.
        JAMA Oncol. 2017; 3: 686-694
        • Ong W.L.
        • Schouwenburg M.G.
        • van Bommel A.C.M.
        • Stowell C.
        • Allison K.H.
        • Benn K.E.
        • et al.
        A standard set of value-based patient-centered outcomes for breast cancer: the international Consortium for health outcomes measurement (ICHOM) initiative.
        JAMA Oncol. 2017; 3: 677-685
        • Revicki D.A.
        • Cella D.F.
        Health status assessment for the twenty-first century: item response theory, item banking and computer adaptive testing.
        Qual Life Res. 1997; 6: 595-600
        • Scott N.W.
        • Fayers P.M.
        • Aaronson N.K.
        • Bottomley A.
        • de Graeff A.
        • Groenvold M.
        • et al.
        EORTC QLQ-C30 reference values.
        2008 (Brussels, Belgium)
        • Klee M.
        • Groenvold M.
        • Machin D.
        Quality of life of Danish women: population-based norms of the EORTC QLQ-C30.
        Qual Life Res. 1997; 6: 27-34
        • Juul T.
        • Petersen M.A.
        • Holzner B.
        • Laurberg S.
        • Christensen P.
        • Gronvold M.
        Danish population-based reference data for the EORTC QLQ-C30: associations with gender, age and morbidity.
        Qual Life Res. 2014; 23: 2183-2193
        • Schwarz R.
        • Hinz A.
        Reference data for the quality of life questionnaire EORTC QLQ-C30 in the general German population.
        Eur J Canc. 2001; 37: 1345-1351
        • Waldmann A.
        • Schubert D.
        • Katalinic A.
        Normative data of the EORTC QLQ-C30 for the German population: a population-based survey.
        PLoS One. 2013; 8 (e74149)
        • Hinz A.
        • Singer S.
        • Brahler E.
        European reference values for the quality of life questionnaire EORTC QLQ-C30: results of a German investigation and a summarizing analysis of six European general population normative studies.
        Acta Oncol. 2014; 53: 958-965
        • van de Poll-Franse L.V.
        • Mols F.
        • Gundy C.M.
        • Creutzberg C.L.
        • Nout R.A.
        • Verdonck-de Leeuw I.M.
        • et al.
        Normative data for the EORTC QLQ-C30 and EORTC-sexuality items in the general Dutch population.
        Eur J Canc. 2011; 47: 667-675
        • Mols F.
        • Husson O.
        • Oudejans M.
        • Vlooswijk C.
        • Horevoorts N.
        • van de Poll-Franse L.V.
        Reference data of the EORTC QLQ-C30 questionnaire: five consecutive annual assessments of approximately 2000 representative Dutch men and women.
        Acta Oncol. 2018; : 1-11
        • Hjermstad M.J.
        • Fayers P.M.
        • Bjordal K.
        • Kaasa S.
        Health-related quality of life in the general Norwegian population assessed by the european organization for research and treatment of cancer core quality-of-life questionnaire: the QLQ=C30 (+ 3).
        J Clin Oncol. 1998; 16: 1188-1196
        • Hjermstad M.J.
        • Fayers P.M.
        • Bjordal K.
        • Kaasa S.
        Using reference data on quality of life – the importance of adjusting for age and gender, exemplified by the EORTC QLQ-C30 (+3).
        Eur J Canc. 1998; 34: 1381-1389
        • Velenik V.
        • Secerov-Ermenc A.
        • But-Hadzic J.
        • Zadnik V.
        Health-related quality of life assessed by the EORTC QLQ-C30 questionnaire in the general slovenian population.
        Radiol Oncol. 2017; 51: 342-350
        • Michelson H.
        • Bolund C.
        • Nilsson B.
        • Brandberg Y.
        Health-related quality of life measured by the EORTC QLQ-C30--reference values from a large sample of Swedish population.
        Acta Oncol. 2000; 39: 477-484
        • Derogar M.
        • van der Schaaf M.
        • Lagergren P.
        Reference values for the EORTC QLQ-C30 quality of life questionnaire in a random sample of the Swedish population.
        Acta Oncol. 2012; 51: 10-16
        • United Nations Department of Economic and Social Affairs Population Division
        World population Prospects: the 2017 revision.
        DVD Edition. 2017
        • Fayers P.
        • Aaronson N.
        • Bjordal K.
        • Groenvold M.
        • Curran D.
        • Bottomley A.
        • et al.
        The EORTC QLQ-C30 scoring manual.
        3rd ed. European Organisation for Research and Treatment of Cancer, Brussels2001
        • Osoba D.
        • Rodrigues G.
        • Myles J.
        • Zee B.
        • Pater J.
        Interpreting the significance of changes in health-related quality-of-life scores.
        J Clin Oncol. 1998; 16: 139-144
        • Liu H.
        • Cella D.
        • Gershon R.
        • Shen J.
        • Morales L.S.
        • Riley W.
        • et al.
        Representativeness of the patient-reported outcomes measurement information System internet panel.
        J Clin Epidemiol. 2010; 63: 1169-1178
        • OECD. Harmonised Unemployment Rates (HURs)
        OECD - updated: june 2018.
        2018
        • OECD. SF3.3
        Cohabitation rate and prevalence of other forms of partnership.
        2016
        • Breivik H.
        • Collett B.
        • Ventafridda V.
        • Cohen R.
        • Gallacher D.
        Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment.
        Eur J Pain. 2006; 10: 287-333
        • Gallus S.
        • Lugo A.
        • Murisic B.
        • Bosetti C.
        • Boffetta P.
        • La Vecchia C.
        Overweight and obesity in 16 European countries.
        Eur J Nutr. 2015; 54: 679-689
        • Wittchen H.U.
        • Jacobi F.
        • Rehm J.
        • Gustavsson A.
        • Svensson M.
        • Jonsson B.
        • et al.
        The size and burden of mental disorders and other disorders of the brain in Europe 2010.
        Eur Neuropsychopharmacol. 2011; 21: 655-679
        • eurostat
        Share of the population by level of educational attainment, by selected age groups and country.
        2016 (2017)
        • Idler E.
        • Cartwright K.
        What do we rate when we rate our health? Decomposing age-related contributions to self-rated health.
        J Health Soc Behav. 2018; 59: 74-93
        • Scott N.W.
        • Fayers P.M.
        • Bottomley A.
        • Aaronson N.K.
        • de Graeff A.
        • Groenvold M.
        • et al.
        Comparing translations of the EORTC QLQ-C30 using differential item functioning analyses.
        Qual Life Res. 2006; 15 (discussion 1117-20): 1103-1115
        • Bergqvist K.
        • Yngwe M.Å.
        • Lundberg O.
        Understanding the role of welfare state characteristics for health and inequalities – an analytical review.
        BMC Publ Health. 2013; 13 (1234): 1234
        • Liegl G.
        • Petersen M.A.
        • Groenvold M.
        • Aaronson N.K.
        • Costantini A.
        • Fayers P.M.
        • et al.
        Establishing the European Norm for the health-related quality of life domains of the computer-adaptive test EORTC CAT Core.
        Eur J Canc. 2018; (in this issue)

      Linked Article