3.1 Phase 1, Generation of issues
The literature searches yielded 232 hits. Of 37 papers, 17 were specific studies assessing oral health. Manual hand searching of the reference lists yielded another two studies. Altogether, 31 relevant questionnaires were reviewed.
The 85 issues covered these domains;
- a)
oral pain, problems and discomfort; 38 items
- b)
oral/dental status and care; 13 items
- c)
functional issues (dryness, chewing, speaking, swallowing); 15 items
- d)
information about oral side-effects; 11 items
- e)
social function and QoL related to oral problems; 8 items.
Eighteen HCPs from Norway (n = 10), United Kingdom (UK) (n = 4) and Greece (n = 4) were interviewed. The selection of professionals was performed to cover a broad spectrum of experience in oral problems in cancer and the experts (male/female: 10/8) consisted of oncologists (n = 8), oncology nurses (n = 4), oral surgeons/dentists (n = 5) and one dental hygienist. Two items were deleted after the HCP interviews; one duplicate, and one that was regarded as being related to physicians’ decision making (‘dose-limiting effect of mouth-problems’).
The 83-item list was then used in interviews with 133 patients from Norway (
n = 30), Greece (
n = 30), UK (
n = 15), Germany (
n = 9), France (
n = 27) and Netherlands (
n = 22), representing different diagnoses and treatment phases,
Table 2.
Table 2Characteristics of patient samples, phase 1 and 3.
Fifty-two items were deleted after the interviews,
Fig. 1. No new issues were suggested, but reformatting of issues (dental care, social relations and information) yielded an additional 10 items. The 41 items and corresponding domains are listed in
Table 3.
Table 3The 41 issues and their hypothesised subscales used in phase 3.
3.2 Phase 2: Construction of the provisional questionnaire
The remaining 41 issues were formatted into questions within the EORTC format. Items that covered the content in full were available from the EORTC item bank for 15 items; 13 from the QLQ-H&N35,
27- Bjordal K.
- Ahlner-Elmqvist M.
- Tollesson E.
- et al.
Development of a European Organization for Research and Treatment of Cancer (EORTC) questionnaire module to be used in quality of life assessments in head and neck patients.
one from the QLQ-BR23
37- Sprangers M.A.
- Groenvold M.
- Arraras J.I.
- et al.
The European Organization for Research and Treatment of Cancer breast cancer-specific quality-of-life questionnaire module: first results from a three-country field study.
and one from the QLQ-STO22
38- Blazeby J.M.
- Conroy T.
- Bottomley A.
- et al.
Clinical and psychometric validation of a questionnaire module, the EORTC QLQ-STO22, to assess quality of life in patients with gastric cancer.
. For another nine issues on social interaction and information, the wording was very similar to items from the QLQ-H&N35
27- Bjordal K.
- Ahlner-Elmqvist M.
- Tollesson E.
- et al.
Development of a European Organization for Research and Treatment of Cancer (EORTC) questionnaire module to be used in quality of life assessments in head and neck patients.
and QLQ-INFO25 modules,
39- Arraras J.I.
- Greimel E.
- Sezer O.
- et al.
An international validation study of the EORTC QLQ-INFO25 questionnaire: an instrument to assess the information given to cancer patients.
requiring a translation of one or two words only. The remaining issues were constructed as there were no identical items in the item bank. Translations were performed according to EORTC guidelines. Specific questions in the pilot interviews revealed that most patients preferred dichotomous scales for the item about dental treatment and use of dentures and that the latter should be followed by a skip session. Thus, seven items (no. 27–30 and 34–36) were dichotomous, and item 29 and 30 were only to be answered for those wearing dentures (
Table 3) in the provisional module. Two items (40 and 41) were formatted with the same 1–7 scale used in the last two items of the EORTC QLQ-C30.
19- Aaronson N.K.
- Ahmedzai S.
- Bergman B.
- et al.
The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
The translation procedures were reviewed by the QLG translation office and the phase 1 and 2 development process was approved by the QLG.
3.3 Phase 3: Testing of the provisional questionnaire for relevance and acceptability
The provisional module and the EORTC QLQ-C30
19- Aaronson N.K.
- Ahmedzai S.
- Bergman B.
- et al.
The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
were completed and interviews performed in 178 patients at nine centres in seven countries (
Table 2). The majority (58%) had education beyond compulsory schooling, were living with others (83%) and had good performance status; mean Karnofsky 82 (SD13). Thirty-two percent had localised disease, 45% advanced while 41 patients (23%) were in the palliative phase of cancer. About one-third of the patients used dentures.
The mean score of the 32 module items with a 4-point categorical scale was 1.5 or above for 10 items. Compliance exceeded 95% for all but one item (36) and a two point range was found with all items except no. 33. No ceiling effect was found, but a floor effect was present with all items. For 13 items, at least 30% of respondents endorsed the symptom. All items, statistical results and patients’ comments were subject to round table discussions in the module development group.
Twenty-four items were deleted (
Table 3) and 17 retained, resulting in a 17-item module; QLQ-OH17. The main reason for deletion was failure to meet the sufficient number of criteria for inclusion.
30Johnson C, Aaronson N, Blazeby J, Bottomley A, Fayers P, Koller M, et al. Guidelines for developing Questionnaire modules. Report 4th Ed. Brussels, 2011.
Nine items were kept despite meeting less than five criteria (3, 5, 8, 12, 20, 31, 34, 37 and 38). Eight of these met four criteria, were judged as clinically relevant by the oncologists and dentists in the module development group, and the majority were emphasised as important by patients.
30Johnson C, Aaronson N, Blazeby J, Bottomley A, Fayers P, Koller M, et al. Guidelines for developing Questionnaire modules. Report 4th Ed. Brussels, 2011.
Item no. 3 (bleeding gums) that met three criteria was retained, due to its high clinical importance in certain situations, and high ranking of importance by patients.
Most patients today are dentate, but many patients have dentures that necessitate special attention e.g. in relation to chemotherapy. Patients were asked if they preferred a dichotomous or 4-point scale for items related to use of dentures, and if a skip session should be inserted. This resulted in the reformatting of one dichotomous item about dentures (46) followed by an optional last question (47).
The mean scores from H&N patients were compared to patients with other cancer types. Significantly higher mean scores (
p < .05) were found with 14 of the items; 4, 10, 11, 14, 15, 16, 20, 21, 22, 28, 29, 37, 40 and 41 in
Table 3, indicating good criterion validity. Seven of these were retained; 10, 14, 15, 16, 20, 28 and 37, meeting five of seven inclusion criteria (37 met four) and were judged as clinically relevant also in patients with other cancers (mean score >1.5 for seven of these eight). No significantly different mean scores were found when comparing the different phases of treatment. No specific language problems were detected.
The provisional questionnaire employed two different time-frames; the conventional EORTC format ‘
during the past week’; no. 1–33 and 37–41,
Table 3 and ‘
during your current disease or treatment,
not only the past week’, as in the QLQ-INFO25.
39- Arraras J.I.
- Greimel E.
- Sezer O.
- et al.
An international validation study of the EORTC QLQ-INFO25 questionnaire: an instrument to assess the information given to cancer patients.
Many patients preferred the longer time frame also for ‘worries about the future’, so this was changed. Additional issues (
n = 24) suggested by patients were either covered by the EORTC QLQ-C30/OH17 (
n = 19), or were regarded as too specific (details about candida, molar pain etc.
n = 5), not tabulated.
The aggregation of single items into scales is recommended to facilitate the interpretation of results.
30Johnson C, Aaronson N, Blazeby J, Bottomley A, Fayers P, Koller M, et al. Guidelines for developing Questionnaire modules. Report 4th Ed. Brussels, 2011.
Three multi-item scales were proposed in the QLQ-OH17, based on their content and clinical relevance; pain discomfort, xerostomia and eating. Cronbach’s alpha coefficient was calculated, including the multi-trait scaling matrix, yielding coefficients from .67 to .77 for the proposed scales indicating good internal consistency,
Table 4. A fourth scale related to information was also suggested, consisting of two items. Cronbach’s alpha coefficient was not calculated for this scale as one of the items was dichotomous. Three single items were suggested; two on dentures and one about future worries.
Table 4Internal consistency—Cronbach’s alpha values.