- Open Access
The pediatric rheumatology quality of life scale: validation of the English version in a US cohort of juvenile idiopathic arthritis
© Weiss et al.; licensee BioMed Central Ltd. 2013
- Received: 7 June 2013
- Accepted: 28 September 2013
- Published: 8 November 2013
This study aims to validate the English version of the Pediatric Rheumatology Quality of Life Scale (PRQL), a concise Health Related Quality of Life (HRQoL) measure, in a US cohort of children with juvenile idiopathic arthritis (JIA).
The PRQL is a 10-item HRQoL measure with two subscales: physical health and psychological health. The original version of this measure was validated using an Italian-speaking cohort of 472 JIA patients and 796 healthy controls and found to have acceptable psychometric properties. The English language version has not been validated in a US pediatric population. The English PRQL was administered to 161 JIA subjects from a US Rheumatology clinic. We assessed the reliability (internal consistency and test-retest) and validity (convergent, discriminative, and criterion) of the PRQL.
The English PRQL was feasible to administer and demonstrated good psychometric properties. Cronbach alpha (reliability) coefficients ranged from 0.72 to 0.81. Factor analysis yielded the existing subscales. The PRQL total and subscales were found to have moderate correlations with other HRQoL instruments, the Pediatric Quality of Life Inventory (PedsQL) generic core scale and the PedsQL rheumatology. The PRQL discriminated between subjects with active versus inactive disease and was responsive to an improvement or worsening in disease activity over time.
Our results suggest that the English version of the instrument is suitable for use in JIA patients in the US. This tool provides a relatively easy method to integrate at least one patient-reported outcome into routine clinical or research assessment.
- Quality of life
- Patient-reported outcomes
- Juvenile arthritis
The importance of patient-reported outcomes (PROs), reported by pediatric patients and their parents, is increasingly emphasized in both routine clinic care and research. PROs include items such as health related quality of life (HRQoL), functional status, pain, and satisfaction. Recently, the Consolidated Standards of Reporting Trials (CONSORT) patient reported outcome extension was released that urged inclusion of PROs as primary or secondary outcomes in ancillary analyses for all randomized controlled trials . PROs are also important for high-quality patient centered care and comprehensive decision-making. HRQoL is a particularly important PRO to include in the overall assessment of children with juvenile idiopathic arthritis (JIA). If clinical assessment is limited to physician-determined items such as active joint count, the impact of factors such as medication side effects, fear of injections, and missed school for medication infusions may be overlooked.
Several validated HRQoL measures exist to measure HRQoL in children with rheumatology conditions e.g. the Pediatric Quality of Life Inventory (PedsQL) and the Juvenile Arthritis Quality of Life Questionnaire (JAQQ)), but these existing instruments are either time consuming, costly, and/or complicated to administer in clinical settings. The PedsQL has been validated and used extensively in a wide range of diseases, including JIA [2–6]. However, the PedsQL Generic Core contains 23 items and the PedsQL Rheumatology Module contains 22 items, rendering them cumbersome to complete during a clinic visit. Further, the PedsQL Generic Core and Rheumatology modules are costly to use in routine clinical practice . The JAQQ is a validated rheumatology specific measure that has also been used in JIA and outcomes studies [8–11]. Similar to the PedsQL it is time consuming to complete with 74 items. The ability of children to select the 5 most problematic areas in each domain to answer allows for a unique individualized assessment over time but makes comparison of scores across children problematic .
The feasibility constraints of the previous HRQoL instruments led to the development of the Pediatric Rheumatology Quality of Life Scale (PRQL), a concise 10-item HRQoL measure designed for use in the clinical setting but with potential utility for research . Items included in the PRQL were derived from literature review, analysis of existing HRQoL measures, study panel discussion, and face-to-face interviews of children with rheumatic disease and their parents. Two independent individuals translated the Italian version of the PRQL to English . Two native-English translators then independently translated the English version back to Italian. The translation was assessed by a focus group of Pediatric Rheumatology International Trials Organization (PRINTO) employees with translation expertise to ensure the content of the instrument was preserved across translation. The Italian version of PRQL was validated using an Italian cohort of 472 JIA patients and 796 healthy controls. The median age of JIA patients was 8.7 (IQR: 4.7, 12.2) years. The comparison group of healthy children had a similar age distribution . The PRQL possessed good measurement properties, including feasibility and face, content, and construct validity, test-retest reliability, and good responsiveness to patient improvement over time. A Cronbach’s α of 0.86 demonstrated good internal consistency. The PRQL is available in English but has not been validated in a US pediatric population .
The PRQL is an attractive option for use in routine clinical practice because it is free, takes less than 5 minutes to complete, and less than 1 minute to score. The aim of this study was to validate the English PRQL in JIA subjects from our US clinical practice, using the PedsQL (generic core and rheumatology module) as the gold standard.
Human subjects protections
The protocol for the conduct of this study was reviewed and approved by the Committee for the Protection of Human Subjects.
The source population for the study was children with a diagnosis of JIA who were 18 years of age or younger and evaluated in the rheumatology clinic between August 2011 and June 2012. Subjects were a convenience sample enrolled without regard to disease duration, disease severity, current disease activity, or therapy. All subjects met International League of Associations for Rheumatology (ILAR) criteria  for JIA according to the treating physician. 96% (161/167) of people approached agreed to participate in the study.
The following demographics and clinical characteristics were collected at the study visit: age, disease duration, sex, race, and ILAR category.
Quality of life
The PRQL, PedsQL generic scale (version 4.0), and the PedsQL-Rheumatology module (version 3.0) were completed by the parent(s)/legal guardian(s) or by the participant if 13 to 18 years old.
The PRQL is a concise 10-item QOL measurement that uses 4-point Likert scales from 0 (never) to 3 (all the time). Items are grouped into 2 subscales, physical health (PhH) and psychosocial health (PsH). The total score ranges from 0 to 30, where higher scores indicate worse HRQoL. If more than 2 questions are not answered in each sub-domain, the PRQL score is not computed .
The PedsQL has been validated and used extensively in a wide range of diseases, including JIA [2–6]. The PedsQL has a validated rheumatology module for use among patients with JIA . The PedsQL Generic Core contains 23 items, and the PedsQL Rheumatology Module contains 22 items. Both the generic and rheumatology questionnaires use 5-point Likert scales from 0 (never) to 4 (almost always). Scores are transformed on a scale from 0 to 100, where higher scores indicate better HRQoL.
At enrollment the subject or parent was asked, “How much pain have you [or your child] had because of your [his/her] rheumatic condition in the past week?” Pain intensity was reported using integers from 0 to 10, anchored by the words “No Pain” and “Very Severe Pain”. High correlation between the traditional 10-centimeter visual analogue scale (VAS) and the integer-based scale has been reported for the measurement of pain intensity [16–18].
Subjects or parents rated the subject’s disease-related functional status during the past week using the Childhood Health Assessment Questionnaire (CHAQ) . A disability index (DI) is calculated based on the mean of the 8 domains; the DI ranges from 0 to 3, with higher scores indicating worse disability .
Parent/subject global health status
At enrollment the subject or parent was asked, “Considering all the ways that arthritis affects you/your child, how do you rate how he/she is doing in the past week?” Status was reported using integers from 0 to 10, anchored by the words “Very well” and “Very poor”.
A physician disease activity VAS was reported for each visit using integers from 0 to 10. Physicians also determined whether subjects met criteria for inactive disease according to the ACR provisional criteria . Subjects who did not fulfill these criteria were considered as having active disease.
Study data were managed using Research Electronic Data Capture (REDCap) tools hosted at Children’s Hospital of Philadelphia .
In order to assess test-retest reliability, a small subset of subjects were asked to retake the PRQL. Forty-three enrolled subjects or parents were emailed a copy of the PRQL one week after the initial administration of the questionnaire. A period of one week was used, as it is not too short that respondents will not remember their first response and not too long that the patients’ HRQoL will have changed .
We assessed the validity of the English version of the PRQL using the Outcome Measures in Rheumatoid Arthritis Clinical Trials (OMERACT) filter . The OMERACT filter was developed to simplify and standardize the terminology used in rheumatology outcome and validation studies.
Internal consistency reliability
Internal consistency was determined using Cronbach’s alpha coefficient. Estimates greater than or equal to 0.70 were considered acceptable.
Test-retest reliability was assessed using the intraclass correlation coefficient (ICC) for total and both subscale scores.
Confirmatory factor analysis
Factor analysis is used to identify over-arching factors that account for the common variance in the observed PRQL items, excluding item-specific (unique) variance . We used confirmatory factor analysis (CFA which is a type of factor analysis,) to test how well the 2-factor model obtained for the Italian version of the instrument fit our data. CFA was conducted since this instrument’s factor structure is already known from previous research. A Bentler’s Comparative Fit Index (CFI) > 0.9, Bentler & Bonnett’s Non-Normed Fit Index (NNI) > 0.9, and the root mean square error of approximation (RMSEA) < 0.1 were considered indicative of an acceptable model fit .
Post-hoc exploratory factor analysis
A post-hoc exploratory factor analysis of the PRQL was also performed to check if the two-factor model fit would be confirmed without making assumptions about the data. We performed a common factor analysis, which is more suitable for identifying latent factors than principal components analysis. A maximum likelihood factor analysis was performed in which squared multiple correlations were used for the initial commonality estimates. A promax (oblique) rotation was used to identify the underlying factor structure.
Convergent and discriminative validity
Convergent validity of the candidate index was tested using the PedsQL 4.0 generic scale integrated with the PedsQL-Rheumatology 3.0 module as the gold standard. We used two methods to assess correspondence between the two standardized measures: 1) Spearman’s correlation, and 2) the method of Bland and Altman . The latter method evaluates the distribution of the differences and plots them against the standardized mean of the two measures.
Discriminative validity was evaluated by comparing median PRQL scores between subjects with physician-determined inactive disease (physician VAS of 0) versus active disease (physician VAS≥1), using a Wilcoxon rank sum test.
Responsiveness to change
Responsiveness of the PRQL to clinical change over time was tested in subjects with a follow-up visit 3–7 months after the initial study visit. We compared the mean change in PRQL between visits in subjects who had an improvement or worsening in disease activity according to the treating physician using a two-tailed t-test and the standardized response mean (SRM). The SRM is the mean PRQL score divided by the standard deviation of that score change . SRMs were adjusted for the correlation between the 2 PRQL measurements in order to correctly apply Cohen’s thresholds of responsiveness . An SRM ≥0.50 and ≥0.80 are considered evidence of moderate and large responsiveness, respectively [28, 29].
Age at visit, years (median, IQR)
11.6 (7.2, 15.5)
Disease duration, years (median, IQR)
2.8 (1.2, 5.5)
More than 1 race
Physician disease activity VAS (median, IQR)
Inactive disease, on medication < 6 months
Clinical remission while on medication
Clinical remission, off medication <12 months
Clinical remission, off medication >12 months
Subject/parent global health status VAS
1 (0, 3)
Subject/parent pain VAS
1 (0, 4)
The PRQL was simple for subjects and parents to comprehend. Completion of the PRQL required less than 5 minutes. Scoring of the questionnaire was straightforward and took less than 1 minute.
Pediatric rheumatology quality of life scale
Item-total scale correlation
Physical health subscale
Item 1: Been limited in taking care of him/herself, that is, eating, dressing, or washing him/herself?
Item 2: Been limited in walking one block or climbing one flight of stairs?
Item 3: Been limited in doing activities that take a lot of energy, such as running, playing soccer, or dancing?
Item 4: Been limited in doing schoolwork or activities with friends?
Item 5: Had bodily discomfort?
Psychosocial health subscale
Item 6: Felt sad or blue?
Item 7: Felt anxious or acted nervous?
Item 8: Had troubles getting along with other children?
Item 9: Had difficulty concentrating or paying attention?
Item 10: Felt dissatisfied about his/her looks or abilities?
Internal consistency reliability
Cronbach’s α was 0.81, 0.72, and 0.78 for the total score, PhH subscale and PsH subscale, demonstrating good internal consistency. Cronbach’s α for the PRQL total score and subscales among the following respondent subgroups were equal to or greater than 0.70: males, females, inactive disease, and active disease.
Forty-three enrolled subjects or parents were emailed a copy of the PRQL one week after the initial administration of the questionnaire. The average time between questionnaire completions was 11 days (IQR: 7,15). The pairwise correlation coefficient and ICC for test-retest reliability were 0.72 and 0.68, respectively, thereby demonstrating adequate reliability.
Correlation between PRQL scores and the PedsQL generic and rheumatology modules and other clinical variable
Generic core scales
Pain and hurt
Parent/patient global health status VAS
Parent/patient pain VAS
Active joint count
Physician disease activity VAS
We also assessed the correspondence between the PRQL and physician-determined disease activity and other PROs (Table 3). The PRQL and PhH subscale were moderately correlated with the parent’s assessment of global health status and pain. Correlations of the PRQL, PhH, and PsH and the active joint count and physician-determined disease activity were low. Correlations of the PedsQL total, physical health, and psychosocial health scores and the physician-determined disease activity were similarly low (0.32, 0.37, and 0.21, respectively).
Discriminative validity was evaluated using physician disease activity VAS as the external criterion. Children with a physician disease activity VAS of 0 (N=89) and those with a VAS equal to or greater than 1 (N=57) were compared using a Wilcoxon rank sum test. The median PRQL scores for children with a physician VAS of 0 and ≥1 were 1 (IQR: 1,3) and 3 (IQR: 1,5), respectively (p-value <0.001).
The PRQL is a concise 10-item assessment of HRQoL that was created primarily for use in clinical practice. This prospective study supports the validity of this HRQoL assessment in JIA patients in our US clinical practice. Using cross-sectional data from 161 JIA subjects we have shown evidence of feasibility, convergent validity, discriminative validity, internal consistency, test-retest ability, and responsiveness. Content validity of the English PRQL was established prior to this study. The Italian PRQL was found to have strong content and face validity . The Italian version was carefully forward- and back-translated to preserve the content of the instrument and observe any difficulties or problems with the translation. The rigorousness of the translation and testing of the translated version provide support for the content validity of the English version of the PRQL. Interestingly the correlations between the PRQL and the active joint count and physician disease activity VAS were low. Correlation between the PedsQL and physician disease activity VAS was similarly low. While these measurements assess different constructs of disease, one might expect that active disease greatly affects HRQoL, albeit not in a linear fashion. These findings highlight the importance of collecting PROs both in clinical practice and registries as they provide different qualitative information.
The brevity of this assessment tool makes it a feasible and non-onerous measure to collect and score as part of routine clinical practice. The limited number of items does not cover the breadth of other HRQoL assessments available for use in pediatric rheumatology including the PedsQL and JAQQ. However, we have shown moderate correlation with at least one of these measures, the PedsQL, by two different methods. For clinicians who aspire to collect PROs but do not have the luxury of time to administer, score, or pay for the PedsQL and/or JAQQ the PRQL is a reasonable alternative.
Our findings should be interpreted in the context of several limitations. First the validity assessment was confined to JIA patients and did not include other rheumatologic conditions. The validity of this measurement tool in other pediatric rheumatology conditions should be explored in future analyses. Second, our study population was a convenience sample of JIA subjects; however, they were recruited without regard to disease duration, disease severity, current disease activity, or therapy. Disease attributes may have differed in children who were and were not enrolled in this study; however, we expect that any selection bias would be non-differential in regards to this validity analysis.
Despite caveats, our study indicates the PRQL is a valid tool for the assessment of HRQoL in children and adolescents with JIA in our US practice. Further it is easy to administer, simple and quick to complete, and takes minimal time and effort to score. This tool provides a relatively easy method to integrate PROs into routine clinical assessment and research.
The authors would like to thank Allyson Gutstein, Jenna Tress, and Cara Hoffart for their assistance with subject recruitment. The authors are also grateful to Colden Broderick and Mithin Thomas for their assistance with data entry.
- Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD: Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA. 2013, 309 (8): 814-822. 10.1001/jama.2013.879.View ArticlePubMedGoogle Scholar
- Yang X, Xiao N, Yan J: The PedsQL in pediatric cerebral palsy: reliability and validity of the Chinese version pediatric quality of life inventory 4.0 generic core scales and 3.0 cerebral palsy module. Qual Life Res. 2011, 20 (2): 243-252. 10.1007/s11136-010-9751-0.View ArticlePubMedGoogle Scholar
- Limbers CA, Ripperger-Suhler J, Heffer RW, Varni JW: Patient-Reported Pediatric Quality of Life Inventory 4.0 Generic Core Scales in Pediatric Patients with Attention-Deficit/Hyperactivity Disorder and Comorbid Psychiatric Disorders: Feasibility, Reliability, and Validity. Value Health. 2011, 14 (4): 521-530. 10.1016/j.jval.2010.10.031.View ArticlePubMedGoogle Scholar
- Tsuji N, Kakee N, Ishida Y: Validation of the Japanese version of the Pediatric Quality of Life Inventory (PedsQL) cancer module. Health Qual Life Outcomes. 2011, 9 (1): 22-10.1186/1477-7525-9-22.PubMed CentralView ArticlePubMedGoogle Scholar
- Varni JW, Seid M, Kurtin PS: PedsQL 4.0: reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Med Care. 2001, 39 (8): 800-812. 10.1097/00005650-200108000-00006.View ArticlePubMedGoogle Scholar
- Varni JW, Seid M, Smith Knight T, Burwinkle T, Brown J, Szer IS: The PedsQL in pediatric rheumatology: reliability, validity, and responsiveness of the pediatric quality of life inventory generic core scales and rheumatology module. Arthritis Rheum. 2002, 46 (3): 714-725. 10.1002/art.10095.View ArticlePubMedGoogle Scholar
- PedsQL conditions of use: fees. 2011, http://www.pedsql.org/conditions.html. Accessed May 13, 2011
- Gao Y, Johnston RC, Karam M: Pediatric sports-related lower extremity fractures: hospital length of stay and charges: what is the role of the primary payer?. Iowa Orthop J. 2010, 30: 115-118.PubMed CentralPubMedGoogle Scholar
- Dempsey RL, Layde PM, Laud PW, Guse CE, Hargarten SW: Incidence of sports and recreation related injuries resulting in hospitalization in Wisconsin in 2000. Inj Prev. 2005, 11 (2): 91-96. 10.1136/ip.2004.006205.PubMed CentralView ArticlePubMedGoogle Scholar
- Fournie B, Margarit-Coll N, Champetier de Ribes TL: Extrasynovial ultrasound abnormalities in the psoriatic finger. Prospective comparative power-doppler study versus rheumatoid arthritis. Joint Bone Spine. 2006, 73 (5): 527-531. 10.1016/j.jbspin.2006.01.019.View ArticlePubMedGoogle Scholar
- Stoll ML, Punaro M: Psoriatic juvenile idiopathic arthritis: a tale of two subgroups. Curr Opin Rheumatol. 2011, 23 (5): 437-443. 10.1097/BOR.0b013e328348b278.View ArticlePubMedGoogle Scholar
- Kuikka PI, Pihlajamaki HK, Mattila VM: Knee injuries related to sports in young adult males during military service - Incidence and risk factors. Scand J Med Sci Sports. 2013, 23 (3): 281-287. 10.1111/j.1600-0838.2011.01397.x.View ArticlePubMedGoogle Scholar
- Filocamo G, Schiappapietra B, Bertamino M: A new short and simple health-related quality of life measurement for paediatric rheumatic diseases: initial validation in juvenile idiopathic arthritis. Rheumatology (Oxford). 2010, 49 (7): 1272-1280. 10.1093/rheumatology/keq065.View ArticleGoogle Scholar
- Consolaro A, Ruperto N, Filocamo G: Seeking insights into the EPidemiology, treatment and Outcome of Childhood Arthritis through a multinational collaborative effort: introduction of the EPOCA study. Pediatr Rheumatol. 2012, 10: 39-10.1186/1546-0096-10-39.View ArticleGoogle Scholar
- Petty RE, Southwood TR, Manners P: International League of Associations for Rheumatology classification of juvenile idiopathic arthritis: second revision, Edmonton, 2001. J Rheumatol. 2004, 31 (2): 390-392.PubMedGoogle Scholar
- Price DD, Bush FM, Long S, Harkins SW: A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales. Pain. 1994, 56 (2): 217-226. 10.1016/0304-3959(94)90097-3.View ArticlePubMedGoogle Scholar
- Carlsson AM: Assessment of chronic pain. I. Aspects of the reliability and validity of the visual analogue scale. Pain. 1983, 16 (1): 87-101. 10.1016/0304-3959(83)90088-X.View ArticlePubMedGoogle Scholar
- Bijur PE, Latimer CT, Gallagher EJ: Validation of a verbally administered numerical rating scale of acute pain for use in the emergency department. Acad Emerg Med. 2003, 10 (4): 390-392. 10.1111/j.1553-2712.2003.tb01355.x.View ArticlePubMedGoogle Scholar
- Singh G, Athreya BH, Fries JF, Goldsmith DP: Measurement of health status in children with juvenile rheumatoid arthritis. Arthritis Rheum. 1994, 37 (12): 1761-1769. 10.1002/art.1780371209.View ArticlePubMedGoogle Scholar
- Ruperto N, Ravelli A, Pistorio A: Cross-cultural adaptation and psychometric evaluation of the Childhood Health Assessment Questionnaire (CHAQ) and the Child Health Questionnaire (CHQ) in 32 countries. Review of the general methodology. Clin Exp Rheumatol. 2001, 19 (4 Suppl 23): S1-S9.PubMedGoogle Scholar
- Wallace CA, Giannini EH, Huang B, Itert L, Ruperto N: American College of Rheumatology provisional criteria for defining clinical inactive disease in select categories of juvenile idiopathic arthritis. Arthritis Care Res (Hoboken). 2011, 63 (7): 929-936. 10.1002/acr.20497.View ArticleGoogle Scholar
- Harris PA, Taylor R, Robert T, Payne J, Gonzalz N, Conde JG: Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Informatics. 2009, 42 (2): 377-381. 10.1016/j.jbi.2008.08.010.View ArticleGoogle Scholar
- Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 2003, Oxford; New York: Oxford University Press, 3Google Scholar
- Boers M, Brooks P, Strand CV, Tugwell P: The OMERACT filter for outcome measures in rheumatology. J Rheumatol. 1998, 25 (2): 198-199.PubMedGoogle Scholar
- Gorsuch R: Factor Analysis. 1983, Hillsdale, New Jersey: Lawrence Erlbaum Associates, Inc, PublishersGoogle Scholar
- Hatcher L: A Step-by-Step Approach to Using SAS for Factor Analysis and Structural Equation Modeling. 1994, Cary, NC: SAS Institute, 1Google Scholar
- Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.View ArticlePubMedGoogle Scholar
- McGonagle D, Ash Z, Dickie L, McDermott M, Aydin SZ: The early phase of psoriatic arthritis. Ann Rheum Dis. 2011, 70 (Suppl 1): i71-i76. 10.1136/ard.2010.144097.View ArticlePubMedGoogle Scholar
- McGonagle DG, Helliwell P, Veale D: Enthesitis in psoriatic disease. Dermatology. 2012, 225 (2): 100-109. 10.1159/000341536.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.