Physician assessment of disease activity in JIA subtypes. Analysis of data extracted from electronic medical records
© Miller et al; licensee BioMed Central Ltd. 2011
Received: 3 November 2010
Accepted: 14 April 2011
Published: 14 April 2011
Although electronic medical records (EMRs) have facilitated care for children with juvenile idiopathic arthritis (JIA), analyses of treatment outcomes have required paper based or manually re-entered data. We have started EMR discrete data entry for JIA patient visits, including joint examination and global assessment, by physician and patient. In this preliminary study, we extracted data from the EMR to Xenobase™ (TransMed Systems, Inc., Cupertino, CA), an application permitting cohort analyses of the relationship between global assessment to joint examination and subtype.
During clinic visits, data were entered into discrete fields in ambulatory visit forms in the EMR (EpicCare™, Epic Systems, Verona, WI). Data were extracted using Clarity Reports, then de-identified and uploaded for analyses to Xenobase™. Parameters included joint examination, ILAR diagnostic classification, physician global assessment, patient global assessment, and patient pain score. Data for a single visit for each of 160 patients over a 2 month period, beginning March, 2010, were analyzed.
In systemic JIA patients, strong correlations for physician global assessment were found with pain score, joint count and patient assessment. In contrast, physician assessment for patients with persistent oligoarticular and rheumatoid factor negative patients showed strong correlation with joint counts, but only moderate correlation with pain scores and patient global assessment. Conversely, for enthesitis patients, physician assessment correlated strongly with pain scores, and moderately with joint count and patient global assessment. Rheumatoid factor positive patients, the smallest group studied, showed moderate correlation for all three measures. Patient global assessment for systemic patients showed strong correlations with pain scores and joint count, similar to data for physician assessment. For polyarticular and enthesitis patients, correlation of patient global assessment with pain scores was strong. Moderate correlations were found between patient global assessment and joint count in oligoarticular and polyarticular patients.
Data extraction from the EMR is feasible and useful to evaluate JIA patients for indicators of treatment responsiveness. In this pilot study, we found correlates for physician global assessment of arthritis differed, according to disease subtype. Further data extraction and analyses will determine if these findings can be confirmed, and will assess other outcome measures, compare longitudinal responses to treatment, and export extracted data to multi-center databases.
Juvenile idiopathic arthritis (JIA) is characterized by joint inflammation with onset at or before sixteen years of age . Recent studies of biologic agents [2, 3], have relied upon a core set of outcome measures, including components of physical examination, physician and patient global assessment, and pain scores . Other disease status measures validated to measure remission  and define minimally active disease  have found that, despite current treatment, many children, including those with initial response, have disease recurrences, measured by remission criteria .
Physician global assessment is an important component of all these outcome measures, distinct from joint counts, patient pain assessment, and other components. Physician and patient global assessments have been used to define minimal disease activity . Studies have not determined the extent to which physician global assessment correlates with joint counts or pain assessments, depending upon JIA subtype. The advent of the electronic medical record (EMR) permits data extraction to address this type of question more efficiently than permitted by a study of paper based records.
Since 2008, we have used an EMR to document all outpatient visits, resulting in more rapid and better organized access to medical information. We recently incorporated the ability to enter discrete data for all visits of children with juvenile idiopathic arthritis. In addition to extracting data in preparation for participation in multi-center studies, we have started to analyze extracted data concerning clinical status and assessment of JIA patients. In this preliminary study, we used EMR data extraction to study the relationship of physician global assessment to patient global assessment and pain scores in patients with different JIA subtypes.
Patients and methods
We studied data for all patients meeting ILAR diagnostic criteria for juvenile idiopathic arthritis  seen by M.M. and M.K.G. at Children's Memorial Hospital pediatric rheumatology clinics for 2 months starting March 2010. Patients in the Undifferentiated arthritis category were not included because of heterogeneous characteristics of these patients. In the other ILAR subtypes, 160 patients were seen.
Demographic and disease characteristics
Age data (birth date, date of each visit) were extracted. Additional extractable disease characteristics consisted of diagnostic subtype, joint count (active joints, as defined in reference ), pain score, physician and patient global assessment. ANA, rheumatoid factor (RF), and B27 status had been tested within the first 4 months of diagnosis and available (as noted in parentheses) for the subgroups as follows: 18 systemic patients (18 ANA, 12 RF, 0 B27); 63 oligoarticular persistent patients (59 ANA, 43 RF, 21 B27); 6 oligoarticular extended patients (6 ANA, 5 RF, 2 B27); 40 RF negative polyarticular patients (38 ANA, 35 RF, 15 B27); 12 RF positive polyarticular patients (12 ANA, 12 RF, 6 B27); 3 psoriatic arthritis patients (3 ANA, 3 RF, 2 B27), 18 enthesitis patients (18 ANA, 15 RF, 15 B27). Per cent positive for each test is expressed as per cent of all patients in the subgroup.
Physician and patient assessment
Physician global assessment of overall disease activity  used a scale from 0 to 10. Patient pain was rated on a Likert scale (with 0 = no pain and 10 = very severe pain) in response to the question "By giving a number between 0 and 10, with 0 being no pain and 10 being the worst possible pain, how much pain on average have you experienced from your arthritis over the past week?" Patient global assessment was rated on a Likert scale (with 0 = doing very poorly and 10 = doing very well) in response to the question "By giving a number between 0 and 10, with 0 being doing very poorly and 10 being doing very well, how have you experienced your arthritis in general over the past week? Include not only pain, but also how you feel about your arthritis, how having arthritis affects your getting along with family and friends, and how well you can move around." Of the 160 patients, 132 (83%) self reported pain and global assessments (13.0 ± 4.0 years). Of the other 28 patients (6.3 ± 2.7 years), mothers of 26 patients reported, and fathers reported for 2 patients.
Data Entry into the Electronic Medical Record
Data Extraction from the Electronic Medical Record
Descriptive statistics are presented as median (minimum, maximum) for continuous variables or frequency (percentage) for categorical variables. We used Spearmann Rank correlation coefficients to measure pair-wised correlations among physician assessment and patient pain score, global assessments, and joint counts for all subtypes except extended oligoarticular and psoriatic arthritis, due to the small numbers of patients in those groups. Correlations were considered strong for values >0.7, moderate for 0.4 - 0.7, and weak for <0.4. All statistical analyses were performed using SAS® version 9.2 (SAS Institute, Inc., Cary, NC).
Demographic and disease characteristics
10.7 (5.8, 19.9)
9.9 (2.6, 18.6)
15.3 (10.8, 21.1)
11.2 (3.5,1 9.6)
17.0 (9.7, 21.2)
Onset age (yrs)
5.5 (0.9, 13.0)
3.7 (0.8, 15.8)
8.2 (1.6, 14.8)
10.3 (3.0, 15.6)
Diagnostic age (yrs)
6.1 (1.0, 13.3)
4.3 (1, 16.6)
9.2 (1.9, 15.3)
5.4 (1.3, 17.3)
13.2 (9.7, 18.4)
Duration from diagnosis (yrs)
0.3 (0, 10.0)
0.3 (0, 2.0)
0.4 (0.0, 5.4)
2.1 (0, 5.3)
ANA+ n (%)
RF+ n (%)
B27+ n (%)
Values of outcome measures
Physician global assessment
Patient global assessment
7.75 (0, 10)
Patient pain score
Joint Count = 0 n (%)
Physician Global Assessment in JIA subtypes
Spearman's correlations between Physician Global Assessment and other outcome measures in JIA subtypes
Physician Global Assessment vs.
patient global assessment
Patient Global Assessment in JIA subtypes
Spearman's correlations Patient Global Assessment and other outcome measures in JIA subtypes
Patient Global Assessment vs.
The aim of this study was to determine the extent to which physician global assessment correlates with pain and joint count for JIA patients with different subtypes, using data extracted from the electronic medical record. We found the extraction process efficient, permitting a study too time consuming to perform in our center, if data were only available from paper records. Distribution of JIA subtypes was similar to that previously reported , except for fewer numbers of psoriatic arthritis patients, perhaps because of different ethnic distributions or shorter period of time for data collection in our study. Half of our enthesitis patients were ANA positive, possibly a result of small sample size.
Validating data was necessary to ensure data extraction yielded identical target and source data. For example, we found incorrect EMR formatting caused some data appear to be absent, when physician or patient global assessment was entered as zero. This was easily corrected, but would have been missed had there not been a validation process. When dates of disease onset and diagnosis were prior to EMR implementation, requiring data extraction from paper records, we used at least two inspections of the data. Although prospective studies eventually will not derive data from paper records, data validation from EMR sources and targets will always be necessary, if only because necessary EMR software upgrades have potential to alter data flow from source to target applications. Re-identification of de-identified data is also critical for data validation in research using data extracted from EMRs. To verify that data contents and formats have been maintained from the moment of data entry into the EMR to the time of data uploading to the data target, cross checking against data from several re-identified patients is best carried out by visual comparisons by the investigator.
In the current study, we found physician global assessment of persistent oligoarticular and rheumatoid factor negative polyarticular patients strongly correlated with joint count but moderately with patient pain scores and global assessment (Table 3). However, patient assessments showed higher correlation with pain scores than joint counts in polyarticular patients (Table 4), raising the possibility that these patients factored pain more than extent of arthritis into their global assessments. In contrast to these JIA subtypes, only for systemic JIA patients were there strong correlations between physician global assessments and all the other outcome measures tested (Table 3). This possibly reflects differences in disease characteristics in this subtype compared to others, although low joint counts in this group probably accounted for the high correlation coefficients between physician and patient assessments.
In contrast to oligoarticular and rheumatoid factor negative patients, in enthesitis patients we found a strong correlation between physician global assessment and pain score, rather than joint count. Most likely, enthesitis contributed to these correlations. A quantitative measure of enthesitis on physical examination, that might correlate with physician and patient assessments, is lacking, perhaps because of difficulties inherent in validation. Correlations between pain scores and joint counts in all JIA subtypes tended to be lower than other correlations (data not shown), possibly because pain assessment during clinic visits can be insensitive, suggested by a study using daily pain diaries .
Physician global assessment, while a subjective interpretation of patient status, has been used as a component of outcome scores, validated for drug studies  and JIA remission criteria . Few investigators have explored its relationship to other outcome score components. In one study with findings similar to ours, Berntson et al found a strong relationship with joint count  in 312 Scandinavian patients with all JIA subtypes, excluding systemic onset. This study did not compare physician global assessment to patient global assessment or pain scores, as it addressed the role of joint size in physician assessment.
We found no differences among JIA subtypes for data distributions of physician or patient global assessments, or for joint count, perhaps because of small sample sizes and large numbers of patients with zero joint counts. Findings from this preliminary study need to be confirmed with studies of larger numbers of patients, which may identify differences among subgroups. We did not characterize whether physician assessment correlated to medication status; multi-center longitudinal studies may be better able to address this question. Finally, although it is possible that physician assessment varied, when we analyzed data from patients by physician, no such variability was found.
Ours is one of the first studies of JIA patients to use the EMR as a source of data, which can be used for quality improvement studies , as has been used for adults with arthritis . While quality studies for children with arthritis using EMR derived data remain to be published , the Child Arthritis and Rheumatology Research Alliance is establishing registries for childhood rheumatic diseases, based upon widespread interest and participation of pediatric rheumatologists [16, 17].
In conclusion, we have established extractable clinical data in electronic medical records for the purpose of monitoring the status of JIA patients. In this preliminary study, we found correlates of physician assessment vary with disease subtype. We anticipate adding other response measures and using extracted data to contribute to multi-center national registries.
For their assistance in implementing discrete data structures in the EMR, we thank our colleagues in Information Management, Children's Memorial Hospital, Arnold Butiu and Lattice Bell. For sharing information on data entry structure and operational assistance, we thank Tracy Ting, MD, Daniel Lovell, MD, MPH, both of the Division of Rheumatology, and Andrew Spooner, MD, Chief Medical Information Officer, all of Cincinnati Children's Hospital.
- Miller ML, Cassidy J: Juvenile Rheumatic Arthritis. Nelson Textbook of Pediatrics. 2007, Philadelphia: Saunders Elsevier, 1001-1011. 18Google Scholar
- Ilowite NT: Update on biologics in juvenile idiopathic arthritis. Curr Opin Rheumatol. 2008, 20 (5): 613-8.PubMedGoogle Scholar
- Hayward K, Wallace CA: Recent developments in anti-rheumatic drugs in pediatrics: treatment of juvenile idiopathic arthritis. Arthritis Res Ther. 2009, 11 (1): 216-10.1186/ar2619.PubMed CentralView ArticlePubMedGoogle Scholar
- Giannini EH, Ruperto N, Ravelli A, Lovell DJ, Felson DT, Martini A: Preliminary definition of improvement in juvenile arthritis. Arthritis Rheum. 1997, 40 (7): 1202-9.View ArticlePubMedGoogle Scholar
- Wallace CA, Ruperto N, Giannini E: Preliminary criteria for clinical remission for select categories of juvenile idiopathic arthritis. J Rheumatol. 2004, 31 (11): 2290-4.PubMedGoogle Scholar
- Magni-Manzoni S, Ruperto N, Pistorio A, Sala E, Solari N, Palmisani E: Development and validation of a preliminary definition of minimal disease activity in patients with juvenile idiopathic arthritis. Arthritis Rheum. 2008, 59 (8): 1120-7. 10.1002/art.23916.View ArticlePubMedGoogle Scholar
- Wallace CA, Huang B, Bandeira M, Ravelli A, Giannini EH: Patterns of clinical remission in select categories of juvenile idiopathic arthritis. Arthritis Rheum. 2005, 52 (11): 3554-62. 10.1002/art.21389.View ArticlePubMedGoogle Scholar
- Petty RE, Southwood TR, Baum J, Bhettay E, Glass DN, Manners P: Revision of the proposed classification criteria for juvenile idiopathic arthritis: Durban, 1997. J Rheumatol. 1998, 25 (10): 1991-4.PubMedGoogle Scholar
- Saurenmann RK, Rose JB, Tyrrell P, Feldman BM, Laxer RM, Schneider R: Epidemiology of juvenile idiopathic arthritis in a multiethnic cohort: ethnicity as a risk factor. Arthritis Rheum. 2007, 56 (6): 1974-84. 10.1002/art.22709.View ArticlePubMedGoogle Scholar
- Schanberg LE, Gil KM, Anthony KK, Yow E, Rochon J: Pain, stiffness, and fatigue in juvenile polyarticular arthritis: contemporaneous stressful events and mood as predictors. Arthritis Rheum. 2005, 52 (4): 1196-204. 10.1002/art.20952.View ArticlePubMedGoogle Scholar
- Wallace CA, Ravelli A, Huang B, Giannini EH: Preliminary validation of clinical remission criteria using the OMERACT filter for select categories of juvenile idiopathic arthritis. J Rheumatol. 2006, 33 (4): 789-95.PubMedGoogle Scholar
- Berntson L, Wernroth L, Fasth A, Aalto K, Herlin T, Nielsen S: Assessment of disease activity in juvenile idiopathic arthritis. The number and the size of joints matter. J Rheumatol. 2007, 34 (10): 2106-11.PubMedGoogle Scholar
- Dean BB, Lam J, Natoli JL, Butler Q, Aguilar D, Nordyke RJ: Review: use of electronic medical records for health outcomes research: a literature review. Med Care Res Rev. 2009, 66 (6): 611-38. 10.1177/1077558709332440.View ArticlePubMedGoogle Scholar
- Adhikesavan LG, Newman ED, Diehl MP, Wood GC, Bili A: American College of Rheumatology quality indicators for rheumatoid arthritis: benchmarking, variability, and opportunities to improve quality of care using the electronic health record. Arthritis Rheum. 2008, 59 (12): 1705-12. 10.1002/art.24054.View ArticlePubMedGoogle Scholar
- Passo MH, Taylor J: Quality improvement in pediatric rheumatology: what do we need to do?. Curr Opin Rheumatol. 2008, 20 (5): 625-30. 10.1097/BOR.0b013e32830c690f.View ArticlePubMedGoogle Scholar
- Feldman BM: Treating children with arthritis: towards an evidence-based culture. J Rheumatol Suppl. 2005, 72: 33-5.PubMedGoogle Scholar
- Wilkinson NM, Page J, Uribe AG, Espinosa V, Cabral DA: Establishment of a pilot pediatric registry for chronic vasculitis is both essential and feasible: a Childhood Arthritis and Rheumatology Alliance (CARRA) survey. J Rheumatol. 2007, 34 (1): 224-6.PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.