- Research article
- Open Access
Dutch patients, caregivers and healthcare professionals generate first nationwide research agenda for juvenile idiopathic arthritis
Pediatric Rheumatology volume 19, Article number: 52 (2021)
Involving the end-users of scientific research (patients, carers and clinicians) in setting research priorities is important to formulate research questions that truly make a difference and are in tune with the needs of patients. We therefore aimed to generate a national research agenda for Juvenile Idiopathic Arthritis (JIA) together with patients, their caregivers and healthcare professionals through conducting a nationwide survey among these stakeholders.
The James Lind Alliance method was used, tailored with additional focus groups held to involve younger patients. First, research questions were gathered through an online and hardcopy survey. The received questions that were in scope were summarised and a literature search was performed to verify that questions were unanswered. Questions were ranked in the interim survey, and the final top 10 was chosen during a prioritisation workshop.
Two hundred and seventy-eight respondents submitted 604 questions, of which 519 were in scope. Of these 604 questions, 81 were generated in the focus groups with younger children. The questions were summarised into 53 summary questions. An evidence checking process verified that all questions were unanswered. A total of 303 respondents prioritised the questions in the interim survey. Focus groups with children generated a top 5 of their most important questions. Combining this top 5 with the top 10s of patients, carers, and clinicians led to a top 21. Out of these, the top 10 research priorities were chosen during a final workshop. Research into pain and fatigue, personalised treatment strategies and aetiology were ranked high in the Top 10.
Through this study, the top 10 research priorities for JIA of patients, their caregivers and clinicians were identified to inform researchers and research funders of the research topics that matter most to them. The top priority involves the treatment and mechanisms behind persisting pain and fatigue when the disease is in remission.
Juvenile Idiopathic Arthritis (JIA) is a heterogeneous disease that is characterised by the occurrence of arthritis of unknown origin lasting for more than 6 weeks, with an onset before the age of 16 years. It is the most common chronic rheumatic disease in children . The health outcome for children and young adults with JIA has significantly improved, however unanswered questions still remain regarding the care of these patients [1, 2]. Nevertheless, there is increasing evidence that the needs raised by patients with JIA, their caregivers and clinicians are not always reflected by the subjects as studied in research programmes . Importantly, various studies demonstrate the importance of involving the end-users of knowledge in setting priorities for research to formulate research questions that truly make a difference and are in tune with the needs of patients [4, 5].
While the importance is widely acknowledged , still little effort is made to include patients in the set-up of JIA research. This is probably also aggravated by the fact that it includes a paediatric population, and it is still not exactly clear how to best include their voice [7,8,9,10]. A recent systematic review on research priority setting in paediatric chronic disease shows that only one in four studies reported parents/caregiver involvement, and only 5% included children directly . One of the studies that directly involves children/adolescents in research priority setting for rheumatic conditions was a study by Parsons et al. They successfully involved young people (11–24 years) in research prioritisation by organising focus groups . The domains ‘basic science’ and ‘psychosocial research’ were found to be most significant and have the highest priority for research. Notably, they showed that young people can discuss and prioritise scientific research, despite them being relatively research naïve. We aimed to interweave the advantages of such focus groups with the broader, well-established approach of setting research priorities of the James Lind Alliance (JLA).
The JLA is a non-profit initiative, founded in 2004 in the United Kingdom to bring patients, carers (caregivers, here: mostly parents), and clinicians together in Priority Setting Partnerships (PSPs) to set research priorities [12, 13]. They have developed a methodological approach that has now been used worldwide to generate about a hundred research agendas. Following the JLA methodology, we aimed to conduct a nationwide prioritisation exercise for JIA in the Netherlands . The ultimate aim of this study is to guide future JIA research and funding to the issues that matter most to all directly involved.
The Medical Ethical Committee of University Medical Centre Utrecht confirmed that this study was exempted from the Medical Research Involving Humans Act (WMO) (METC protocol number 18–721/C).
Initiating parties and steering group
The PSP was initiated by two Dutch patient associations for JIA (the Dutch JIA patient and parent organisation (JVN) and Youth-R-Well.com (YRW)), and two Dutch professional organisations (the Dutch Society for Paediatric Rheumatology (NVKR), and the Dutch Health Professionals in Paediatric Rheumatology (NHPKR)). An expert steering group was assembled to oversee all phases of the project. This group consisted of young adult JIA patients (n = 4), parents of JIA patients (n = 3), paediatric rheumatologists (n = 3), an ophthalmologist (n = 1), physical therapists (n = 2) and a nurse practitioner (n = 1). Clinicians were recruited from 7 academic centres in the Netherlands. They were selected to represent all different professions and all geographic regions of the Netherlands. Most of them were members of the abovementioned organisations. Our JLA advisor (KC) had an advisory role throughout the whole process, while the steering group had the authority to make all important decisions within the framework and guiding principles of the JLA.
Before starting the process, the scope of our PSP was defined in agreement with the steering group. We chose to keep our scope broad to include questions regarding prevention, aetiology, symptoms, diagnosis, treatment, prognosis, health services, self-management and psychosocial aspects. We explicitly made the commitment to include lower educated carers and patients, and children to be truly inclusive.
The first step was to collect relevant questions from patients, carers and clinicians through a survey (December 2018–March 2019). Patients and parents were recruited to participate via patient organisations (e-mail and social media), and via flyers distributed at all outpatient clinics for paediatric rheumatology in the Netherlands. Clinicians were recruited via professional organisations’ newsletters and flyers were sent to them. Demographic details were analysed periodically to strive for equal representation of age, education level and region. Recent JIA guidelines were also searched for research recommendations. Extracted recommendations were added to the question database. Focus groups and small (group-) interviews were held with children (aimed 10–13 years) in an exploratory, conversation-like manner, guided by an expert in child participation (among others, CD). In-depth results of the focus groups will be published separately (Aussems et al., in preparation).
All questions were reviewed and assessed whether they were in scope. Questions that were identified out of scope were put on a separate list which was agreed upon in a steering group meeting. Next, the included questions were grouped into categories and keywords were allocated to them, to ease the process of summarising. In a face-to-face meeting, the steering group summarised the questions into summary questions. A search in PubMed and PsycINFO (restricted to the last 10 years) was conducted to ensure that the question was unanswered. Publications were found to be relevant if they included systematic reviews, meta-analyses, randomised control trials (RCTs) or large representative cohort studies following the JLA guidelines. Next, the steering group provided expert opinion on the articles that were retrieved from this search and made the final decision about whether or not the question could be identified as already answered.
Interim priority setting survey
Here, the goal was to make a shortlist of 20–25 questions for the final workshop. Again, a survey was designed in which participants could choose their Top 10 (October–December 2019). Participants were recruited in the same way as during the first survey. Furthermore, participants of the first survey who left their contact details were e-mailed directly. Younger children were asked to rank their top 5 during focus groups that were set up as small priority setting workshops. Three separate top 10s, for patients, carers and clinicians, were determined. Together with the top 5 of the younger children, a final shortlist was set – they all had an equal weight. This shortlist was taken to the final workshop.
Final priority setting workshop
Participants of the workshop were invited from the steering group, through professional connections and through the interim survey (people who left their contact details were approached) to be inclusive of the whole JIA community. Prior to the workshop, participants were asked to individually prioritise the shortlist of questions. Through three rounds of prioritisation in both smaller and larger groups, chaired by trained facilitators using an adapted nominal group technique, the final top 10 was agreed (February 2020). Several observers were invited from a large patient advocacy organisation, an insurance company, the Dutch Society for Paediatrics (NVK) and the Dutch Arthritis Foundation. They did not take part in the discussions, but were present to observe the process, become inspired and learn from the discussions.
An independent ethical process evaluation was conducted by a bio-ethicist (KJ) in order to evaluate (the inclusiveness of) the priority setting process. The bio-ethicist was present during all steering group meetings, the final workshop, and was included in all correspondence regarding the research agenda. In-depth results of this evaluation will be published separately (Jongsma et al., in press).
During the first phase of the process, a total of 604 questions were gathered. Of these 604, 506 were submitted by 278 respondents through the survey: 141 patients (50.7%), 88 carers (31.6%) and 49 health care professionals (17.6%). Demographic data are summarised in Table 1. Responses were gathered from all academic centres and geographic regions in the Netherlands. In the online survey, 25.8% of the carers had finished a lower and middle education. To lower the bar of participating, a hardcopy version of the survey was distributed at outpatient clinics. On this hardcopy version 59% of the respondents had lower and middle education (see Table 2), demonstrating the additional value of distributing hardcopy surveys. The underrepresentation of younger patients in the online survey – no more than 23% of responding patients were younger than 16 years – underscored the significance of the focus groups. In total 24 children (17 girls and 7 boys, 9–16 years of age, suffering from JIA between 4 months to 9 years), participated in two focus groups and six (group-) interviews, Together, they formulated 81 extra questions (Aussems et al., in preparation). Furthermore, in the Dutch JIA guideline 17 additional unanswered research questions were found .
Analysis of evidence uncertainties
Of the 604 submitted questions, 519 were determined to be in scope. Out of scope questions mostly related to logistics of care (e.g. “Why can’t blood be drawn at the GP’s office instead of at the hospital?”, or: “Do we have to pay for orthopaedic shoes ourselves or does the insurance cover it?”) or personal situations (e.g. “Which type of JIA do I have?”) and could not be answered by research. During a face-to-face meeting, the steering group summarized the remaining questions into 53 summary questions.
An elaborate search in PubMed and PsycInfo showed that none of the 53 questions was completely answered. A full list of all the submitted questions, the 53 summary questions, our search strategy for evidence checking and the critical appraisal of the studies has been published online .
Three hundred and three people chose their top 10 from the 53 questions: 125 patients (41.3%), 136 carers (44.9%) and 42 clinicians (13.9%). Two focus groups with seven and nine children respectively (in total 9 girls and 7 boys, 10–15 years), and a subsequent group priority setting discussion attended by six girls and five boys from the focus groups, resulted in a top 5 of their most important questions (Aussems et al. in preparation).
The 35 questions in the respective top 10s of patients, carers, clinicians, and the top 5 of younger children showed considerable overlap. One question – on fatigue – was prioritised by all 4 groups. Four questions were ranked in three top 10s. This resulted in a combined top 21. Table 3 shows how these 21 questions were ranked in the different groups. Interestingly, the question “How can JIA be cured?” was highly prioritised by patients and carers, and ranked very low by the clinicians. The clinicians may have been less optimistic about the chances to find a cure in the near future. Three questions in the childrens’ top 5 – numbered 14, 16 and 19 in Table 3 – were ranked much lower by the other three groups. This illustrates the added value of the focus groups.
During the final priority setting workshop, on February 7, 2020, the top 10 was chosen (see Table 3). The workshop was attended by five patients, five parents of patients, and ten clinicians (paediatric rheumatologists (n = 3), an ophthalmologist (n = 1), physical therapists (n = 2), nurses (n = 3), and a psychologist (n = 1)). Clinicians were recruited from all academic centres in the Netherlands. The results of two rounds of discussions and ranking in three mixed groups were combined, and discussed further in a final session. The participants chose to merge the two summary questions on personalised medicine and strategies to taper off medication (see Table 3). All 20 attendees unanimously agreed on the final Top 10.
The result of the discussions in the final workshop broadly reflected the interim rankings. For both patients and carers, 6 of the interim top 10 questions (60%) were selected. For clinicians it was 80%. For the focus groups 2 out of 5 questions (40%) were part of the final top 10. Importantly, question 9 of the final top 10 made it into the list because a young adult patient advocated for it during the final discussion, using the argument that it was the children’s top priority. Evaluations from the participants of the final workshop were very positive: patients, carers and clinicians felt like their voice was heard, that all voices mattered equally, and that the atmosphere was very positive.
This project has brought patients, caregivers and clinicians together in creating a research agenda for JIA using the JLA method. This is one of the first times a PSP has integrated the JLA approach with additional focus groups with children to ensure involvement of paediatric patients of all age categories. We found that the number one research priority involved the cause and care of pain and fatigue when the disease was in remission. This is in line with a qualitative study by Bromberg et al. that finds self-reported pain and fatigue are highly common in children with JIA despite advances in treatment strategies . It is also highlighted to be an important research area by Palman et al. , along with defining better predictors of remission states, which was also part of our Top 10. The fact that these studies all underline the same top research priority demonstrates the importance of future research focusing on this. Next to pain and fatigue, the aetiology of the disease remains an important topic that was featured high in our Top 10 and also in a recent priority setting exercise in the United States .
Moreover, our study exposed other important research areas such as personalised treatment strategies, JIA-associated uveitis, nutrition, long-term effects of drugs taken for JIA and sports/exercise that were not directly featured in other studies. This may be due to the wide scope we defined for this project, as well as the easily accessible nature of the JLA method that may have led to the collection of more widespread themes. The fact that the questions do not only cover the healthcare setting but also comprise more (psycho) social and educational issues suggests funding for these topics can also be sought from psychological, social and educational funding bodies.
One major strength of our study is the use of the systematic and transparent JLA method, which enhances the validity of our results. Furthermore, our efforts to include younger children is a strength. We conducted focus groups during the two phases of the process where information was gathered, such that they truly had their say in determining the most important topics. Two questions of the children’s Top 5 made it to the final Top 10 (see Table 3), which indicates the significant influence they had in the PSP.
A challenge in this study was the inclusiveness of people with all educational backgrounds and age groups throughout the survey phases. The input of patients and parents in the steering group was very valuable. For example, they thought of using a cartoon on the flyers and in social media coverage to capture people’s attention. A parent proposed the use of hardcopy questionnaires in these phases, which improved the inclusion of respondents with regard to education level, especially in the first phase. For people with low digital skills, it might be more difficult to formulate their own question, than to choose from a list of questions.
In a subgroup analysis of the parent responses in the prioritising phase, we found that the online and hardcopy groups of parents showed overlap in their priorities. The parents responding with paper and pencil did not rank the question on alternative medicine that high. Interestingly, they did prioritize two questions on school and education (nrs 9 and 17), that were not prioritized in the online parent group. This may have been related to their own educational background.
In this light, it is important to realise that participants of the final workshop consisted of a group of (predominantly) white, articulate, higher educated people, despite explicit efforts to include people with lower educational backgrounds and other ethnicities. This may have influenced which questions made it to the Top 10. This is a typical tendency in survey research and was also observed in other PSPs . Future PSPs may want to come up with and employ alternative strategies to ensure equal representation of all members of society. We also observed that more questions from the clinicians initial shortlist made it into the final Top 10 (see Table 3). This may be due to the fact that clinicians are more trained to give their opinion about these matters than young people and parents. Nevertheless, all attendees at the final workshop in the end unanimously agreed on the final Top 10 as a list of shared priorities.
Formally, this Top 10 was generated in the Netherlands, but we expect it also holds for other western countries. Now that the research agenda has been set, it is important that it is now indeed implemented with research funders and researchers. To achieve this, we attempted to inform the whole JIA research community in the Netherlands of this prioritisation exercise from the start, and some of the research groups made the commitment to truly incorporate the Top 10 in the long-term vision of their research lines. In addition, we have organised workshops with researchers, patients, parents and clinicians to turn the relatively broad questions into research proposals that can be presented to funding agencies. These workshops took place in the fall of 2020. With these workshops, we hope to gather a group of people that is truly committed to finding answers to the research questions of the Top 10.
In short, we systematically and transparently generated a research agenda for JIA, confirmed as evidence uncertainties and regarded important by children and young people with JIA, their parents/caregivers and the clinicians caring for them. This is a vital resource that conveys a clear message to both government funders and charitable agencies, about which research topics should have priority. The next step is to turn the questions into research proposals. Workshops are currently being organised to this end.
Availability of data and materials
Most of the data described in the article can be found in this article or online at the James Lind Alliance website, as stated in the article and mentioned in the references. Any other datasets are available from the corresponding author on reasonable request.
Juvenile Idiopathic Arthritis
James Lind Alliance
Dutch JIA Patient and Parent Organisation
Dutch Health Professionals in Paediatric Rheumatology
Dutch Society for Paediatrics
Dutch Society for Paediatric Rheumatology
Priority Setting Partnership
Randomised Controlled Trial
Medical Research Involving Humans Act
Prakken B, Albani S, Martini A. Juvenile idiopathic arthritis. Lancet. 2011;377(9783):2138–49. https://doi.org/10.1016/S0140-6736(11)60244-4.
Schoemaker CG, Armbrust W, Swart JF, Vastert SJ, van Loosdregt J, Verwoerd A, et al. Dutch juvenile idiopathic arthritis patients, carers and clinicians create a research agenda together following the James Lind Alliance method: a study protocol. Pediatr Rheumatol Online J. 2018;16(1):57-018-0276-3. https://doi.org/10.1186/s12969-018-0276-3.
Crowe S, Fenton M, Hall M, Cowan K, Chalmers I. Patients', clinicians' and the research communities' priorities for treatment research: there is an important mismatch. Res Involv Engagem. 2015;1:2–015-0003-x eCollection 2015.
Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JP, et al. Biomedical research: increasing value, reducing waste. Lancet. 2014;383(9912):101–4. https://doi.org/10.1016/S0140-6736(13)62329-6.
Abma TA, Broerse JE. Patient participation as dialogue: setting research agendas. Health Expect. 2010;13(2):160–73. https://doi.org/10.1111/j.1369-7625.2009.00549.x.
Schanberg LE, Mullins CD. If patients are the true north, patient-centeredness should guide research. Nat Rev Rheumatol. 2019;15(1):5–6. https://doi.org/10.1038/s41584-018-0129-y.
Odgers HL, Tong A, Lopez-Vargas P, Davidson A, Jaffe A, McKenzie A, et al. Research priority setting in childhood chronic disease: a systematic review. Arch Dis Child. 2018;103(10):942–51. https://doi.org/10.1136/archdischild-2017-314631.
Bate J, Ranasinghe N, Ling R, Preston J, Nightingale R, Denegri S. Public and patient involvement in paediatric research. Arch Dis Child Educ Pract Ed. 2016;101(3):158–61. https://doi.org/10.1136/archdischild-2015-309500.
McDonagh JE, Bateman B. 'Nothing about us without us': considerations for research involving young people. Arch Dis Child Educ Pract Ed. 2012;97(2):55–60. https://doi.org/10.1136/adc.2010.197947.
Bird D, Culley L, Lakhanpaul M. Why collaborate with children in health research: an analysis of the risks and benefits of collaboration with children. Arch Dis Child Educ Pract Ed. 2013;98(2):42–8. https://doi.org/10.1136/archdischild-2012-303470.
Parsons S, Thomson W, Cresswell K, Starling B, JE MD, Barbara Ansell National Network for Adolescent Rheumatology. What do young people with rheumatic disease believe to be important to research about their condition? A UK-wide study. Pediatr Rheumatol Online J. 2017;15(1):53–017–0181-1.
Chalmers I, Atkinson P, Fenton M, Firkins L, Crowe S, Cowan K. Tackling treatment uncertainties together: the evolution of the James Lind initiative, 2003-2013. J R Soc Med. 2013;106(12):482–91. https://doi.org/10.1177/0141076813493063.
The James Lind Alliance. Available at: http://www.jla.nihr.ac.uk/. Accessed Apr 2020.
James Lind Alliance Guidebook. Available at: http://www.jla.nihr.ac.uk/jla-guidebook/. Accessed Apr 2020.
Richtlijn medicamenteuze behandeling van kinderen met juveniele idiopathische artritis. Available at: https://www.nvk.nl/themas/kwaliteit/richtlijnen/richtlijn?componentid=7864339&tagtitles=Infectieziekten%2ben%2bImmunologie.Intensive%2bCare.Maag-Darm-Leverziekten%2b(MDL),Reumatologie,Sociale%2ben%2bPsychosociale%2bkindergeneeskunde,Chirurgie. Accessed May, 2019.
Juvenile Idiopathic Arthritis (Netherlands). Available at: http://www.jla.nihr.ac.uk/priority-setting-partnerships/Juvenile-idiopathic-arthritis/. Accessed Apr 2020.
Bromberg MH, Connelly M, Anthony KK, Gil KM, Schanberg LE. Self-reported pain and disease symptoms persist in juvenile idiopathic arthritis despite treatment advances: an electronic diary study. Arthritis Rheum. 2014;66(2):462–9. https://doi.org/10.1002/art.38223.
Palman J, Shoop-Worrall S, Hyrich K, McDonagh JE. Update on the epidemiology, risk factors and disease outcomes of juvenile idiopathic arthritis. Best Pract Res Clin Rheumatol. 2018;32(2):206–22. https://doi.org/10.1016/j.berh.2018.10.004.
Correll CK, Dave M, Paul AF, Gaizo VD, Schrandt S, Partovi RS, et al. Identifying research priorities among patients and families of children with rheumatic diseases living in the United States. J Rheumatol. 2020;47(12):1800–6. https://doi.org/10.3899/jrheum.190934.
Aldiss S, Fern LA, Phillips RS, Callaghan A, Dyker K, Gravestock H, et al. Research priorities for young people with cancer: a UK priority setting partnership with the James Lind Alliance. BMJ Open. 2019;9(8):e028119-2018-028119. https://doi.org/10.1136/bmjopen-2018-028119.
We thank Soumaya Chemlal for her help during the evidence checking process.
This project was funded by the Dutch Association for Paediatric Rheumatology (NVKR), the Dutch JIA Patient and Parent Organisation (JVN) and Wilhelmina Children’s Hospital. PGO support funded the ethical process evaluation.
Ethics approval and consent to participate
The Medical Ethical Committee of University Medical Centre Utrecht confirmed that this study was exempted from the Medical Research Involving Humans Act (WMO) (METC protocol number 18–721/C).
Consent for publication
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Verwoerd, A., Armbrust, W., Cowan, K. et al. Dutch patients, caregivers and healthcare professionals generate first nationwide research agenda for juvenile idiopathic arthritis. Pediatr Rheumatol 19, 52 (2021). https://doi.org/10.1186/s12969-021-00540-2
- Juvenile idiopathic arthritis
- Research priority setting
- James Lind Alliance
- Patient involvement