- Open Access
Dutch juvenile idiopathic arthritis patients, carers and clinicians create a research agenda together following the James Lind Alliance method: a study protocol
Pediatric Rheumatology volume 16, Article number: 57 (2018)
Research on Juvenile Idiopathic Arthritis (JIA) should support patients, caregivers/parents (carers) and clinicians to make important decisions in the consulting room and eventually to improve the lives of patients with JIA. Thus far these end-users of JIA-research have rarely been involved in the prioritisation of future research.
Dutch organisations of patients, carers and clinicians will collaboratively develop a research agenda for JIA, following the James Lind Alliance (JLA) methodology. In a ‘Priority Setting Partnership’ (PSP), they will gradually establish a top 10 list of the most important unanswered research questions for JIA. In this process the input from clinicians, patients and their carers will be equally valued. Additionally, focus groups will be organised to involve young people with JIA. The involvement of all contributors will be monitored and evaluated. In this manner, the project will contribute to the growing body of literature on how to involve young people in agenda setting in a meaningful way.
A JIA research agenda established through the JLA method and thus co-created by patients, carers and clinicians will inform researchers and research funders about the most important research questions for JIA. This will lead to research that really matters.
Research priority setting involving the end-users of knowledge is clearly needed in order to formulate research questions that can really make a difference [1,2,3]. In a recent review, Odgers et al. reported a substantial increase in the number of research priority setting initiatives in paediatric chronic disease since 2010, generating a broad range of priorities shared across multiple conditions . Unfortunately, the methodology was generally inadequately described. This lack of clarity raises concerns over the legitimacy and relevance of identified priorities. Odgers et al. suggested that the available systematic methods of priority setting should be used more often .
Patient and parent/caregiver (carer) involvement in establishing research priorities is crucial in generating a research agenda that encompasses the full spectrum of issues that affects paediatric patients with chronic disease [5,6,7,8,9]. Thus far, their involvement in research priority appears to be limited. Only approximately one-in-four studies reported some parental/caregiver involvement, and only 5% involved children directly . Furthermore, qualitative research showed that the involvement of patients and carers seems to be challenging: real co-design does not happen by itself . Therefore, precautionary measures need to be taken to empower patients and carers , and their involvement in the process should be monitored and evaluated [4, 10].
As noted above, understanding young people’s research priorities is crucial to develop research that is in tune with their needs [4, 11, 12]. However, some researchers have reported challenges to collaborating with young people in health research [12,13,14]. More recently, there appears to be increasing efforts to involve children and adolescents in research priority setting [7, 11, 12, 15]. Parsons et al. organised 13 focus groups involving young people with rheumatic diseases, aged 11–24, to explore what they believed to be important research questions regarding their condition [12, 16]. They provided evidence that even younger adolescents (11–15 years) are equipped to discuss and prioritise scientific research even if they are relatively research naive .
In 2018 four Dutch organisations of patients, parents and clinicians will start to establish a research agenda for Juvenile Idiopathic Arthritis (JIA). The research agenda was initiated by the Netherlands JIA patient and parent organisation (Dutch Juvenile Arthritis Association: DJAA), a member organisation of the European Network for Children with Arthritis (ENCA). Three other Dutch organisations are involved: the Dutch network organisation for young arthritis patients (16–30 years old) Youth-R-Well.com, the Dutch Association for Pediatric Rheumatology (DAPR) and the Dutch Health Professionals in Pediatric Rheumatology (DHPPR). The project will be based at the Pediatric Rheumatology and Immunology department of the Wilhelmina Children’s Hospital (WKZ) in Utrecht. DAPR, DJAA and WKZ funded the project. Amsterdam UMC will develop and lead the focus groups for young people with JIA, and enable them to have effective and fulfilling participation in the whole process. PGO-support, a Dutch networking organisation for patient organisations will issue an independent process evaluation of the PSP. The Department of Medical Ethics at the Julius Center of the UMC Utrecht will perform the research concerning the process evaluation.
In this paper, the project is outlined briefly. We discuss how we will address the aforementioned questions on the use of systematic methods and the feasibility of meaningful patient and caregiver participation in research agenda setting. Formulating a research agenda is not a goal in itself [2, 17]. Finally, we will describe how we aim to inspire researchers and research funders by the defined priorities when preparing for and guiding funding new research projects.
In a recent review on patient and public engagement in priority setting, Manafo et al. described four highly structured deliberative methods that are inclusive and objectively based, specific to the priorities of all stakeholders engaged in the process . Two of these methods have successfully been applied in the Netherlands: The Dialogue Method and the James Lind Alliance (JLA) Priority Setting Partnerships [18, 19]. Both methods are clearly suited for this purpose [5, 20]. Eventually, we chose the JLA method as it proved to be very effective in implementing agendas in calls for research. United Kingdom’s National Institute for Health Research (NIHR) and several funding charities, for example Marie Curie, the Multiple Sclerosis Society and Parkinson’s UK, have adopted the research agendas as an important part of their research funding strategy .
The James Lind Alliance (JLA) is a non-profit initiative established in the United Kingdom (UK) in 2004 by Sir Iain Chalmers . The JLA team is positioned at the NIHR Evaluation, Trials and Studies Coordinating Centre (NETSCC), based at the University of Southampton in the UK. The goal of the JLA is to bring together the end users of scientific knowledge – patients, carers and clinicians – to jointly formulate a research agenda for a disease or type of care. In a so-called ‘Priority Setting Partnership’ (PSP) they gradually establish a top-10 list of the most important unanswered questions for their health area of interest .
Until now about 70 different Top 10s have been published. More information on the content and the background of these Top 10s can be found on the JLA website . In 2015, Chalmers and colleagues compared the prioritised unanswered questions of several PSPs to the research questions they found in registered clinical trials. They demonstrated that the JLA method identifies questions and themes that are not yet being addressed in current studies .
The JLA method consists of 5 steps: setting up the steering group, gathering uncertainties, data processing and verifying uncertainties, interim priority setting, and final priority setting (see Table 1). In a free internet-based Guidebook the JLA method has been described in more detail . Following these five steps, it takes approximately twelve to eighteen months to formulate a research agenda .
A PSP is led by a steering group (10–15 people) that coordinates the PSP and organises the activities . The Dutch JIA-PSP steering group will be led by a carer and a pediatric rheumatologist. The steering group will include representatives of patients (i.c. adult JIA-patients), carers (i.c. parents) and clinicians (i.c. pediatric rheumatologists, ophthalmologists, physiotherapists and nurses,). The four previously mentioned organisations recruited their members for the steering group. Four groups – pediatric rheumatologists, other health professionals, patients and parents – will be equally represented in the steering group. The two PSP Leaders made a selection for the pediatric rheumatologists, and invited one of the centers to invite one of their nurse practitioners, in order to achieve a balanced representation of clinicians of all 6 academic centres including their affiliated rehabilitation centre within the steering group. These decisions were made in collaboration with the chairs of both organisations. Furthermore, all Dutch centers for pediatric rheumatology will be represented in this steering group. A MD PhD-student coordinates the JIA-PSP, reviews the data collected, identifies the existing research evidence, and formulates potential research questions with input from the steering group. The PSP will be supported and guided by a trained JLA Adviser .
According to Odgers et al., the JLA approach may not be very well suited to children with chronic disease . It demands creative and developmentally appropriate strategies to empower children to reflect on their situation, and how research could benefit them and to articulate their priorities [25, 26]. Inspired by the work of Parsons et al. we will organise additional focus group meetings involving children and adolescents with JIA. This established qualitative method allows the participants to draw from other participant’s knowledge and allows for a conversation among peers .
Specific themes and research questions formulated by these young patients will be added to our dataset of uncertainties from the survey. In the focus groups the young patients will discuss how they wish to be involved in the process and which arrangements need to be made in order for them to participate successfully. The results of the focus group will be discussed in the second meeting of the steering group. This may change the involvement of young patients in the process onwards.
Some precautionary measures to empower patients and carers are built into the JLA method. Patients and carers take part in the steering group. We will ensure that the chairing of the steering group is fair and neutral so as not to favour one group over another. The final priority setting workshop of the PSP is attended by patients and carers as well as clinicians and the opinions of all people at the workshop are valued equally . The JLA supports an adapted Nominal Group Technique for PSPs choosing their priorities during the final workshop. One benefit of this technique is that it prevents the domination of discussion by a single person and encourages the participation of less assertive members. There is no hierarchy between the different participants; no one individual or group’s views or experiences are more valid than another’s. Nominal Group Technique is a well-established and well-documented approach to decision making. Despite these measures, engaging patients and carers in the complexities of health science based discussions of uncertainty is challenging . To empower patients and carers in the steering group, most of them received a two-day training as a patient partner in research .
A process evaluation with a specific focus on the ethical aspects of the decision-making process is conducted parallel to the priority setting process [10, 27]. In the process evaluation, issued by PGOsupport and executed by a researcher from the Julius Center, attention will be paid to the inclusion of different stakeholders, their influence on the priority setting as well as facilitating and limiting factors for equal deliberation between the different stakeholders. For this, the researcher from the Julius Center will observe all key meetings during the project and perform additional interviews among the stakeholder groups. Important deliverables include evaluation of the suitability of the JLA method for patient organisations that aim to take a role as partner and/or driving force in scientific research; identification of critical success factors during the process in relation to patient representation; identification of specific requirements for appropriate involvement of children and adolescents. PGOsupport will disseminate the results of the evaluation via the relevant media in order to inform other patient organisations that consider a similar approach.
Formulating a research agenda for JIA is not a goal in itself. It is important that researchers and research funders are inspired by the defined priorities when preparing for and funding new research projects. Therefore all Dutch academic centers for pediatric rheumatology will be represented in the steering group. We will present our results at a 2019 meeting of a large Dutch/Canadian research project on personalised medicine, UCAN CAN-DU, funded by the Netherlands Organisation for Health Research and Development ZONMW, the Canadian Institutes of Health Research (CIHR) and Dutch Arthritis Foundation (ReumaNederland), to inspire further JIA-research. Funding agencies will be invited for our final workshop. Members and ambassadors of the Dutch JIA-PSP are involved in European organisations like ENCA, Paediatric Rheumatology European Society (PReS) and the European League Against Rheumatism (EULAR). Collectively, these measures will ensure the optimal implementation of the research agenda in different “layers” of research.
In 2018 four Dutch organisations for JIA-patients, parents, pediatric rheumatologists and health professionals will initiate a PSP for JIA, following the JLA methodology. This research agenda, will be established in 2019, and will improve the relevance of JIA-research in the Netherlands and beyond. This will not only benefit patients, parents and clinicians in the consulting room, but also the JIA-researchers themselves since their research will really matter to the people that need it most.
Canadian Institutes of Health Research
Dutch Association for Pediatric Rheumatology
Dutch Health Professionals in Pediatric Rheumatology
Dutch Juvenile Arthritis Association:
European Network for Children with Arthritis
European League Against Rheumatism
Juvenile Idiopathic Arthritis
James Lind Alliance
NIHR Evaluation, Trials and Studies Coordinating Centre
National Institute for Health Research (NIHR)
Dutch networking organisation for patient organisations
Paediatric Rheumatology European Society
Priority Setting Partnership
- UCAN CAN-DU:
Canada – Netherlands Personalized Medicine Network in Childhood Arthritis and Rheumatic diseases
Wilhelmina Children’s Hospital
Dutch network organisation for young arthritis patients (16–30 years old)
Netherlands Organisation for Health Research and Development
Macleod MR, et al. Biomedical research: increasing value, reducing waste. Lancet. 2014;383(9912):101–4.
Crowe S, et al. Patients’, clinicians’ and the research communities’ priorities for treatment research: there is an important mismatch. Res Involv Engagem. 2015;1:2.
Abma TA, Broerse JE. Patient participation as dialogue: setting research agendas. Health Expect. 2010;13(2):160–73.
Odgers HL, et al. Research priority setting in childhood chronic disease: a systematic review. Arch Dis Child. 2018. https://doi.org/10.1136/archdischild-2017-314631.
Manafo E, et al. Patient and public engagement in priority setting: a systematic rapid review of the literature. PLoS One. 2018;13(3):e0193579.
Tong A, et al. Children’s experiences of living with juvenile idiopathic arthritis: a thematic synthesis of qualitative studies. Arthritis Care Res (Hoboken). 2012;64(9):1392–404.
Bate J, et al. Public and patient involvement in paediatric research. Arch Dis Child Educ Pract Ed. 2016;101(3):158–61.
Gomez-Ramirez O, et al. A recurring rollercoaster ride: a qualitative study of the emotional experiences of parents of children with juvenile idiopathic arthritis. Pediatr Rheumatol Online J. 2016;14(1):13.
Eyckmans L, et al. What does it mean to grow up with juvenile idiopathic arthritis? A qualitative study on the perspectives of patients. Clin Rheumatol. 2011;30(4):459–65.
Bryant J, et al. Health research priority setting in selected high income countries: a narrative review of methods used and recommendations for future practice. Cost Eff Resour Alloc. 2014;12:23.
McDonagh JE, Bateman B. ‘Nothing about us without us’: considerations for research involving young people. Arch Dis Child Educ Pract Ed. 2012;97(2):55–60.
Parsons S, et al. Study protocol: determining what young people with rheumatic disease consider important to research (the young People's opinions underpinning rheumatology research - YOURR project). Res Involv Engagem. 2016;2:22.
Bird D, Culley L, Lakhanpaul M. Why collaborate with children in health research: an analysis of the risks and benefits of collaboration with children. Arch Dis Child Educ Pract Ed. 2013;98(2):42–8.
van Staa A, et al. Exciting but exhausting: experiences with participatory research with chronically ill adolescents. Health Expect. 2010;13(1):95–107.
Tunnicliffe DJ, et al. Healthcare and research priorities of adolescents and young adults with systemic lupus erythematosus: a mixed-methods study. J Rheumatol. 2017;44(4):444–51.
Parsons S, et al. What do young people with rheumatic disease believe to be important to research about their condition? A UK-wide study. Pediatr Rheumatol Online J. 2017;15(1):53.
Abma TA, et al. Patient involvement in research programming and implementation: a responsive evaluation of the dialogue model for research agenda setting. Health Expect. 2015;18(6):2449–64.
Broerse JE, et al. Involving burn survivors in agenda setting on burn research: an added value? Burns. 2010;36(2):217–31.
van Furth EF, van der Meer A, Cowan K. Top 10 research priorities for eating disorders. Lancet Psychiatry. 2016;3(8):706–7.
Schoemaker CG, Prakken ABJ, Furth EF. Patients and physicians creating a research agenda together: the method of the British James Lind Alliance. Ned Tijdschr Geneeskd. 2017;161(0):D1764.
JLA. Funded research. 2018; Available from: http://www.jla.nihr.ac.uk/making-a-difference/funded-research.htm. Accessed 1 Sept 2018.
Chalmers I. The James Lind initiative. J R Soc Med. 2003;96(12):575–6.
JLA. JLA Guidebook. 2018; Available from: www.jla.nihr.ac.uk/jla-guidebook. Accessed 1 Sept 2018.
JLA. Top 10s of priorities for research. 2018; Available from: http://www.jla.nihr.ac.uk/top-10-priorities. Accessed 1 Sept 2018.
Dedding CW, et al. Kinderen en jongeren actief in wetenschappelijk onderzoek. Ethiek, methoden en resultaten van onderzoek met en door jeugd. Houten: LannooCampus; 2013.
Schalkers I, Dedding CW, Bunders JF. ‘[I would like] a place to be alone, other than the toilet’—Children’s perspectives on paediatric hospital care in the Netherlands. Health Expect. 2015;18(6):2066–78.
Madden M, Morley R. Exploring the challenge of health research priority setting in partnership: reflections on the methodology used by the James Lind Alliance pressure ulcer priority setting partnership. Res Involv Engagem. 2016;2:12.
de Wit MP, et al. European league against rheumatism recommendations for the inclusion of patient representatives in scientific projects. Ann Rheum Dis. 2011;70(5):722–6.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Schoemaker, C.G., Armbrust, W., Swart, J.F. et al. Dutch juvenile idiopathic arthritis patients, carers and clinicians create a research agenda together following the James Lind Alliance method: a study protocol. Pediatr Rheumatol 16, 57 (2018). https://doi.org/10.1186/s12969-018-0276-3
- Juvenile Idiopathic Arthritis (JIA)
- Research agenda
- James Lind Alliance
- Patient involvement