- Open Access
Understanding treatment decision making in juvenile idiopathic arthritis: a qualitative assessment
Pediatric Rheumatologyvolume 11, Article number: 34 (2013)
The increase in therapeutic options for juvenile idiopathic arthritis (JIA) has added complexity to treatment decisions. Shared decision making has the potential to help providers and families work together to choose the best possible option for each patient from the array of choices. As part of a needs assessment, prior to design and implementation of shared decision making interventions, we conducted a qualitative assessment of clinicians’ current approaches to treatment decision making in JIA.
Pediatric rheumatology clinicians were recruited from 2 academic children’s hospitals affiliated with a quality improvement learning network, using purposive and snowball sampling. Semi-structured interviews elicited how clinicians with prescribing authority (n = 10) interact with families to make treatment decisions. Interviews were audio-recorded and transcribed verbatim. A multi-disciplinary research team used content analysis to analyze the interview data.
To validate data from individual interviews and enrich our understanding, we presented the interview results to pediatric rheumatology clinicians attending a learning network meeting (n = 24 from 12 children’s hospitals). We then asked the clinicians questions to further identify and discuss areas of variation in the decision-making processes.
Clinicians described a decision-making process in which they, rather than the family or other care team members, consistently initiated treatment decisions. Initial treatment options presented to families generally reflected the clinician’s preferred treatment approaches, which differed across clinicians. Clinicians used various methods to inform families about treatment options and tailor information according to perceptions of a family’s information needs, level of comprehension or mood (e.g. anxiety). The attributes of medication presented to families fell into 4 categories: benefits, risks, logistics and family preferences. Clinicians typically included family members in the decision to initiate JIA treatment after limiting the options to fit the clinical situation and the clinician’s own preferences. Family members’ preferences were seen as more integral in the decision to stop treatment after symptom remission.
Decision making about initial JIA treatment appears to be largely driven by clinician preferences. Family preferences are more likely to be considered for treatment discontinuation. Opportunities exist to develop, test, and implement tools to facilitate shared decision making in pediatric rheumatology.
Therapeutic options to treat juvenile idiopathic arthritis (JIA) have grown in number and complexity. What used to be a crippling condition is now a manageable though chronic one. Methotrexate has long been a foundational treatment for JIA, but there is substantial practice variation in its use [1–3]. In recent years, a growing number of other treatments have become available for JIA. Such treatments may differ in mechanism of action, dosing interval, mode of administration and safety profile . To address this rapidly changing field, in 2011 the American College of Rheumatology published the first recommendations for the initiation of therapeutic agents for JIA . The level of evidence behind these guidelines leaves multiple reasonable options, which differ in ways that matter to families [5, 6]. Therefore, even with such guidelines, there is often a need to personalize treatment plans based upon unique factors brought to each interaction between a prescribing clinician and a patient.
In the face of uncertainty about which treatment is optimal for a specific patient , the decision-making process may be influenced by clinician training and practice style, clinician beliefs about the tradeoffs of safety versus effectiveness, and the stated or assumed preferences of patients and parents . In the adult setting, the priorities of rheumatoid arthritis patients and rheumatologists can differ when making decisions about care escalation . In pediatrics, many parents of children being treated for JIA are left with persistent questions, information needs, long-lasting concerns and worry about treatment adverse effects , suggesting a need for improved clinician-parent communication. Moreover, adolescents with JIA who have participated in treatment decisions often wish their role in the decision process had been different . Their desire to be involved in decision making [11, 12], may further complicate the process if their preferences differ from those of their parents .
Shared decision making, in which clinicians and families work together to make treatment decisions, may help overcome some of these challenges. This process typically involves clinicians offering options and describing the risks and benefits, and the patient and/or family members expressing their preferences and values . This conversation leads to a better understanding of the relevant factors and shared responsibility for deciding how to proceed in a manner consistent with family preferences and values .
In previous work we elicited parent and adolescent perspectives regarding the treatment decision making in JIA [6, 10]. However, the clinician perspective was unknown. Therefore, we undertook a needs assessment aimed at delineating the current decision making process in JIA treatment, in order to understand the barriers and facilitators to shared decision making. The study occurred within the context of a quality improvement initiative of the Pediatric Rheumatology Care and Outcomes Improvement Network (PR-COIN) aimed at enhancing shared decision making around therapeutics for JIA. PR-COIN is a learning network with a mission to improve the care delivery and outcomes of patients with JIA [16, 17]. PR-COIN’s approach is to use quality improvement science in tandem with the improving chronic illness care model . Central to this model is an enriched partnership of patients and practice teams to improve patient centered outcomes through the safe use of therapeutics and delivery of high quality care.
We conducted a decision-making needs assessment in 2 steps. First we conducted and analyzed semi-structured interviews using established qualitative methods. Then we validated that data and enriched our understanding by presenting pediatric rheumatology clinicians attending a PR-COIN learning network meeting with questions to identify and discuss areas of variation, between clinicians, in the decision-making process. The Cincinnati Children’s Hospital Medical Center Institutional Review Board approved this study.
Using a combination of purposeful and snowball sampling , we recruited pediatric rheumatology clinicians with prescribing authority from 2 large, academically-oriented children’s hospitals affiliated with PR-COIN. Using snowball sampling , where individuals identify people known to them to approach for study participation, we asked early participants to name fellow clinicians with disparate approaches to working with families. Our overall goal was to hear about diverse approaches to working with families. We e-mailed potential participants to introduce the project and inform them that a study team member would be calling, unless they declined to participate. A study team member then called potential participants to schedule an in-person interview with one of two trained interviewers (EL, JS). Informed consent was obtained from all participants. Interviews were audio-recorded for verbatim transcription and verified by study staff. Recruitment continued until information saturation was achieved .
A semi-structured interview guide (Additional file 1) was developed based on adult and pediatric literature about treatment decision making, research on parents’ experiences with treatment decision making in JIA  and input from pediatric rheumatologists. As interviews progressed, the major content areas remained constant but changes were made based on information learned in prior interviews. Although several interviewees mentioned other treatment-related decisions, such as physical therapy and sports participation, we focused this needs assessment on decisions about medications. Interviews focused on understanding the typical decision-making process, treatment attributes (e.g., side effects, cost, time to improvement, etc.) considered during decision making and the challenges of specific decision-making situations (e.g., new diagnosis, poorly controlled symptoms, etc.).
Interview data coding and analysis
We used descriptive content analysis for data coding and analysis [20, 21]. After reviewing the initial transcripts, the research team identified major content categories. Each interview was then coded by a minimum of 2 members of the research team. Coders identified interview content that fit into the major categories, as well as additional concepts that had not been identified in the initial interviews. Codes were aggregated and compared between coders. Major differences were resolved through discussion. The analytic process sought to identify areas of agreement among interviews, as well as outlying concepts and variations between participants.
Validation refers to the process of presenting the investigators’ findings to the participants or to individuals with similar characteristics to confirm the findings . We first did this by giving a presentation of the findings from our interviews to the pediatric rheumatology professionals attending a PR-COIN collaborative learning session. A learning session is a face-to-face meeting of learning network teams to study quality improvement, share results, and advance network projects. To identify and discuss areas of variation in decision-making processes, particularly related to the attributes found to influence decision making during initial interviews, we constructed multiple choice questions based upon the interview data (Additional file 2) and used an audience response system to capture the pattern of responses. For example, we asked, “How often do you discuss the magnitude of the expected improvement when starting or changing mediations: never, rarely, sometimes, almost always, always?” Following each question, the percent choosing each option was displayed graphically to participants and research team members facilitated a discussion to better understand the sources of variation among participants. This process assisted in the organization of themes from the interviews and confirmed our results. Results were further validated by inviting review and feedback on a draft of this manuscript by both interview and learning session participants. Collectively these groups are referred to as clinicians throughout this manuscript.
We interviewed a total of 10 clinicians. Most were white, female and had been in their current position for an average of 4.5 years (Table 1). Learning session participants included 24 clinicians from 12 hospitals, of which 21 had prescribing authority. Demographic information was not collected from learning session participants, some of whom had also participated in interviews.
Our results are organized according the four major themes found in our data: clinicians’ decision process, treatment attributes, working with families to make decisions, and challenges in JIA treatment decisions. Each section has a corresponding table with quotations illustrating the findings.
Clinicians’ decision process
All clinicians indicated that the chronicity of JIA leads to multiple decision points. (Table 2) Moreover, decisions may recur during the course of treating a patient with JIA. As one clinician stated, “…down the road, we need to have a discussion and see how much benefit [the patient’s] gotten….then it’s just a reassessment.” In considering medication decisions most clinicians reported they had a preferred approach to treatment, such as following published guidelines, step-up therapy, or early aggressive therapy. However, there was wide-variation in which of these approaches each individual favored. These individual preferences, in turn, determined the menu of options presented to families.
The clinician’s preferred approach sometimes depended on the timing of the decision: whether the decision occurs at diagnosis, when symptoms persist despite current treatment, or when a patient has clinical remission on treatment. When initiating treatment for newly diagnosed children and adolescents, clinicians felt the treatment discussion was typified by a presentation of the array of treatment options perceived by the clinician to be the best choices. In the setting of treatment failure, decision making was complicated by the need to distinguish between ineffective treatment, poor adherence and treatment-limiting adverse drug reactions. After achieving remission, “…the attention immediately turns to ‘How do we get off these things?’”
When presenting treatment options to families, the attributes considered by clinicians fell into 4 categories: benefits, risks, logistics and family preferences. (Table 3) Treatment benefits included symptom relief, long-term effectiveness and time to expected improvement. As one physician stated, in describing a particular patient encounter, “I wanted to start [a specific medication] because I knew that it would work a lot faster.” Nearly all clinicians said they always or almost always discussed how likely a medication was to work, but there was less consistency in discussing the expected magnitude of improvement. In contrast, all clinicians considered the risks of treatment and discussed side-effects with parents. Infusion reactions, immunosuppression and malignancy were specifically mentioned as important side-effects to discuss.
When choosing options to present to families, most clinicians always or almost always considered logistical aspects of the treatment such as the route of administration, travel needed for infusions, costs, associated lab tests and the expected length of treatment. However, the specific logistics considered in each situation varied. For example, some clinicians, reflecting on their preferred options, felt that because some treatments only come in one form there is not always a choice to be made about route of administration. Finally, clinicians considered patient characteristics such as age, disease severity and the patient’s psychological and sociocultural context. For example, one clinician identified “chaotic households where there may be two parents or an absent parent, parents incarcerated or…whatever reason” as a particular challenge in treatment decision making.
Working with families to make decisions
Many clinicians expressed concern about families experiencing information overload. (Table 4) They felt that families’ ability to absorb and retain information is limited, especially at the time of diagnosis. As one clinician said, “…they just are in over their heads and they’re feeling very overwhelmed and you give them a lot of options I think they get—they just don’t know what to do.” Some try to meet the anticipated information needs by providing both verbal and written information.
Many clinicians also had concerns that parents’ fears of adverse drug reactions may limit “their willingness to use, maybe, certain medications that I think, perhaps, would be beneficial.” Others felt that addressing parents’ fears led to families being more open to treatment and may provide an opportunity to give the family needed hope and optimism. The concerns about families’ understanding of the disease and treatments, fear of adverse drug reactions and need for hope occurred against a backdrop in which some clinicians worried that families do not or cannot tell them what they do not understand.
Overall, descriptions of the decision-making process largely involved the clinician making a recommendation and anticipating that the family would accept it. However, there were situations that led to clinicians altering their practice, such as families who came to an appointment with outside information, difficult social situations or families with particular concerns about treatment. Likewise, when the evidence was less clear, such as in deciding when to stop treatment, clinicians were more likely to actively consider family members’ preferences.
Challenges in JIA treatment decisions
Clinicians highlighted a number of medical and system challenges to making treatment decisions for children with JIA. (Table 5) Medical challenges included limited long-term data for some treatments, the challenge of achieving disease control while minimizing adverse drug reactions and long-term risks, and “that we don’t know when it’s okay to stop these medications.” This last point was particularly emphasized during the learning session discussion in which clinicians’ answers about when they would consider stopping treatment for a patient in remission on medication varied widely. There were also health care system challenges; the most commonly mentioned being the cost of treatment and difficulties obtaining insurance approval. Another system challenge was ensuring families get consistent information from all clinicians.
Consistent with what is known from parents’ perspectives , our needs assessment revealed a clinician-centered decision-making process in JIA, including which options are being considered and the weight given to treatment attributes. Importantly, however, nearly all clinicians described situations in which they would alter their typical process. This suggests a capacity for flexibility and a willingness to consider other approaches to treatment decision making. Such flexibility is essential to PR-COIN’s work to improve shared decision making.
Clinicians’ stated concerns about over-whelming families with information may be one of the reasons that other studies, in both JIA  and other conditions , have found that families lack desired information. This lack of desired information is particularly notable since the treatment attributes considered by parents  mirror those highlighted by the clinicians in this study. Alternatively, due to the different value clinicians and families place on treatment attributes, the relative amount of information provided about each attribute may mismatch the family’s needs. This contrast between clinicians’ concerns about information overload and many families experience of being under-informed  suggests that new methods, such as decision aids, are needed for assessing and addressing families’ information needs in pediatric rheumatology.
In adult medicine, numerous studies have addressed patients’ information needs through the use of decision aids [23, 24]. In addition to addressing information needs, decision aids may also help ensure that families are included, to the extent they desire, in treatment decisions . Interventions that help develop a two-way flow of information may be more successful at shifting the decision-making structure to one that is more family-centered [25, 26], by helping clinicians consider the patient/family goals and preferences, as well as provide sufficient, consistent information to families. Changing clinicians’ behavior will be challenging [27, 28], However, our needs assessment revealed opportunities that exist for expanding shared decision making into pediatric rheumatology. For areas that currently lack treatment guidelines or where there is professional uncertainty, such as in treatment de-intensification, clinicians already describe a more active role for families. Developing tools [23, 24] that channel this impulse to include families in some decisions is an essential step towards more broad adaptation of shared decision making.
To further facilitate such a change, treatment guidelines could highlight decisions that have multiple medically reasonable options about which patients and parents may have differing preferences. Including such prompts for shared decision making may help alleviate some of the tension between following guidelines and engaging in shared decision making. Additionally, such guidelines could be coupled with decision aids to further facilitate elicitation of family preferences .
Given that little research has focused on pediatric clinicians’ roles in treatment decisions, especially among sub-specialists, this needs assessment provides important insight into how such decisions are made but does have limitations. Our finding that information saturation was achieved after the tenth interview was confirmed by the learning session discussion which revealed no new topics or treatment attributes. Although we included clinicians from 12 institutions in our process of data validation the generalizability of this work, especially outside of pediatric rheumatology, may be limited. All clinicians were aware that this work was conducted as preparation for implementing shared decision making tools within PR-COIN. Such knowledge may have influenced the way clinicians discussed decision making, particularly their experiences partnering with families. Additionally, although previous work has focused on parents’  and adolescents’  perspectives on decision making, the study reported here only includes the clinician perspective.
Based on the findings of this needs assessment, the authors of this manuscript and collaborators from PR-COIN are developing a tool to be used during clinic visits to help structure decision making. This tool, like others designed to support selecting a medication from among multiple medications with multiple attributes [24, 30, 31], will facilitate consistent information delivery and spark conversations between clinicians and families. It will highlight the treatment attributes which providers and parents considered key to treatment decisions. Moreover, the tool will present the minimum amount of information necessary so that clinicians can tailor the depth of information to individual families’ needs. Importantly, while this study presents a needs assessment based on interviews with prescribing clinicians, patients and families will be key partners in assuring our success in developing a tool to support shared decision making.
Understanding the current decision making process, in this case in JIA, is an essential step towards developing methods for improving the quality of medical decisions. Despite strong evidence of efficacy in adult medicine , the adoption of tools designed to foster shared decisions has been slow in practice settings [32–34]. However, by conducting this needs assessment within the confines of a collaborative learning network and garnering agreement about the potential for benefit of such tools, we anticipate a more rapid adoption of tools in network sites and an opportunity to measure their impact. In turn, the adoption of shared decision making tools may lead to improved decision quality and higher value care as chosen treatments are consistent with patients’ and parents’ well-informed preferences.
Juvenile idiopathic arthritis
Pediatric rheumatology care and outcomes improvement network.
Chedeville G, Scuccimarri R, Duffy CM: Survey on the use of methotrexate by pediatric rheumatologists in Canada. J Rheumatol. 2007, 34: 818-822.
Becker ML, Rose CD, Cron RQ, Sherry DD, Bilker WB, Lautenbach E: Effectiveness and toxicity of methotrexate in juvenile idiopathic arthritis: comparison of 2 initial dosing regimens. J Rheumatol. 2010, 37: 870-875. 10.3899/jrheum.090826.
Cron RQ, Sharma S, Sherry DD: Current treatment by United States and Canadian pediatric rheumatologists. J Rheumatol. 1999, 26: 2036-2038.
Hayward K, Wallace CA: Recent developments in anti-rheumatic drugs in pediatrics: treatment of juvenile idiopathic arthritis. Arthritis Res Ther. 2009, 11: 216-10.1186/ar2619.
Beukelman T, Patkar NM, Saag KG, Tolleson-Rinehart S, Cron RQ, DeWitt EM, Ilowite NT, Kimura Y, Laxer RM, Lovell DJ: 2011 American College of Rheumatology recommendations for the treatment of juvenile idiopathic arthritis: initiation and safety monitoring of therapeutic agents for the treatment of arthritis and systemic features. Arthritis Care Res (Hoboken). 2011, 63: 465-482. 10.1002/acr.20460.
Lipstein EA, Lovell DJ, Denson LA, Moser DW, Saeed SA, Dodds CM, Britto MT: Parents’ Information Needs in Tumor Necrosis Factor-alpha Inhibitor Treatment Decisions. J Pediatr Gastroenterol Nutr. 2012, 65: 244-250.
Baildam E: A commentary on TREAT: the trial of early aggressive drug therapy in juvenile idiopathic arthritis. BMC medicine. 2012, 10: 59-10.1186/1741-7015-10-59.
Wennberg JE, Fisher ES, Skinner JS: Geography and the debate over Medicare reform. 2002, Millwood: Health Aff, W96-W114.
Van Hulst LT, Kievit W, Van Bommel R, Van Riel PL, Fraenkel L: Rheumatoid arthritis patients and rheumatologists approach the decision to escalate care differently: results of a maximum difference scaling experiment. Arthritis Care Res (Hoboken). 2011, 63: 1407-1414. 10.1002/acr.20551.
Lipstein EA, Muething KA, Dodds CM, Britto MT: “I’m the One Taking It”: Adolescent Participation in Chronic Disease Treatment Decisions. J Adolesc Health. 2013, 53: 253-259. 10.1016/j.jadohealth.2013.02.004.
Unguru Y, Sill AM, Kamani N: The experiences of children enrolled in pediatric oncology research: implications for assent. Pediatrics. 2010, 125: e876-e883. 10.1542/peds.2008-3429.
Beresford BA, Sloper P: Chronically ill adolescents’ experiences of communicating with doctors: a qualitative study. J Adolesc Health. 2003, 33: 172-179. 10.1016/S1054-139X(03)00047-8.
Knopf JM, Hornung RW, Slap GB, DeVellis RF, Britto MT: Views of treatment decision making from adolescents with chronic illnesses and their parents: a pilot study. Health Expect. 2008, 11: 343-354. 10.1111/j.1369-7625.2008.00508.x.
Charles C, Gafni A, Whelan T: Decision-making in the physician-patient encounter: revisiting the shared treatment decision-making model. Soc Sci Med. 1999, 49: 651-661. 10.1016/S0277-9536(99)00145-8.
Barry MJ, Edgman-Levitan S: Shared decision making–pinnacle of patient-centered care. N Engl J Med. 2012, 366: 780-781. 10.1056/NEJMp1109283.
Bingham CA, Darbie LM, Marsolo K, Weiss JE, Ardoin SP, Laxer RM, Lovell DJ, Passo MH, Vora S, Gottlieb BS: Improving Delivery of Care for JIA Across a Multi-Center Network Using a Shared Data Registry and Quality Improvement Science: The Pediatric Rheumatology Care and Outcomes Improvement Network. Arthritis Rheum. 2012, 64: S1101-
Pediatric Rheumatology Care & Outcomes Improvement Network.http://pr-coin.org,
Wagner EH, Austin BT, Von Korff M: Improving outcomes in chronic illness. Managed care quarterly. 1996, 4: 12-25.
Patton MQ: Qualitative evaluation and research methods. 1990, Newbury Park, Calif: Sage Publications, 2
Pope C, Mays N: Qualitative Research in Health Care. 2006, Malden: Blackwell Publishing, Third
Sandelowski M: Whatever happened to qualitative description?. Res Nurs Health. 2000, 23: 334-340. 10.1002/1098-240X(200008)23:4<334::AID-NUR9>3.0.CO;2-G.
Guerriere DN, McKeever P, Llewellyn-Thomas H, Berall G: Mothers’ decisions about gastrostomy tube insertion in children: factors contributing to uncertainty. Dev Med Child Neurol. 2003, 45: 470-476.
Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Legare F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011, CD001431-
Breslin M, Mullan RJ, Montori VM: The design of a decision aid about diabetes medications for use during the consultation with patients with type 2 diabetes. Patient Educ Couns. 2008, 73: 465-472. 10.1016/j.pec.2008.07.024.
Pediatrics AAo: Family-centered care and the pediatrician’s role. Pediatrics. 2003, 112: 691-697.
Gabe J, Olumide G, Bury M: ‘It takes three to tango’: a framework for understanding patient partnership in paediatric clinics. Soc Sci Med. 2004, 59: 1071-1079. 10.1016/j.socscimed.2003.09.035.
Bauchner H, Simpson L, Chessare J: Changing physician behaviour. Arch Dis Child. 2001, 84: 459-462. 10.1136/adc.84.6.459.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.
van der Weijden T, Boivin A, Burgers J, Schunemann HJ, Elwyn G: Clinical practice guidelines and patient decision aids. An inevitable relationship. J Clin Epidemiol. 2012, 65: 584-589. 10.1016/j.jclinepi.2011.10.007.
Brinkman WB, Hartl Majcher J, Poling LM, Shi G, Zender M, Sucharew H, Britto MT, Epstein JN: Shared decision-making to improve attention-deficit hyperactivity disorder care. Patient Educ Couns. 2013, 93: 95-101. 10.1016/j.pec.2013.04.009.
Mullan RJ, Montori VM, Shah ND, Christianson TJ, Bryant SC, Guyatt GH, Perestelo-Perez LI, Stroebel RJ, Yawn BP, Yapuncich V: The diabetes mellitus medication choice decision aid: a randomized trial. Arch Intern Med. 2009, 169: 1560-1568.
Elwyn G, Edwards A, Wensing M, Hood K, Atwell C, Grol R: Shared decision making: developing the OPTION scale for measuring patient involvement. Qual Saf Health Care. 2003, 12: 93-99. 10.1136/qhc.12.2.93.
Legare F, Ratte S, Stacey D, Kryworuchko J, Gravel K, Graham ID, Turcotte S: Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2010, CD006732-
Gravel K, Legare F, Graham ID: Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals’ perceptions. Implement Sci. 2006, 1: 16-10.1186/1748-5908-1-16.
Thank you to the PR-COIN sites that participated in this work: Ann & Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL; Cincinnati Children’s Hospital Medical Center, Cincinnati, OH; Steven and Alexandra Cohen Children’s Medical Center of New York, Long Island (Lake Success), NY; The Joseph M. Sanzari Children’s Hospital, Hackensack University Medical Center, Hackensack, NJ; Lucile S. Packard Children’s Hospital at Stanford, Palo Alto, CA; Medical College of Wisconsin, Milwaukee, WI; Medical University of South Carolina, Charleston, SC; Nationwide Children’s Hospital, Columbus, OH; Penn State Milton S. Hershey Children’s Hospital, Hershey, PA; The Hospital for Sick Children, Toronto, ON, Canada; University of Alabama Birmingham, Birmingham, AL; University of Chicago Medicine Comer Children’s Hospital, Chicago, IL.
This work is supported by Centers for Education and Research on Therapeutics grant #1U19HS021114 from AHRQ, principal investigator Dr. Lannon. Dr. Brinkman is supported by grant #K23MH083027 from NIMH. Dr. Lipstein is supported by grant #K23HD073149 from NICHD.
The authors declare they have no competing interests.
EL participated in design of the study, conducted interviews and facilitated learning session discussions, coded the data, interpreted the results and drafted the manuscript. WB participated in design of the study, facilitated learning session discussions, coded the data and helped draft the manuscript. JS conducted interviews and coded the data. CL participated in design of the study. EMD participated in design of the study, facilitated learning session discussions, coded the data and helped draft the manuscript. All authors provided critical revision of the manuscript, read and approved the final manuscript. All authors read and approved the final manuscript.