The development and usability testing of digital knowledge translation tools for parents of children with bronchiolitis ======================================================================================================================= * Anne Le * Lisa Hartling * Shannon D. Scott ## Abstract Bronchiolitis is an acute infection of the lower respiratory tract that predominantly affects children less than two years old. Although self-limiting, symptoms of bronchiolitis can be distressing for young children. Research has demonstrated that parents may not have the necessary information to be able to identify bronchiolitis symptoms, resulting in emergency department (ED) visits and hospitalizations. Parents have expressed that they feel unprepared, afraid, and that they lack information on their child’s condition. Digital knowledge translation (KT) tools have the potential to convey complex health information to parents to support their healthcare decision-making needs. We worked with parents of children with bronchiolitis to develop and evaluate three digital tools on bronchiolitis (whiteboard animation video, infographic, and e-Book). Following prototype completion, usability testing was conducted using iPads in two Alberta ED waiting rooms. Parents were randomized to one out of the three tools. Overall, the tools were highly rated, suggesting that arts-based digital tools are useful in delivering complex health information to parents. ## Introduction Bronchiolitis, an acute lower respiratory tract infection, often affects children less than two years old and is the most common cause of hospitalization for infants under the age of 1 [1-2]. Often caused by the respiratory syncytial virus (RSV), characteristics of bronchiolitis include acute inflammation, edema, necrosis of epithelial cell linings, and increased mucus production [2-3]. Although bronchiolitis is often self-limiting, small amounts of inflammation may cause respiratory distress due to the small anatomy of children [4]. As a result of the wide variation in disease states, methods of bronchiolitis diagnosis and treatment vary and overuse of unnecessary tests and treatments are frequent [2,5]. Previous research has identified that parents may not always be aware of bronchiolitis symptoms and when to seek care, and as a result, have experienced feelings of fear, isolation, and helplessness [6]. This demonstrates the need for parents to understand the condition and more effective knowledge sources [6]. Research evidence suggests that targeting health consumers such as parents may aid in the development of tools that facilitate understanding and decision making [7-8]. Furthermore, targeting knowledge translation (KT) resources at parents may reduce health care utilization and improve health outcomes [9]. Past literature has demonstrated the power of innovative methods over traditional written information, highlighting the potential for art and narrative-based approaches, such as infographics, when educating patients and families [10-12]. To date, there have been limited tools developed using art forms to educate about bronchiolitis. Existing tools often discuss general respiratory tract issues or care and treatments [13-14]. In addition, these tools commonly target health care providers and specific minority populations [15-16]. As co-directors of Translating Emergency Knowledge for Kids (TREKK), our research programs develop arts-based KT tools that deliver consumer-friendly, evidence-based information for parents. Combining parental narratives and best practice guidelines, we have developed an innovative method to equip parents with information and strategies to manage common childhood conditions (e.g., gastroenteritis, chronic pain, croup, asthma). The purpose of this study was to work with parents to develop and assess the usability of a whiteboard animation video, e-Book, and interactive infographic for bronchiolitis in children. ## Methods We employed a multi-method study involving patient engagement to develop, refine, and evaluate a whiteboard animation video, e-Book, and interactive infographic for pediatric bronchiolitis (**Figure 1**). Research ethics approval was obtained from the University of Alberta Health Research Ethics Board (Edmonton, AB) [Pro00062904]. Operational approvals were obtained from individual emergency departments and urgent care centres to conduct usability testing. ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F1) Figure 1. KT Tool Development Cycle ### Compilation of Parents’ Narratives Parental narratives were informed through semi-structured qualitative interviews (**Appendix A**) and a systematic review [6, 17-18]. Parents of children who presented to the Stollery Children’s Hospital (Edmonton, Canada) with bronchiolitis were invited to participate. Interviews were conducted by a research coordinator trained in qualitative methodology. Parents (n = 15) were asked to discuss their experiences having a child with bronchiolitis. Concurrently, a systematic review was conducted to synthesize current evidence about experiences and information needs of parents and caregivers managing bronchiolitis. Key findings from the systematic review and qualitative study were used to develop content outlines for a whiteboard animation video, e-Book, and interactive infographic. Results from the systematic review and qualitative interviews are published elsewhere [6, 17-18]. ### Intervention Development Storyboards, scripts, and skeletons were written by the research team and shared with a creative team to develop the e-tool prototypes. The creative team, which included graphic designers, artists, video developers, and authors were selected through a competitive process. Each tool included best available evidence on pediatric bronchiolitis from the TRanslating Emergency Knowledge for Kids (TREKK) Bottom Line Recommendations (BLR) [19]. Information pertinent to management of pediatric bronchiolitis was embedded within the storyline of the video and e-Book, which depicted parents struggling to manage their child’s condition (**Appendices B and C**). Likewise, information on symptoms, treatment options, and when to seek emergency care were included in the infographic (**Appendix D**). ### Revisions Iterative processes were used to develop the tools. We sought feedback from a variety of different stakeholder groups, including parents, health care professionals (HCPs), and researchers. HCPs were asked to comment on the accuracy of information and evidence, length of the tool, aesthetics, usefulness, and perceived value. Parents from our Pediatric Parent Advisory Group (P-PAG) were asked to provide feedback on the length, stylistic elements, and highlight areas not addressed in the tools. The P-PAG was developed by ECHO and ARCHE and meets once a month to provide parental feedback on our tools and research activities. Research team meetings are held weekly to discuss the development of our tools. Our KT Tool Development Cycle can be viewed in **Figure 1**. ### Video Five versions of the video were developed before the tool was ready for usability testing. The closed-captioned, English-language video is 5 minutes and 20 seconds in length and features a family of four (father, mother, older brother, and younger baby sister). The story begins with the brother, Sam, developing a cold which was later passed onto his younger sister, Kira. Unlike Sam who recovered quickly from the cold, Kira’s symptoms worsened, and she began exhibiting symptoms of bronchiolitis which included wheezing and skin sucking in around her neck and ribs. Following several attempts at managing Kira’s symptoms at home, the parents seek emergency care, resulting in a diagnosis of bronchiolitis. The video then outlines what bronchiolitis is, the symptoms associated with bronchiolitis, as well as the differences in how symptoms can manifest for the babies and older children. This is followed by general information on how bronchiolitis can be managed at home and when to seek professional help. Finally, the video describes what happens during an ED visit for bronchiolitis, if required. The video was later entered into the Canadian Institutes of Health Research (CIHR) Institute of Human Development, Child and Youth Health (IHDCYH) Talks Video Competition (2019) and received special commendation. ### E-Book In the 18-page eBook, a father narrates his experiences when his infant daughter, Rose, develops a cough, runny nose, and refuses to eat. Despite his best efforts to manage her symptoms at home, she does not get better. He calls the 24-hour health information line and is told to go to the ED. There, he learns that she has bronchiolitis. Throughout the story, the eBook describes common symptoms for infants and older children, risk factors, diagnosis methods, and common treatments. The story concludes with home care tips. To increase reader understanding, certain terms are defined in the appendix. ### Infographic The bronchiolitis interactive infographic was developed under the same style as our suite of infographics. The style is unique to our research program and underwent dozens of iterations and two years of development. In order to ensure consistency across all pediatric conditions, the same style, design elements, animations, and characters are used. The infographic looks similar to a webpage and allows users to scroll through the information, exploring at their own pace. The ability for parents to control what they view paced on their needs differentiates the interactive infographic from the video and e-Book. The information provided in the bronchiolitis infographic mirrors information that is provided in both the video and e-Book and is comprised of five major sections: (1) General Information about Bronchiolitis, (2) Here’s What You Can Do, (3) Treatment, (4) Useful Links, and (5) Contact Us. Within *General Information*, subheadings include what bronchiolitis is, common symptoms, and risk factors. Under *Here’s What You Can Do*, the tool provides information on what parents could do at home, when to seek emergency care, and what to do if they are confused. The infographic also includes quotes from parents who have had children affected by bronchiolitis. ### Surveys Parents were recruited to participate in an electronic, usability survey (**Appendix E**) in two urban ED waiting rooms in the Edmonton area (Stollery Children’s Hospital and Northeast Community Health Centre). Surveys were informed by a systematic review of over 180 usability evaluations and comprised of 9, 5-point Likert items assessing: 1) usefulness, 2) aesthetics, 3) length, 4) relevance, and 5) future use. Parents were also asked to provide their positive and negative opinions of the tool via two free text boxes [20]. Members of the study team approached parents in the ED to determine interest and study eligibility. Study team members were available in the ED to provide technical assistance and answer questions as parents were completing the surveys. ### Data Analysis Data were cleaned and analyzed using SPSS v.24. Descriptive statistics and measures of central tendency were generated for demographic questions. Likert answers were given a corresponding numerical score, with 5 being “Strongly Agree” and 1 being “Strongly Disagree” [21-22]. One-way analysis of variance (ANOVA) was used to determine whether there were statistically significant differences between the three tools. Open-ended survey data were analyzed thematically. A summary of the results was then shared with the creative team to inform the development of the final versions of the tools. ## Results 93 parents from 2 ED waiting rooms waiting rooms participated in this study. Of those, 33 reviewed the infographic, 30 reviewed the eBook, and 30 reviewed the video. In general, feedback for the bronchiolitis video and interactive infographic were positive, with participants giving the tools scores between 4.00 (*agree*) and 5.00 (*strongly agree*). Mean responses for the eBook varied more and ranged from 3 (*neither agree nor disagree*) to 5 (*strongly agree*). When asked about the usefulness of the tools, all parents strongly agreed or agreed that the tools were useful. High scores were also reported for relevance, simplicity, and aesthetics. Parents also indicated all tools could be used without written instructions or additional help. A significant difference is seen in the means regarding appropriateness of length; with a mean of 4.09 for the infographic length, 3.33 for the e-Book, and 4.30 for the video. The video and infographic also scored higher than the e-Book when parents were asked about plans for future use and decision-making, although differences were not statistically significant. Nonetheless, parents strongly agreed and agreed that they would recommend the tools to their friends. Table 2 displays the mean responses to the 9 usability questions based on tool. View this table: [Table 1.](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/T1) Table 1. Demographic characteristics of parents who assessed the usability of the bronchiolitis e-tools (N=93) View this table: [Table 2.](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/T2) Table 2. Means (SD) of participant responses to the usability survey *p < 0.05. In the open text boxes, parents described the bronchiolitis video as “clear”, “concise”, and “visually appealing”. One parent stated that they liked that the information was presented in a manner that was not too complicated. Another parent said, “This is an awesome tool that I would use. It should be posted in waiting rooms and on tv commercials”. Parents described the infographic as being very “well done” and that they appreciated that there was work and research being done in the pediatric knowledge translation space. Finally, parents described the e-Book as being a good resource to go through with their children and would be a valuable method of teaching them about illnesses. They liked that the book provided details about what to expect in the emergency department and were appreciative of the summary lists included in the book. Furthermore, parents described the storyline of the book as a way to teach children about empathy as well. ## Conclusions We developed and evaluated the usability of three innovative, arts-based, digital tools for parents with children with bronchiolitis. Using comprehensive methods that include (1) synthesis of evidence from the literature; (2) collection of our own evidence through interviews with parents who have had children with bronchiolitis; (3) content outline development; (4) tool design and development; (5) several rounds of revisions and modifications with stakeholders and the study team, and (6) usability testing with our end-users, we developed several tools that were highly rated and met the information needs of parents. High scores across all usability items for all tools suggest that using multi-method development processes can result in tools that are useful, relevant, understandable, and will be used by the intended audience. Our tools are easily accessible and can be viewed across a broad range of devices, including desktop computers, mobile phones, and tablet devices. Providing a means for quick and convenient access ensures that parents can obtain information about how to manage their child’s condition quickly and effective. Such resources may reassure parents, support them in caring for their children at home, and help them make evidence-based decisions about accessing health care services. This may also alleviate the burden on the health system. **The tools can be found here: [http://www.echokt.ca/tools/bronchiolitis/](http://www.echokt.ca/tools/bronchiolitis/)** Note: Our KT tools are assessed for alignment with current, best-available evidence every two years. If recommendations have changed, appropriate modifications are made to our tools to ensure that they are up-to-date [23]. ## Data Availability Data referred to in the manuscript are not available for access. Data are stored at on secured servers at the University of Alberta to protect participant privacy and confidentiality. ## Author Contributions This study was conducted under the supervision of Drs. Shannon D. Scott (SDS) and Lisa Hartling (LH), PIs for **translation Evidence in Child Health to enhance Outcomes** (ECHO) Research and the **Alberta Research Centre for Health Evidence**, respectively. Both PIs designed the research study and obtained research funding through Translating Emergency Knowledge for Kids (TREKK) Networks of Centres of Excellence of Canada (NCE), Stollery Children’s Hospital Foundation, and the Women and Children’s Health Research Institute. SS developed and supervised all aspects of tool development and evaluation. LH contributed to all aspects of tool development and evaluation and supervised the systematic review of parent experiences and information needs. Alyson Campbell and Samantha Louie-Poon conducted and analyzed qualitative interviews with parents. Tony An developed the infographic. Tabatha Plesuk and Hyelin Sung collected usability data. Anne Le analyzed usability data. All authors contributed to the writing of this technical report and provided substantial feedback. This work was funded by: **Networks of Centres of Excellence:** * Klassen, T., Hartling, L., Jabbour, M., Johnson, D., & Scott, S.D. (2015). Translating emergency knowledge for kids (TREKK). Networks of Centres of Excellence of Canada Knowledge Mobilization Renewal ($1,200,000). January 2016 – December 2019. **Women’s and Children Health Research Institute** * Scott, S.D & Hartling L. (2016). Translating Emergency Knowledge for Kids renewal. Women and Children’s Health Research Institute (matched dollars, $150,000). 2016/04- 2019/04. ## Other Outputs from this Project ## Appendices ## Appendix A Interview Guide Parents will be interviewed to understand their experience having a child with bronchiolitis. Semi-structured interviews will be conducted with parents in order to get their “narrative” or experiences. The following questions will be used to guide these interviews. Being true to semi-structured interview techniques, interview questions will start broad and then move to the more specific. 1. Tell me about your experience having your child experience bronchiolitis. 2. Tell me about your child that was ill. How old is your child? How was your child ill? Has your child previously bronchiolitis? 3. How did you feel during this experience? 4. Tell me how prepared you felt during the experience. Did you have all of the information you needed to make decisions about when to seek healthcare? Tell me more about that. 5. What did you do to manage symptoms of bronchiolitis? (any techniques you used, for example, giving Tylenol, talking with family/friends, etc.) 6. How was your experience in the ED? Tell me about it. 7. Tell me about your child being diagnosed with bronchiolitis – were any tests done? Any medications ordered? 8. What strategies were put in place by health care professionals to help your child? (for example, giving/prescribing medication). Did they ask you to do anything? 9. How did your child manage the experience? How did you feel about the outcome of this situation? 10. If presented with the same situation again, would you do anything differently? If so, please tell me. ## Appendix B Video Images ![Figure2](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F2.medium.gif) [Figure2](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F2) ![Figure3](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F3.medium.gif) [Figure3](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F3) ![Figure4](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F4.medium.gif) [Figure4](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F4) ## Appendix C e-Book Images ![Figure5](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F5.medium.gif) [Figure5](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F5) ![Figure6](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F6.medium.gif) [Figure6](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F6) ![Figure7](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F7.medium.gif) [Figure7](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F7) ## Appendix D Infographic Images ![Figure8](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F8.medium.gif) [Figure8](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F8) ![Figure9](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F9.medium.gif) [Figure9](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F9) ![Figure10](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F10.medium.gif) [Figure10](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F10) ## Appendix E Usability Survey SECTION 1: Demographics * 1) What is your gender? * □ Male * □ Female * 3) What is your Age? * □ Less than 20 years old * □ 20-30 years * □ 31-40 years * □ 41-50 years * □ 51 years and older * 7) What is your Marital Status? * □ Married * □ Single * 5) What is your gross annual household income? * □ Less than $25,000 * □ $25,000-$49,999 * □ $50,000-$74,999 * □ $75,000-$99,999 * □ $100,000-$149,999 * □ $150,000 and over * 6) What is your highest level of education? * □ Some high school * □ High school diploma * □ Some post-secondary * □ Post-secondary certificate/diploma * □ Post-secondary degree * □ Graduate degree * □ Other * 7) How many children do you have? * 8) How old are your children? SECTION 2: Assessment of attributes of the arts-based, digital tools ****participant is randomized to view 1 of 3 digital tools then automatically directed to the survey*** 1. It is useful. [5-point Likert Scale] 2. It provides information that is relevant to me as a parent. [5-point Likert Scale] 3. It is simple to use. [5-point Likert Scale] 4. I can use it without written instructions or additional help. [5-point Likert Scale] 5. Its length is appropriate. [5-point Likert Scale] 6. It is aesthetically pleasing (i.e., images, colours, etc.). [5-point Likert Scale] 7. It helps me to make decisions about my child’s health. [5-point Likert Scale] 8. I would use it in the future. [5-point Likert Scale] 9. I would recommend it to a friend. [5-point Likert Scale] 10. List the most negative aspects: [open text] 11. List the most positive aspects: [open text] ## Appendix F Project Timeline ![Figure11](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/06/28/2021.06.21.21259266/F11.medium.gif) [Figure11](http://medrxiv.org/content/early/2021/06/28/2021.06.21.21259266/F11) ## Footnotes * **This report should be cited as:** Le, A., Hartling, L., Scott, S.D. (2021). The development and usability testing of digital knowledge translation tools for parents of children with bronchiolitis. Technical Report. ECHO Research, University of Alberta. *Available at: [http://www.echokt.ca/research/technical-reports/](http://www.echokt.ca/research/technical-reports/)* * Received June 21, 2021. * Revision received June 21, 2021. * Accepted June 28, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## Research Papers 1. Campbell, A., Hartling, L., Louie-Poon, S., Scott, S.D. (2020). Parent experiences caring for a child with bronchiolitis: a qualitative study. Journal of Patient Experience, 1–7. [https://doi.org/10.1177/2374373520924526](https://doi.org/10.1177/2374373520924526) 2. Campbell, A., Hartling, L., Louie-Poon, S., Scott, S.D. (2019) Parents’ information needs and preferences related to bronchiolitis: A qualitative study. CMAJ Open, 7(4): E640–E645. [https://doi.org/10.9778/cmajo.20190092](https://doi.org/10.9778/cmajo.20190092) [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiY21ham8iO3M6NToicmVzaWQiO3M6ODoiNy80L0U2NDAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wNi8yOC8yMDIxLjA2LjIxLjIxMjU5MjY2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 3. Gates, M., Shulhan-Kilroy, J., Featherstone, R., MacGregor, T., Scott, S.D., Hartling, L. (2018). Parent experiences and information needs related to bronchiolitis: a mixed methods systematic review. Patient Education and Counseling, 102(5), 864-878. [https://doi.org/10.1016/j.pec.2018.12.013](https://doi.org/10.1016/j.pec.2018.12.013) ## Presentations & Research Conferences 1. Sung, H., Scott, S.D. (2020). Evaluating a social media campaign for a parent educational video on bronchiolitis. Women and Children’s Health Research Institute Research Day. Edmonton, AB. October 6, 2020. 2. Scott, S.D., Hartling, L. Developing innovative e-tools to help parents manage bronchiolitis: merging research and parental experience. Children’s Healthcare Canada Annual Conference. Ottawa, ON. December 8–10, 2019. 3. Sung, H., Le, A., Plesuk, T., Brooks, H.M., Ahn, T., Hartling, L., Scott, S.D. Usability of infographics for pediatric UTI and bronchiolitis. Shirley Stinson Nursing Research Conference. Edmonton, AB. November 7, 2019. 4. Louie-Poon, S., Plesuk, T., Campbell, A., Sung, H., Le, A., Brooks, H.M., Hartling, L., Scott, S.D. Comparing the usability evaluation results of three parental tools for bronchiolitis. Shirley Stinson Nursing Research Conference, Edmonton, AB. November 7, 2019. 5. Sung, H., Le, A., Plesuk, T., Brooks, H.M., Ahn, T., Hartling, L., Scott, S.D. Usability of infographics for pediatric UTI and bronchiolitis. Women and Children’s Health Research Institute Research Day. Edmonton, AB. November 6, 2019. 6. Louie-Poon, S., Plesuk, T., Campbell, A., Sung, H., Le, A., Brooks, H.M., Hartling, L., Scott, S.D. Comparing the usability evaluation results of three parental tools for bronchiolitis. Women and Children’s Health Research Institute Research Day. Edmonton, AB. November 6, 2019. 7. Louie-Poon, S., Plesuk, T., Campbell, A., Sung, H., Le, A., Brooks, H.M., Hartling, L., Scott, S.D. Comparing the usability evaluation results of three parental tools for bronchiolitis. Women and Children’s Health Research Institute Public Lecture on Children’s Pain. Edmonton, AB. November 5, 2019. 8. Sung, H., Le, A., Plesuk, T., Brooks, H.M., Ahn, T., Hartling, L., Scott, S.D. Usability of infographics for pediatric UTI and bronchiolitis. Undergraduate Student Summer Series: Launchpad to Research, Edmonton, AB. July 24, 2019. 9. Gates, M., Shulhan-Kilroy, J., Featherstone, R., MacGregor, T., Scott S.D., Hartling, L. Parent self-reports of experiences and information needs related to bronchiolitis: a mixed studies systematic review. Pediatric Research Day. Edmonton, AB. May 16, 2018. ## References 1. 1.Nair, H., Nokes, D.J., Gessner, B.D., Dherani, M., Madhi, S.A., Singleton, R., et al. (2010). Global burden of acute lower respiratory infections due to respiratory syncytial virus in young children: A systematic review and meta-analysis. Lancet, 375, 1545–55. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(10)60206-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20399493&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.21.21259266.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000277655100027&link_type=ISI) 2. 2.Ralston, S.L., Lieberthal, A.S., Meissner, C., Alverson, B.K., Baley, J.E., Gadomski, A.M. (2014). Clinical practice guideline: The diagnosis, management, and prevention of bronchiolitis. Pediatrics, 134, e1474–e1502. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6MTE6IjEzNC81L2UxNDc0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDYvMjgvMjAyMS4wNi4yMS4yMTI1OTI2Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 3. 3.Piedimonte, G., Perez, M.K. (2014). Respiratory syncytial virus infection and bronchiolitis. Pediatrics in Review, 35(12), 519–30. 4. 4.Friedman, J.N., Rieder, M.J., Walton, J.M. (2014). Bronchiolitis: Recommendations for diagnosis, monitoring and management of children on to 24 months of age. Canadian Paediatric Society, 19(9), 485–91. 5. 5.Sarmiento, L., Rojas-Soto, G.E., Rodriguez-Martinez, C. (2017). Predictors of inappropriate use of diagnostic tests and management of bronchiolitis. BioMed Research International, 2017, 1–8. 6. 6.Gates, M., Shulhan-Kilroy, J., Featherstone, R., MacGregor, T., Scott, S.D., Hartling, L. (2019). Parent experiences and information needs related to bronchiolitis: A mixed studies systematic review. Patient Education and Counseling, 102, 864–878. 7. 7.Slater, M.D., Buller, D.B., Waters, E., Archibeque, M., LeBlance, M. (2003). A test of conversational and testimonial messages versus didactic presentations of nutrition information. Research Brief, 35, 255–259. 8. 8.Scott, S.D., Osmond, M.H., O’Leary, K.A., Graham, I.D., Grimshaw, J., Klassen, T., and the Pediatric Emergency Research Canada (PERC) MDI/space Study Group. (2009). Barriers and supports to implementation of MDI/spacer use in nine Canadian pediatric emergency departments: A qualitative study. Implementation Science, 4, 65–75. 9. 9.Scott, S.D., Albrecht, L., Given, L.M., Hartling, L., Johnson, D.W., Jabbour, M., Klassen, T. (2018). Pediatric information seeking behaviour, information needs, and information preferences of health care professionals in general emergency departments: Results from the Translating Emergency Knowledge for Kids (TREKK) Needs Assessment. CJEM, 20(1), 89–99. 10. 10.Delp, C., Jones, J. (1996). Communicating information to patients: The use of cartoon illustrations to improve comprehension of instructions. Academic Emergency Medicine, 3(3), 264–70. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1553-2712.1996.tb03431.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=8673784&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.21.21259266.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1996TX51300016&link_type=ISI) 11. 11.Austin, P.E., Matlack, R., Dunn, K.A., Kesler, C., Brown, C.K. (1995). Discharge instructions: Do illustrations help our patients understand them?. General Clinical Investigation, 25(3), 317–320. 12. 12.Silver, D. (2001). Songs and storytelling: Bringing health messages to life in Uganda. Education for Health, 14(1), 51–60. 13. 13.Francis, N.A., Hood, K., Simpson, S., Wood, F., Nuttall, J., Butler, C.C. (2008). The effect of using an interactive booklet on childhood respiratory tract infections in consultations: Study protocol for a cluster randomized controlled trial in primary care. BMC Family Practice, 9(23), 1–11. 14. 14.Wheeler, J.G., Fair, M., Simpson, P.M., Rowlands, L.A., Aitken, M.E., Jacobs, R.F. (2001). Impact of a waiting room videotape message on parent attitudes toward pediatric antibiotic use. Pediatrics, 108(3), 591–96. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6OToiMTA4LzMvNTkxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDYvMjgvMjAyMS4wNi4yMS4yMTI1OTI2Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 15. 15.Murch, H., Oakley, J., Pierrepoint, M., Powell, C. (2015). Using multifaceted education to improve management in acute viral bronchiolitis. Arch Dis Child, 100, 654–8. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTI6ImFyY2hkaXNjaGlsZCI7czo1OiJyZXNpZCI7czo5OiIxMDAvNy82NTQiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wNi8yOC8yMDIxLjA2LjIxLjIxMjU5MjY2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 16. 16.McKay, C.C., Chang, A.B., Versteegh, L.A., McCallum, G.B. (2015). Culturally appropriate flipcharts improve that knowledge of common respiratory conditions among Northern Territory Indigenous families. Health Promotion Journal of Australia, 26, 150–3. 17. 17.Campbell, A., Hartling, L., Louie-Poon, S., Scott, S.D. (2019) Parents’ information needs and preferences related to bronchiolitis: A qualitative study. CMAJ Open, 7(4): E640–E645. [https://doi.org/10.9778/cmajo.20190092](https://doi.org/10.9778/cmajo.20190092) [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiY21ham8iO3M6NToicmVzaWQiO3M6ODoiNy80L0U2NDAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wNi8yOC8yMDIxLjA2LjIxLjIxMjU5MjY2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 18. 18.Campbell, A., Hartling, L., Louie-Poon, S., Scott, S.D. (2020). Parent experiences caring for a child with bronchiolitis: a qualitative study. Journal of Patient Experience, 1–7. 19. 19.TRanslating Emergency Knowledge for Kids (TREKK). Bronchiolitis – Bottom Line Recommendations. April 2017 – Version 1.0. Retrieved from: [https://trekk.ca/resources?tag_id=D001988](https://trekk.ca/resources?tag_id=D001988) 20. 20.Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies andresearch. International journal of human-computer studies. 64(2), 79–102. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijhcs.2005.06.002&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000234658400002&link_type=ISI) 21. 21.Carifio, J., & Perla, R. (2008). Resolving the 50-year debate around using and misusing Likert scales. Blackwell Publishing, 42, 1150–1152. 22. 22.Sullivan, G.M., & Artino Jr., A.R. (2013). Analyzing and interpreting data from Likert-type scales. Journal of Graduate Medical Education, Editorial. 23. 23.Featherstone, R.M., Leggett, C., Knisley, L., Jabbour, M., Klassen, T.P., Scott, S.D., Van De Mosselaer, G., Hartling, L. (2018). Creation of an integrated knowledge translation process to improve pediatric emergency care in Canada. Health Commun, 33(8), 980–987. [https://www.doi.org/10.1080/10410236.2017.1323538](https://www.doi.org/10.1080/10410236.2017.1323538).