“Multimorbidity and consultation time: a systematic review” =============================================================== * Ana Carolina Reis Tadeu * Inês Rosendo Carvalho e Silva Caetano * Inês Jorge de Figueiredo * Luiz Miguel Santiago ## ABSTRACT **Background** Multimorbidity (MM) is one of the major challenges health systems currently face. Management of time length of a medical consultation with a patient with MM is a matter of concern for doctors. **Objectives** To describe the impact of MM on the average time of a medical consultation. **Methods** A systematic review was performed considering the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) guidelines. The systematic online searches of the Embase and PubMed databases were undertaken, from January 2000 to August 2018. The studies were independently screened by two reviewers to decide which ones met the inclusion criteria. (Kappa=0.84 and Kappa=0.82). Differing opinions were solved by a third person. This systematic review included people with MM criteria as participants (two or more chronic conditions in the same individual). The type of outcome included was explicitly defined – the length of medical appointments with patients with MM. Any strategies aiming to analyse the impact of MM on the average consultation time were considered. The length of time of medical appointment for patients without MM was the comparator criteria. Experimental and observational studies were included. **Results** Of 85 articles identified, only 1 observational study was included, showing a clear trend for patients with MM to have longer consultations than patients without MM criteria (*p*<0.001). **Conclusions** More studies are necessary to assess better allocation length-time for patients with MM and to measure other characteristics like doctors workload. Keywords * Multimorbidity * Medical appointment * Quality of healthcare * Consultation length-time ## 1. INTRODUCTION Multimorbidity (MM) is defined by the European General Practice Research Network as “any combination of chronic disease with at least one other disease (acute or chronic) or biopsychosocial factor (associated or not) or somatic risk factor”.1 This is sometimes simplified to, “the simultaneous occurrence of two or more chronic diseases in the same individual”.2 MM is now one of the main challenges faced by health systems at an international level and occupies a considerable part of the daily activity of General Practitioners/Family Doctors (GPs/FMs) around the world.3-6 With an ever ageing world population, MM and its consequences, are becoming a major issue in public health and primary care. According to United Nations data,7,8 Europe has the largest percentage of population aged 60 or over (25%).7 In 2015 the number of people in the world aged 60 years and older was 901 million.8 It is projected that in 2030 this figure will rise to 1.4 billion (a 56% increase since 2015) and stand at 2.1 billion in 2050.8 Several studies have shown that there is a significant association between age2 and the prevalence of MM, most national health systems not being prepared or able to cope with this rapid ageing with many demands.5,6 So it is imperative to think about the approach to patients with MM to maximize the quality of services provided by the Health Services (HS) consequently guaranteeing a better quality of life for such patients. GPs/FMs medical team face various difficulties in caring for a patient with MM like lack of resources; consultation time restrictions; lack of interdisciplinary care/teams; inadequate patient support (largely relying on community-based support services); inadequate tools (guidelines are drawn up strictly for specific diseases and not for the MM patient); the attitude of the patient (often discouraged and poorly engaged).4,9 Information about the length-time of a consultation with a patient with MM is essential to better organize and deliver healthcare. To our knowledge, no previous review has summarized data related to: “What is the impact of having MM on the medical consultation?” “Is the average length-time consultation with a patient with MM longer than for a patient without MM?” ## 2. METHODS A systematic review was performed considering the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) guidelines for systematic reviews and meta-analysis with: ### 2.1 Eligibility criteria Articles about people with MM. The most widely used definition of MM was used, which is the coexistence of two or more chronic conditions in the same individual.2 The World Health Organization (WHO) definition of chronic disease was adopted, namely, “health problems that require ongoing management over a period of years or decades”.10 Studied outcome: explicitly defined length-time of medical appointments with patients with MM. Any strategies aiming to analyse the impact of MM on the average consultation time were considered. Studies which did not specify the time spent on medical appointments were excluded. The length of time of medical appointment for patients without MM was the comparator criteria. Experimental and observational studies were included. ### 2.2 Information sources and search strategy The systematic online searches were undertaken using combinations of keywords in the following electronic databases: the Embase and PubMed databases, from 1st January 2000 until the 31st August 2018 to find pertinent studies. The search was limited to papers in English, Portuguese, Spanish and French. No other limits were imposed during this stage of the study. ### 2.3 Data extraction and quality assessment The potentially relevant studies were selected in two stages. First, the titles and abstracts quoted in the literature search were independently screened by two reviewers (CT and IF) to decide which ones met the inclusion criteria (Kappa=0.84). Those not meeting the inclusion criteria were excluded. Differing opinions on studies inclusion were resolved by a third person (IR). Secondly, the researchers independently read and analysed the integrity of the matching studies and tried to reach an agreement concerning eligibility (Kappa=0.82). Those not meeting the inclusion criteria were excluded. The quality and risk of bias of the included studies was assessed using the Newcastle-Ottawa Scale (NOS), more precisely, the Newcastle-Ottawa scale adapted for cross-sectional studies.11 This tool assesses three aspects of a study: the selection of the sample; the comparability of the groups; and the outcome (assessment of outcome and statistical test). It is composed of 7 items and classifies the study in 4 possible levels: Very good (9-10 points), Good (7-8 points), Satisfactory (5-6 points) and Unsatisfactory (0-4 points). Any disagreement was resolved through consensus. This systematic review was conducted using Covidence13, the standard production platform used for Cochrane reviews, which was used for the data and records management. ### 2.4 Outcomes and statistical analysis The patients were split into two groups, those with and those without MM, and the relative frequencies were calculated. The results were analyzed using the chi-square distribution test. ## 3. RESULTS ### 3.1 Study selection As described in **Flowchart 1**, the electronic database searches started with 85 potentially eligible references (26 in PubMed and 59 in Embase). Of these, 5 were duplicates and were thus excluded and 31 were considered irrelevant based on a review of the title and abstract. The remnant studies were fully read, analysed and assessed for eligibility, 36 being excluded due to wrong outcome3,12-46, 5 because of wrong study design47-51, 4 due to wrong patient population9,52-54, 2 for wrong language55-56 and 1 for wrong setting57. In the end, 1 study was included.58  [Flowchart 1](http://medrxiv.org/content/early/2019/09/23/19007328/F1) Flowchart 1 Literature search and selection process for studies included. ### 3.2 Study characteristics and quality The main relevant features and outputs of the study were extracted for the purpose of this systematic review and are summed up in **Table 1**. View this table: [Table 1](http://medrxiv.org/content/early/2019/09/23/19007328/T1) Table 1 Summary of study’s characteristics. The included study was conducted between 2008 and 2009 in Denmark, over 12 months. It involved 404 general practitioners (GPs) participants and a total of 8236 contacts. It included patients aged 40 years or more, grouped as those without any chronic condition and those with one, two, three or more chronic conditions. During the study period, the GPs completed a one-page registration form for each of their patient contacts. Of the various items that were registered, the ones relevant forthis review were information on chronic diseases and length-time of consultation. Quality assessment result, performed as described in methodology, is presented in **Table 2**. The quality of the study was considered satisfactory (score 6 out of a maximum score of 10), its main weakness being in the comparability section. View this table: [Table 2](http://medrxiv.org/content/early/2019/09/23/19007328/T2) Table 2 Quality of study - Newcastle-Ottawa Scale adapted for cross-sectional studies. ### 3.3 Results of study **Table 3** shows the relationship between the length of consultation time and the type of patient (with and without MM). There is a clear significant trend for patients with MM to have longer consultations than patients without MM (*p<*0.001). View this table: [Table3](http://medrxiv.org/content/early/2019/09/23/19007328/T3) More than 25% of MM patients had a consultation length-time of at least 16 minutes while more than 75% of the patients without MM had a consultation length-time under 15 minutes. Length-time consultation on both types of patients is more frequently between 6 and 15 minutes. There is a significant difference, however, in the percentage of patients with MM requiring more time than patients without MM criteria. ## 4. DISCUSSION The present systematic review sought to answer the following question: “Is the average consultation time spent on patients with MM longer than that spent on patients who do not meet the MM criteria?” could only identify one study,58 undertaken in Denmark, in which the consultation time was logged as a function of the number of chronic diseases. This study revealed a tendency for consultations to take longer for patients with MM than for those without MM. However, the study was not directly aimed at answering this question and it did not take confounding factors into account. In addition, it does not describe the calculation to determine the sample size of the study and it could be inaccurate to study this specific outcome. So the study was classified as “Satisfactory”. The small number of publications in the literature on this subject shows that more studies should be designed to investigate the impact of MM on the consultation length-time. It is vital to analyse this issue in order to manage resources so that they meet the actual need, and to ensure the services provided by health services, national or private, are appropriate. It will thus be possible to guarantee better quality health services and outcomes for these patients. In fact MM is about a patient with more then two chronic diseases or one chronic disease with biopsychosocial factor (associated or not) or somatic risk factor, so illness being included and not only about the specific sufferances.1,9 In studies with calculated size population representative random samples it is important that accurate methods are used to measure the real length-time of a consultation (i.e. from the moment that the doctor opens the patient’s file to the moment it is closed). Using stop-watches and self-reporting will probably lead to inaccuracies. The calculation of the length-time of the consultation obtained by dividing the total time a medical practitioner is in the clinic by the number of patients could yield average times that mask the real duration of each patient’s consultation. Also confounding factors must be eliminated as the time spent on administrative work, breaks and work meetings. Only direct observation using video recording has been proven to obtain accurate values when measuring the duration of consultations,59 which could be a procedure that mitigates many of the errors previously mentioned. The length-time of a consultation must be measured accurately to avoid errors and skewed judgements. It is essential to identify beforehand any possible confounding factors inherent to the patients (for example, hearing difficulty, education level, age, socio-economic level), inherent to the doctor (in particular, a change in behaviour due to the participation in the research study – Hawthorne effect60), and inherent to the consultation/institution (for example, glitches in computer systems, organization of necessary information in the health informatics records, coding errors, telephone call interruptions). The time lost searching for information in consultation, the friendliness of clinical informatics and the time spent on e.records are also issues to be studied and thought of 61, 62. Health determinants are factors to be studied in such a MM population for better health and social outcomes.63 The data analysis must be evaluated using objective validated laboratory methods and, if possible, it should be a blind assessment. Statistical tests used to analyse the data must be appropriate and clearly described. Measures of association, including confidence intervals and the P value, must be presented. The main limitation of this systematic review was the difficulty in ensuring that all the relevant literature was included. Even though the research used two of the main databases – Pubmed and Embase – there could be other relevant material in grey literature. The scarcity of the literature that was found was a limitation for this review. The one publication found, besides not directly answering our question, also does not take confounding factors into account, and does not describe the calculation to determine the sample size of the study. However, it does highlight the relevance of the subject matter. ## 5. CONCLUSIONS This “impact of MM on the duration of a consultation” has hardly been studied, this systematic review shows. A tendency for consultations of patients with MM to take longer than those without MM was found in the only one study with “satisfactory” quality which met the inclusion criteria. So more research is needed to acquire more information on this subject, important to deal not only with diseases but with the person suffering from MM for consultation must have the adequate length duration to enable doctors and stake-holders with a proper quantification of the time and associated costs. If a longer consultation time is confirmed, it will be important to rethink and adapt GPs’ lists of patients in order to achieve better medical care providing agendas with specific times and allocating enough time for all the required tasks. ## Data Availability All data will be available upon request ## 7. DECLARATIONS Ethics approval and consent to participate – Not applicable Consent for publication – Not applicable Availability of data and materials – Materials can be assessed upon recquest Financial and non-financial competing interests No author states financial and non-financial competing interests for this work. ## Authors’ contributions ACRT: Data extraction, data examination, treatment of data, writting of manuscript and its scientific ctiticism as well as aproval. IRCSC: Data extraction, data examination, treatment of data, writting of manuscript and its scientific ctiticism as well as aproval. Inês Jorge de Figueiredo: Sata examination, treatment of data, writting of manuscript and its scientific ctiticism as well as aproval. Luiz Miguel Santiago: Scientific review of the article. All authors read and approved the final manuscript. ### Acknowledgements Helena Donato, MD for her valuable contribution in the literature search. ## Group authorship Not aplicable ## 6. LIST OF ABBREVIATIONS MM : Multimorbidity GP : General Practitioner PRISMA : Preferred Reporting Items for Systematic Review and Meta-analyses HS : Health Service WHO : World Health Organization * Received September 20, 2019. * Revision received September 20, 2019. * Accepted September 23, 2019. * © 2019, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## 7. REFERENCES 1. 1.Le Reste JY, Nabbe P, Manceau B, Lygidakis C, Doerr C, Lingner H, et al. The European General Practice Research Network presents a comprehensive definition of multimorbidity in family medicine and long term care, following a systematic review of relevant literature. J Am Med Dir Assoc. 2013;14(5):319–25. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jamda.2013.01.001&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23411065&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 2. 2.Violan C, Foguet-Boreu Q, Flores-Mateo G, Salisbury C, Blom J, Freitag M, et al. Prevalence, determinants and patterns of multimorbidity in primary care: a systematic review of observational studies. PLoS One. 2014;9(7):e102149. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0102149&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25048354&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 3. 3.Glynn LG, Valderas JM, Healy P, Burke E, Newell J, Gillespie P, et al. The prevalence of multimorbidity in primary care and its effect on health care utilization and cost. Fam Pract. 2011;28(5):516–23. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/fampra/cmr013&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21436204&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000294968700007&link_type=ISI) 4. 4.Moffat K, Mercer SW. Challenges of managing people with multimorbidity in today’s healthcare systems. BMC Fam Pract. 2015;16:129. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12875-015-0344-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26462820&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 5. 5.Azais B, Bowis J, Wismar M. Facing the challenge of multimorbidity. J Comorb. 2016;6(1):1–3. 6. 6.Navickas R, Petric VK, Feigl AB, Seychell M. Multimorbidity: What do we know? What should we do? J Comorb. 2016;6(1):4–11. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 7. 7.United Nations, Department of Economic and Social Affairs, Population Division. World Population Prospects: The 2017 Revision, Key Findings and Advance Tables. 2017. p. 11. 8. 8.United Nations, Department of Economic and Social Affairs, Population Division. World Population Ageing 2015. 2015. p. 9. 9. 9.Prazeres F, Santiago L. The Knowledge, Awareness, and Practices of Portuguese General Practitioners Regarding Multimorbidity and its Management: Qualitative Perspectives from Open-Ended Questions. Int J Environ Res Public Health. 2016;13(11). 10. 10.World Health Organization. Innovative care for chronic conditions: building blocks for action. Global report. World Health Organization, 2002. 11. 11.Lo CK, Mertz D, Loeb M. Newcastle-Ottawa Scale: comparing reviewers’ to authors’ assessments. BMC Medical Research Methodology. 2014,14:45. 12. 12.Gunturi N, Gunturi N, Gennari A, Bartels K. Patient-centered Goals of Care: Using the Chronic Care Management (CCM) Code Towards Cooperative Goal Setting in the Multimorbid Elderly. Journal of the American Medical Directors Association. 2018;19(3). 13. 13.Johnson TL, Kaldor J, Falster MO, Sutherland K, Humphries J, Jorm LR, et al. Predictive risk modelling under different data access scenarios: who is identified as high risk and for how long? BMJ Open. 2018;8(2). 14. 14.Kangovi S, Carter T, Charles D, Smith RA, Glanz K, Long JA, et al. Toward A Scalable, Patient-Centered Community Health Worker Model: Adapting the IMPaCT Intervention for Use in the Outpatient Setting. Popul Health Manag. 2016;19(6):380–8. 15. 15.Mann EG, Johnson A, VanDenKerkhof EG. Frequency and characteristics of healthcare visits associated with chronic pain: results from a population-based Canadian study. Can J Anaesth. 2016;63(4):411–41. 16. 16.Palmer K, Onder G. Comprehensive geriatric assessment: Benefits and limitations. Eur J Intern Med. 2018;54:e8–e9. 17. 17.Rosbach M, Andersen JS. Patient-experienced burden of treatment in patients with multimorbidity - A systematic review of qualitative data. PLoS One. 2017;12(6):e0179916. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 18. 18.Salisbury C, Johnson L, Purdy S, Valderas JM, Montgomery AA. Epidemiology and impact of multimorbidity in primary care: a retrospective cohort study. Br J Gen Pract. 2011;61(582):e12–21. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMDoiNjEvNTgyL2UxMiI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzIzLzE5MDA3MzI4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 19. 19.Sampalli T, Desy M, Dhir M, Edwards L, Dickson R, Blackmore G. Improving wait times to care for individuals with multimorbidities and complex conditions using value stream mapping. Int J Health Policy Manag. 2015;4(7):459–66. 20. 20.Smith SM, Soubhi H, Fortin M, Hudon C, O’Dowd T. Managing patients with multimorbidity: systematic review of interventions in primary care and community settings. BMJ. 2012;345:e5205. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDUvc2VwMDNfMS9lNTIwNSI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzIzLzE5MDA3MzI4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 21. 21.Stokes T, Tumilty E, Doolan-Noble F, Gauld R. Multimorbidity, clinical decision making and health care delivery in New Zealand Primary care: a qualitative study. BMC Fam Pract. 2017;18(1):51. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12875-017-0622-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28381260&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 22. 22.Tetzlaff J, Junius-Walker U, Muschik D, Epping J, Eberhard S, Geyer S. Identifying time trends in multimorbidity—defining multimorbidity in times of changing diagnostic practices. Journal of Public Health. 2016;25(2):215–22. 23. 23.Tinetti ME, Naik AD, Dodson JA. Moving From Disease-Centered to Patient Goals-Directed Care for Patients With Multiple Chronic Conditions: Patient Value-Based Care. JAMA Cardiol. 2016;1(1):9–10. 24. 24.Wong ES, Rosland AM, Fihn SD, Nelson KM. Patient-Centered Medical Home Implementation in the Veterans Health Administration and Primary Care Use: Differences by Patient Comorbidity Burden. J Gen Intern Med. 2016;31(12):1467–74. 25. 25.European General Practice Research Network (EGPRN)Abstracts from the EGPRN meeting in Leipzig, Germany, 12-16 October 2016. Theme: ‘General practice/family medicine in a changing world’. Eur J Gen Pract. 2017;23(1):143–54. 26. 26.Abraham-Kaba A, Stopol C. Survivorship Continuum: Implications for Patient-Centered Programming. Journal of Psychosocial Oncology. 2016; 34(1-2):125–27. 27. 27.Annals of Long-Term Care: Clinical Care and Aging. 2016;24(4):17–20. 28. 28.Blomgreen J, Ekmann A, Nygaard H, Demény AK, Wejse MR, Pressel E. Geriatric assessment at the Acute Medical Unit: Improving the outcome. European Geriatric Medicine. 2017; 8(1): s153. 29. 29.Scheiner SR, Olson JM, Velner J. Collaborative drug therapy management in a skilled nursing facility to improve transitions of care in older adults. Pharmacotherapy. 2017; 37(12): e221–e222. 30. 30.Osborn R, Moulds D, Schneider EC, Doty MM, Squires D, Sarnak DO. Primary Care Physicians In Ten Countries Report Challenges Caring For Patients With Complex Health Needs. Health Affairs. 2015; 34(12): 2104–2112. 31. 31.Bower P.Better management of multimorbidity: a critical look at the ‘Ariadne principles’. BMC Medicine. 2014; 12:222. 32. 32.Cassil A. Innovations in preventing and managing chronic conditions: what’s working in the real world?. Issue brief. 2010; 132: 1–4. 33. 33.Porter I, Valderas JM. Development of a feedback form for routine clinical use of PROs in primary care for patients with multimorbidity. Quality of Life Research. 2015; 24(1): 181–182. 34. 34.Ehman KM, Deyo-Svendsen M, Merten Z, Kramlinger AM., Garrison G.M. How Preferences for Continuity and Access Differ Between Multimorbidity and Healthy Patients in a Team Care Setting. Journal of primary care & community health. 2017; 8(4): 319–323. 35. 35.Vasquez AH, Patel N, Tripathy C, Jaen C. Optimizing virtual care to improve access and quality of care. Journal of the American Geriatrics Society. 2018; 66 (2): 109. 36. 36.Fisher K, Griffith L, Gruneir A, Panjwani D, Gandhi S, Sheng LL, et al. Comorbidity and its relationship with health service use and cost in community-living older adults with diabetes: A population-based study in Ontario, Canada. Diabetes Res Clin Pract. 2016;122:113–23. 37. 37.Hien H, Ouedraogo M, Berthe A, Konate B, Toe N, Drabo MK, et al. [Patient complaints: an opportunity to improve the quality of care of older people with multimorbidity in Burkina Faso]. Pan Afr Med J. 2017;28:140. 38. 38.Junius-Walker U, Voigt I, Wrede J, Hummers-Pradier E, Lazic D, Dierks ML. Health and treatment priorities in patients with multimorbidity: report on a workshop from the European General Practice Network meeting ‘Research on multimorbidity in general practice’. Eur J Gen Pract. 2010;16(1):51–4. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20184490&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 39. 39.Kadam UT, Croft PR, North Staffordshire GPCG. Clinical multimorbidity and physical function in older adults: a record and health status linkage study in general practice. Fam Pract. 2007;24(5):412–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/fampra/cmm049&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17698977&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000251035700003&link_type=ISI) 40. 40.Strauss VY, Jones PW, Kadam UT, Jordan KP. Distinct trajectories of multimorbidity in primary care were identified using latent class growth analysis. J Clin Epidemiol. 2014;67(10):1163–71. 41. 41.van Dongen JJ, Lenzen SA, van Bokhoven MA, Daniels R, van der Weijden T, Beurskens A. Interprofessional collaboration regarding patients’ care plans in primary care: a focus group study into influential factors. BMC Fam Pract. 2016;17:58. 42. 42.Johnson TL, Kaldor J, Falster MO, Sutherland K, Humphries J, Jorm LR, et al. Predictive risk modelling under different data access scenarios: who is identified as high risk and for how long? BMJ Open. 2018;8(2). 43. 43.Lam CLK, Calvert MJ, Valderas JM, Wee HL, Gibbons C. Routine applications of patient reported outcomes (PROs) in primary care: Identifying and overcoming the challenges. Quality of Life Research.2016; 25(1): 9. 44. 44.Potter C, Hunter C, Kelly L, Gibbons E, Forder J, Coulter A, Fitzpatrick R, Peters M. PROs for personalized care: Patient perspectives on potential use of the long-term conditions questionnaire (LTCQ) in clinical practice. Quality of Life Research. 2016; 25(1): 196. 45. 45.Jowsey T, McRae IS, Valderas JM, Dugdale P, Phillips R, Bunton R, et al. Time’s up. descriptive epidemiology of multi-morbidity and time spent on health related activity by older Australians: a time use survey. PLoS One. 2013;8(4): e59379. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0059379&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23560046&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 46. 46.Deruaz-Luyet A, N’Goran AA, Tandjung R, Frey P, Zeller A, Haller DM, et al. Multimorbidity in primary care: protocol of a national cross-sectional study in Switzerland. BMJ Open. 2015;5(10):e009165. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiNS8xMC9lMDA5MTY1IjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDkvMjMvMTkwMDczMjguYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 47. 47.Oliver D. David Oliver: A manifesto for multimorbidity. BMJ. 2018;360:k1044. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNjAvbWFyMDZfNi9rMTA0NCI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzIzLzE5MDA3MzI4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 48. 48.Feather A. Managing patients with multimorbidity. Medicine. 2018;46(7):397–401. 49. 49.Kadam U. Redesigning the general practice consultation to improve care for patients with multimorbidity. BMJ. 2012;345:e6202. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDUvc2VwMTdfMS9lNjIwMiI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzIzLzE5MDA3MzI4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 50. 50.Wise J. Patients with multimorbidity need longer GP consultations, says RCGP. BMJ. 2016;355:i5961. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNTUvbm92MDZfMS9pNTk2MSI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzIzLzE5MDA3MzI4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 51. 51.Loeb DF, Bayliss EA, Candrian C, De Gruy FV, Binswanger IA. Treating complex patients in primary care: Physician offer a new view of competing demands. Journal of General Internal Medicine. 2013; 28(1): S224–S225. 52. 52.Bower P, Macdonald W, Harkness E, Gask L, Kendrick T, Valderas JM, et al. Multimorbidity, service organization and clinical decision making in primary care: a qualitative study. Fam Pract. 2011;28(5):579–87. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/fampra/cmr018&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21613378&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000294968700015&link_type=ISI) 53. 53.Irving G, Neves AL, Dambha-Miller H, Oishi A, Tagashira H, Verho A, et al. International variations in primary care physician consultation time: a systematic review of 67 countries. BMJ Open. 2017;7(10):e017902. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiNy8xMC9lMDE3OTAyIjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDkvMjMvMTkwMDczMjguYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 54. 54.O’Malley AS, Sarwar R, Keith R, Balke P, Ma S, McCall N. Provider Experiences with Chronic Care Management (CCM) Services and Fees: A Qualitative Research Study. J Gen Intern Med. 2017;32(12):1294–300. 55. 55.Klement A, Oemler M, Wienke A, Richter M, Wolfradt U. [(Expected) Consultation length, mental (co-)morbidity and patient satisfaction in the family practice encounter]. Z Evid Fortbild Qual Gesundhwes. 2015;109(8):560–9. 56. 56.Mühlhäuser U, Götz K, Weinmayr L-M, Steinhäuser J. DEGAM-guidelinen “multimorbidity” – a field test. Zeitschrift fur Allgemeinmedizin. 2018; 94(2): 64–69. 57. 57.Gruneir A, Dhalla IA, van Walraven C, Fischer HD, Camacho X, Rochon PA, et al. Unplanned readmissions after hospital discharge among patients identified as being at high risk for readmission using a validated predictive algorithm. Open Medicine. 2011; 5(2): E104–E111. 58. 58.Moth G, Vestergaard M, Vedsted P. Chronic care management in Danish general practice--a cross-sectional study of workload and multimorbidity. BMC Fam Pract. 2012;13:52. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1471-2296-13-52&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22676446&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 59. 59.Pringle M, Stewart-Evans C. Does awareness of being video recorded affect doctors’ consultation behaviour?. British Journal of General Practice. 1990;40:455–458. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMDoiNDAvMzQwLzQ1NSI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzIzLzE5MDA3MzI4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 60. 60.Holden JD. Hawthorne effects and research into professional practice. Journal of Evaluation in Clinical Practice. 2001;7:65–70. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1046/j.1365-2753.2001.00280.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11240840&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000167234800006&link_type=ISI) 61. 61.[https://ecamfic.wordpress.com/2018/10/21/documento-de-posicionamiento-sobre-el-hiperregistro-registritis-en-el-encuentro-clinico-profesional-paciente-en-la-atencion-primaria-ap/](https://ecamfic.wordpress.com/2018/10/21/documento-de-posicionamiento-sobre-el-hiperregistro-registritis-en-el-encuentro-clinico-profesional-paciente-en-la-atencion-primaria-ap/) [assessed the 11th September 2019] 62. 62.Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R, et al. Conversational agents in healthcare: a systematic review. Journal of the American Medical Informatics Association, 25(9), 2018, 1248–1258. doi: 10.1093/jamia/ocy072 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/jamia/ocy072&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30010941&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F23%2F19007328.atom) 63. 63.Veja PB, Losi S, Martinez LS, Bovell-Ammon A, Garg A, James T, et al. Implementing an EHR-based Screening and Referral System to Address Social Determinants of Health in Primary Care. Med Care 2019;57: S133–S139