Publications

Systematic reviews of ESMS/DESDE

 

Presentations

Virtual “workshop” on “Advances of healthcare ecosystem research for evidence-informed mental health planning” (presented at APIC2 – 2nd Asia Pacific Conference on Integrated Care Melbourne, 2019): ANU, University of Sydney, Loyola University Andalucia, ConNetica. 

 

Conceptual Frameworks and Models

  • Salvador-Carulla L, Lukersmith S, Sullivan W. From the EBM pyramid to the Greek temple: a new conceptual approach to Guidelines as implementation tools in mental health. Epidemiol Psychiatr Sci. 2017 Apr;26(2):105-114.
  • Furst MA, Gandré C, Romero López-Alberca C, Salvador-Carulla L. Healthcare ecosystems research in mental health: a scoping review of methods to describe the context of local care delivery. BMC Health Serv Res. 2019 Mar 18;19(1):173.
  • Almeda N, García-Alonso CR, Salinas-Pérez JA, Gutiérrez-Colosía MR, Salvador-Carulla L. Causal Modelling for Supporting Planning and Management of Mental Health Services and Systems: A Systematic Review. Int J Environ Res Public Health. 2019 Jan 25;16(3). pii: E332. doi: 10.3390/ijerph16030332. Review. PubMed PMID: 30691052.
  • Fernandez A, Sturmberg J, Lukersmith S, Madden R, Torkfar G, Colagiuri R, Salvador-Carulla L. Evidence-based medicine: is it a bridge too far? Health Res Policy Syst. 2015 Nov 6;13(1):66.
  • Salvador-Carulla L, Fernandez A, Madden R, Lukersmith S, Colagiuri R, Torkfar G, Sturmberg J. Framing of scientific knowledge as a new category of health care research. J Eval Clin Pract. 2014; 20(6):1045-55.
  • Salvador-Carulla L, Haro JM, Ayuso-Mateos JL. A framework for evidence-based mental health care and policy. Acta Psychiatr Scand Suppl. 2006;(432):5-11

 

ESMS/DESDE core studies

ESMS

  • Johnson S, Kuhlmann R, EPCAT Group. European Psychiatric Assessment Team. The European Service Mapping Schedule (ESMS): development of an instrument for the description and classification of mental health services. Acta Psychiatr Scand Suppl. 2000;405:14-23.
  • Salvador-Carulla L, Romero C, Martinez A, Haro JM, Bustillo G, Ferreira A, et al. Assessment instruments: standardization of the European Service Mapping Schedule (ESMS) in Spain. Acta Psychiatr Scand Suppl. 2000;405:24-32.

 

DESDE

  • Romero-López-Alberca C, Gutiérrez-Colosía MR, Salinas-Pérez JA, Almeda N, Furst M, Johnson S, Salvador-Carulla L. Standardised description of health and social care: A systematic review of use of the ESMS/DESDE (European Service Mapping Schedule/Description and Evaluation of Services and DirectoriEs). Eur Psychiatry. 2019 Sep;61:97-110. doi: 10.1016/j.eurpsy.2019.07.003.
  • Salvador-Carulla L, Alvarez-Galvez J, Romero C, Gutiérrez-Colosía MR, Weber G,  McDaid D, Dimitrov H, Sprah L, Kalseth B, Tibaldi G, Salinas-Perez JA, Lagares-Franco C, Romá-Ferri MT, Johnson S. Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study. BMC Health Serv Res. 2013: 15;13:218.
  • Salvador-Carulla L, Poole M, Gonzalez-Caballero JL, Romero C, Salinas JA, Lagares-Franco CM. Development and usefulness of an instrument for the standard description and comparison of services for disabilities (DESDE). Acta Psychiatr Scand Suppl. 2006;(432):19-28.

 

GLOSSARY OF TERMS

  • Montagni I, Salvador-Carulla L, Mcdaid D, Straßmayr C, Endel F, Näätänen P, Kalseth J, Kalseth B, Matosevic T, Donisi V, Chevreul K, Prigent A, Sfectu R, Pauna C, Gutiérrez-Colosia MR, Amaddeo F, Katschnig H. The REFINEMENT Glossary of Terms: An International Terminology for Mental Health Systems Assessment. Adm Policy Ment Health,  2018 Mar;45(2):342-351

 

REMAST

  • Salvador-Carulla L., Amaddeo F., Gutiérrez-Colosía MR., Salazzari D., González-Caballero JL., Montagni I., Tedeschi F., Cetrano G., Chevreul K., Kalseth J., Hagmair G., Straßmayr C. Park AL., Sfetcu R., Wahlbeck K.,  García-Alonso C., for the REFINEMENT Group. Developing a tool for mapping adult mental health care provision in Europe: the Remast Research Protocol and its contribution to better integrated care. International Journal of Integrated Care. 2015 Dec 1;15:e042.

 

ICHI

  • Castelpietra G, Salvador-Carulla L, Almborg AH, Fernandez A, Madden R, Working draft: classifications of interventions in mental health care. an expert review, Eur. J. Psychiat. 2017;31(4):127-144

 

Use of ESMS/DESDE mapping and atlases by World Region/Country

 

PACIFIC

Australia

  • Spijker BA van, Salinas-Perez JA, Mendoza J, Bell T, Bagheri N, Furst MA, Reynolds J, Rock D, Harvey A, Rosen A, Salvador-Carulla L. Service availability and capacity in rural mental health in Australia: Analysing gaps using an Integrated Mental Health Atlas. Aust N Z J Psychiatry. 2019 Oct;53(10):1000-1012. doi: 10.1177/0004867419857809
  • Furst MA, Salinas-Perez JA, Salvador-Carulla L. Organisational impact of theNational Disability Insurance Scheme transition on mental health care providers:the experience in the Australian Capital Territory. Australas Psychiatry. 2018 Dec;26(6):590-594.
  • Fernandez A, Smith-Merry J, Gillespie J, Feng X, Astell-Burt T, Maas C, Salvador-Carulla L. The Integrated Mental Health Atlas of Western Sydney Local Health District: Gaps and Recommendations. Aust Health Rev. 2017 Mar;41(1):38-44.

 

EUROPE

  • Gutiérrez-Colosía MR, Salvador-Carulla L, Salinas-Pérez JA, García-Alonso CR, Cid J, Salazzari D, Montagni I, Tedeschi F, Cetrano G, Chevreul K, Kalseth J, Hagmair G, Straßmay C, Park AL, Sfectu R, Ala-Nikkola T, González-Caballero JL, Rabbi L, Kalseth B, Amaddeo F; REFINEMENT Group. Standard comparison of local mental health care systems in eight European countries. Epidemiol Psychiatr Sci.  2019, Apr;28(2):210-223. doi: 10.1017/S2045796017000415
  • Cetrano G, Salvador-Carulla L, Tedeschi F, Rabbi L, Gutiérrez-Colosía MR, Gonzalez-Caballero JL, Park AL, McDaid D, Sfetcu R, Kalseth J, Kalseth B, Hope Ø, Brunn M, Chevreul K, Straßmayr C, Hagmair G, Wahlbeck K, Amaddeo F; REFINEMENT group. The balance of adult mental health care: provision of core health versus other types of care in eight European countries. Epidemiol Psychiatr Sci. 2018 Jan 25;16(3). pii: E332. doi: 10.3390/ijerph16030332.
  • Sadeniemi M, Almeda N, Salinas-Pérez JA, Gutiérrez-Colosía MR, García-Alonso C, Ala-Nikkola T, Joffe G, Pirkola S, Wahlbeck K, Cid J, Salvador-Carulla L. A Comparison of Mental Health Care Systems in Northern and Southern Europe: A Service Mapping Study. Int J Environ Res Public Health. 2018 May 31;15(6). pii: E1133. doi:10.3390/ijerph15061133

 

Spain

  • Fernandez A, Salinas-Perez JA, Gutierrez-Colosia MR, Prat-Pubill B, Serrano-Blanco A, Molina C, Jorda E, Garcia-Alonso CR, Salvador-Carulla L. Use of an integrated Atlas of Mental Health Care for evidence informed policy in Catalonia (Spain). Epidemiol Psychiatr Sci. 2015;24(6):512-24.
  • Sabes-Figuera R, Knapp M, Bendeck M, Mompart-Penina A, Salvador-Carulla L. The local burden of emotional disorders. An analysis based on a large health survey in Catalonia (Spain). Gac Sanit. 2012;26(1):24-9.
  • Salvador-Carulla L, Haro JM, Cabasés J, Madoz V, Sacristán JA, Vázquez-Barquero JL. Service utilization and costs of first-onset schizophrenia in two widely differing health service areas in North-East Spain. PSICOST Group. Acta Psychiatr Scand. 1999;100(5):335-343.

 

Italy

  • Tibaldi G, Munizza C, Pasian S, Johnson S, Salvador-Carulla L, Zucchi S, et al. Indicators predicting use of mental health services in Piedmont, Italy. J Ment Health Policy Econ. 2005, 8(2):95-106.
  • Salvador-Carulla L, Tibaldi G, Johnson S, Scala E, Romero C, Munizza C. Patterns of mental health service utilisation in Italy and Spain--an investigation using the European Service Mapping Schedule. Soc Psychiatry Psychiatr Epidemiol. 2005;40(2):149-159.

 

AMERICA

Chile

  1. Salinas-Perez JA, Salvador-Carulla L, Saldivia S, Grandon P, Minoletti A, Romero Lopez-Alberca C. Integrated mapping of local mental health systems in Central Chile. Rev Panam Salud Publica. 2018;42:e144. https://doi.org/10.26633/RPSP.2018.144

 

Techniques

SPATIAL ANALYTICS

  • Bagheri N, Batterham PJ, Salvador-Carulla L, Chen Y, Page A, Calear AL, Congdon P. Development of the Australian neighborhood social fragmentation index and its association with spatial variation in depression across communities. Soc Psychiatry Psychiatr Epidemiol. 2019 Apr 15. doi: 10.1007/s00127-019-01712-y.[Epub ahead of print]
  • Rodero-Cosano ML, Salinas-Pérez JA, González-Caballero JL, García-Alonso CR, Lagares-Franco C, Salvador-Carulla L. A multi-level analysis of the relationship  between spatial clusters of outpatient-treated depression, risk factors and mental health service planning in Catalonia (Spain). J Affect Disord. 2016;201:42-49.
  • Salinas-Perez JA, Rodero-Cosano ML, Garcia-Alonso CR, Salvador-Carulla L. Applying an Evolutionary Algorithm for the Analysis of Mental Disorders in Macro-urban Areas: The Case of Barcelona. Spatial Economic Analysis, 2015; 10:3, 270-288
  • García-Alonso CR, Salvador-Carulla L, Negrín-Hernández MA, Moreno-Küstner B. Development of a new spatial analysis tool in mental health: identification of highly autocorrelated areas (hot-spots) of schizophrenia using a Multiobjective Evolutionary Algorithm model (MOEA/HS). Epidemiol Psichiatr Soc. 2010;19(4):302-313.
  • Salvador-Carulla L, García-Alonso C, Gonzalez-Caballero JL, Garrido-Cumbrera M. Use of an operational model of community care to assess technical efficiency and benchmarking of small mental health areas in Spain. J Ment Health Policy Econ. 2007;10(2):87-100.

 

MODELLING

  • García-Alonso CR, Almeda N, Salinas-Pérez JA, Gutiérrez-Colosía MR, Salvador-Carulla L. Relative Technical Efficiency Assessment of Mental Health  Services: A Systematic Review. Adm Policy Ment Health. 2019 Jul;46(4):429-444. doi: 10.1007/s10488-019-00921-6.
  • García-Alonso CR, Almeda N, Salinas-Pérez JA, Gutiérrez-Colosía MR, Uriarte-Uriarte JJ, Salvador-Carulla L. A decision support system for assessing management interventions in a mental health ecosystem: The case of Bizkaia (Basque Country, Spain). PLoS One. 2019 Feb 14;14(2):e0212179. doi:10.1371/journal.pone.0212179.
  • Chung Y; Salvador-Carulla L; Salinas-Pérez JA; Uriarte-Uriarte JJ; Iruin-Sanz A; García-Alonso CR. Use of the Self-Organising Map Network (SOMNet) as a Decision Support System for Regional Mental Health Planning. Health Research Policy and Systems, 2018 Apr 25;16(1):35
  • Almeda N, García-Alonso CR, Salinas-Pérez JA, Gutiérrez-Colosía MR, Salvador-Carulla L. Causal Modelling for Supporting Planning and Management of Mental Health Services and Systems: A Systematic Review. Int J Environ Res Public Health. 2019 Jan 25;16(3). pii: E332. doi: 10.3390/ijerph16030332. Review. PubMed PMID: 30691052.
  • Torres-Jiménez M, García-Alonso CR, Salvador-Carulla L, Fernández-Rodríguez V. Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areas.  European Journal of Operational Research, 2015; 242 (2): 525-535

 

OTHER RELATED INSTRUMENTS AND CLASSIFICATIONS

  • Castelpietra G, Salvador-Carulla L, Almborg AH, Fernandez A, Madden R, Working draft: classifications of interventions in mental health care. an expert review, Eur. J. Psychiat. 2017;31(4):127-144

 

Health Economics

  • Moreno K, Sanchez E, Salvador-Carulla L. Methodological advances in unit cost calculation of psychiatric residential care in Spain. J Ment Health Policy Econ. 2008;11(2):79-88.
  • Vázquez-Polo F-J, Negrín M, Cabasés JM, Sánchez E, Haro JM, Salvador-Carulla L. An analysis of the costs of treating schizophrenia in Spain: a hierarchical Bayesian approach. J Ment Health Policy Econ. 2005;8(3):153-165.

 

Topics

RURAL MENTAL HEALTH

  • Perkins D, Farmer J, Salvador-Carulla L, Dalton H, Luscombe G. The Orange Declaration on rural and remote mental health. Aust J Rural Health. 2019 Sep 12. doi: 10.1111/ajr.12560. [Epub ahead of print] PubMed PMID: 31515882.

 

BRAIN INJURY

  • Lukersmith S, Fernandez A, Millington M, Salvador-Carulla L. The brain injury  case management taxonomy (BICM-T); a classification of community-based case management interventions for a common language. Disabil Health J. 2016; 9(2):272-80.

 

FINANCING AND ACCOUNTABILITY

  • Rosenberg S, Salvador-Carulla L. Perspectives:Accountability for Mental Health:The Australian Experience. J Ment Health Policy Econ. 2017; 20(1), 37-54.
  • Rosenberg SP, Hickie IB, McGorry PD, Salvador-Carulla L, Burns J, Christensen H, Mendoza J, Rosen A, Russell LM, Sinclair S. Using accountability for mental health to drive reform. Med J Aust. 2015 Oct 19;203(8):328-30.

 

OTHER STUDIES USING ESMS/DESDE

[1] World Health Organization. WHO-EURO: European Health Report 2018: more than numbers. Evidence for all. WHO EURO Copenhaguen; 2018. http:// www.euro.who.int/__data/assets/pdf_file/0008/379862/who-ehr-2018-eng. pdf?ua=1. [2] Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence informed health Policymaking (STP) 1: what is evidence-informed policymaking? Health Res Policy Syst 2009;7(Suppl 1). [3] Bate P, Robert G, Fulop N, Øvretviet J, Dixon-Woods M. Perspectives on context: a collection of essays considering the role of context in successful quality improvement. Health Foundation; 2014. [4] Shogren KA, Luckasson R, Schalock RL. Using context as an integrative framework to align policy goals, supports, and outcomes in intellectual disability. Intellect Dev Disabil 2015;53(5):367–76. [5] Raine R, Fitzpatrick R, Barratt H, Bevan G, Black N, Boaden R, et al. Challenges, solutions and future directions in the evaluation of service innovations in health care and public health. Health Serv Deliv Res 2016;4(16). https:// www.journalslibrary.nihr.ac.uk/hsdr/hsdr04160/. [6] Salvador-Carulla* L, Amaddeo F, Gutiérrez-Colosía M, Salazzari D, Gonzalez- Caballero JL, et al. Developing a tool for mapping adult mental health care provision in Europe: the REMAST research protocol and its contribution to better integrated care. Int J Integr Care 2015;15(4). [7] García-Alonso C, Almeda N, Salinas-Pérez JA, Gutiérrez-Colosía MR, Salvador- Carulla L. Causal modelling for supporting planning and management of mental health services and systems: a systematic review. Int J Environ Res Public Health 2019;16(332):1–27, doi:http://dx.doi.org/10.3390/ ijerph16030332. [8] Lee BY, Wong KF, Bartsch SM, Yilmaz SL, Avery TR, Brown ST, et al. The Regional Healthcare Ecosystem Analyst (RHEA): a simulation modeling tool to assist infectious disease control in a health system. J Am Med Inform Assoc 2013;20(e1):e139–46. https://academic.oup.com/jamia/article-lookup/doi/ 10.1136/amiajnl-2012-001107. [9] Chung* Y, Salvador-Carulla L, Salinas-Pérez JA, Uriarte-Uriarte JJ, Iruin-Sanz A, et al. Use of the self-organising map network (SOMNet) as a decision support system for regional mental health planning. Health Res Policy Syst 2018;16 (1):35, doi:http://dx.doi.org/10.1186/s12961-018-0308-y. [10] Laihonen H. Knowledge structures of a health ecosystem. J Health Organ Manag 2012;26(4):542–58, doi:http://dx.doi.org/10.1108/ 14777261211251571. [11] World Health Organization. Improving health systems and services for mental health. Geneva: World Health Organization; 2009. [12] World Health Organization. The European mental health action plan 2013– 2020. Copenhagen: World Health Organization; 2015. [13] World Health Organization. mhGAP: mental Health Gap Action Programme: scaling up care for mental, neurological and substance use disorders. Geneva: World Health Organization; 2008. http://www.ncbi.nlm.nih.gov/books/ NBK310851/. [14] Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for reporting implementation studies (StaRI) statement. Br Med J 2017;356:i6795, doi:http://dx.doi.org/10.1136/bmj.i6795. [15] Rycroft-Malone J, Burton CR. Is it time for standards for reporting on research about implementation? Worldviews Evid Based Nurs 2011;8(4):189–90. [16] Johnson* S, Kuhlmann R, EPCAT group. The European Service Mapping schedule (ESMS): development of an instrumentfor the description and classificationof mental health services. Acta Psychiatr Scand 2000;102:14– 23. [17] Munizza* C, Tibaldi G, Cesano S, Dazzi R, Fantini G, et al. Mental health care in Piedmont: a description of its structure and components using a new technology for service assessment. Acta Psychiatr Scand 2000;102:47–58, doi:http://dx.doi.org/10.1111/j.0902-4441.2000.acp28-06.x. [18] De Jong A. Development of the international classification of mental health care (ICMHC). Acta Psychiatr Scand 2000;102:8-–13, doi:http://dx.doi.org/ 10.1111/j.0902-4441.2000.acp28–04.x. [19] Beecham J, Johnson S, EPCAT Group. The European Socio-Demographic Schedule (ESDS): rationale, principles and development. Acta Psychiatr Scand 2000;102:33–46, doi:http://dx.doi.org/10.1111/j.0902-4441.2000.t01- 1-acp28-02.x. [20] Salvador-Carulla* L, Poole M, Gonzalez-Caballero JL, Romero C, Salinas JA, et al. Development and usefulness of an instrument for the standard description and comparison of services for disabilities (DESDE). Acta Psychiatr Scand 2006;114(Suppl. 432), doi:http://dx.doi.org/10.1111/j.1600- 0447.2006.00916.x. [21] Salvador Carulla L. Descripción estandarizada de los servicios de discapacidad para ancianos en España]. Madrid, IMSERSO. Estudios I+D+I, no 2003;24: [Fecha de publicación: 12/07/2005]. [22] Salvador-Carulla* L, Alvarez-Gálvez J, Romero C, Gutiérrez-Colosía MR, Weber G, et al. Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study. BMC Health Serv Res 2013;13(1):218, doi:http://dx.doi. org/10.1186/1472-6963-13-218. [23] Almenara Abellán JL, Gutiérrez-Colosía FAlonso MR, Salinas Pérez JA, Arlette MFRaposo S, García Alonso C, Salvador-Carulla L. Adaptación del sistema de clasificación internacional DESDE-LTC para la evaluación de servicios sociosanitarios y Atención Primaria de salud. Software de ayuda a la codificación eDESDE-AND. Semer - Med Fam 2015;41:, doi:http://dx.doi.org/ 10.13140/RG.2.1.2752.7121. [24] Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004;82(4):581–629. [25] Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009;151(4):264–9. [26] Salvador-Carulla L, Dimitrov H, Weber G, McDaid D, Venner B, Sprah L, et al. For DESDE-LTC group (Eds.). DESDE-LTC: evaluation and classification of services for long term care in Europe. Spain: Psicost and Catalunya Caixa; 2011. [27] Salvador L, Atienza C, Romero C, the PSICOST/EPCAT Group. Use of the EPCAT model of care for standard description of psychiatric services: the experience in Spain. In: Guimón J, Sartorius N, editors. Manage or perish? The challenges of managed mental health care in Europe. New York: Kluwer Academic/ Plenum Publishers; 1999. p. 359–68. [28] Votruba N, Ziemann A, Grant J, Thornicroft G. A systematic review of frameworks for the interrelationships of mental health evidence and policy in low-and middle-income countries. Health Res Policy Syst 2018;16(1):85. [29] Salvador Carulla* L, Torres Gonzalez F, Johnson S, Kuhlman R, Varquez- Barquero JL, et al. The Spanish version of the European Service Mapping schedule (European diagram of services). Archivos de Neurobiología 1997;60:163–70. 108 C. Romero-López-Alberca et al. / European Psychiatry 61 (2019) 97–110[30] Salvador-Carulla* L, Haro JM, Cabases J, Madoz V, Sacristan JA, et al. Service utilization and costs of first-onset schizophrenia in two widely differing health service areas in North-East Spain. PSICOST Group. Acta Psychiatr Scand 1999;100(5)335–43. . Retrieved from http://www.ncbi.nlm.nih.gov/ pubmed/10563450. [31] Haro* JM, Salvador-Carulla L, Cabasés J, Madoz V, Vázquez-Barquero JL. Utilisation of mental health services and costs of patients with schizophrenia in three areas of Spain. Br J Psychiatry 1998;173(October):334–40, doi:http:// dx.doi.org/10.1192/bjp.173.4.334. [32] Prot-Klinger* K, Pawłowska M. The effectiveness of community care for people with severe mental disorders. Arch Psychiatry Psychother 2009;4:43– 50. . Retrieved from http://ww.w.archivespp.pl/uploads/images/2009_11_4/ 43_APP_4_2009.pdf. [33] Ala-Nikkola* T, Pirkola S, Kontio R, Joffe G, Pankakoski M, et al. Size matters — determinants of modern, community-oriented mental health services. Int J Environ Res Public Health 2014;11(12):8456–74, doi:http://dx.doi.org/ 10.3390/ijerph110808456. [34] Salize* HJ, McCabe R, Bullenkamp J, Hansson L, Lauber C, et al. Cost of treatment of schizophrenia in six European countries. Schizophr Res 2009;111(1-3):70–7. https://qmro.qmul.ac.uk/xmlui/bitstream/handle/ 123456789/319/PRIEBECostOf2009POSTP.pdf?sequence=2. [35] Lund* C, Flisher AJ. A model for community mental health services in South Africa. Trop Med Int Health 2009;14(9):1040–7, doi:http://dx.doi.org/ 10.1111/j.1365-3156.2009.02332.x. [36] Tuomainen* H, Schulze U, Warwick J, Paul M, Dieleman GC, et al. Managing the link and strengthening transition from child to adult mental health Care in Europe (MILESTONE): Background, rationale and methodology. BMC Psychiatry 2018;18(1):1–11, doi:http://dx.doi.org/10.1186/s12888-018-1758- z. [37] Montagni* I, Salvador-Carulla L, Mcdaid D, Straßmayr C, Endel F, et al. The REFINEMENT glossary of terms: an international terminology for mental health systems assessment. Adm Policy Ment Health Ment Health Serv Res 2018;45(2):342–51, doi:http://dx.doi.org/10.1007/s10488-017-0826-x. [38] World Health Organization. World Health Organization assessment instrument for mental health systems-WHO-AIMS version 2.2 (No. WHO/ MSD/MER/05.02). Geneva: World Health Organization; 2005. [39] Baková* N, Raboch J, Stárková L. ESMS (the European Service Mapping schedule). Psychiatrie v medicin_e a medicina v psychiatrii. Praha Galén 2002;25:. [40] Adamowski* T, Trypka E. European Service Mapping schedule"(ESMS)– instrument used to describe the structure of mental health care. Psychiatr Pol 2002;36(6 Suppl):369–76. [41] Salvador-Carulla* L, Romero C, Martinez A, et al. Assessment instruments: standardization of the european service mapping schedule (ESMS) in Spain. Acta Psychiatr Scand 2000;102:24–32. https://www.researchgate.net/ profile/Cristina_Romero3/publication/285754449_Assessment_ instruments_standardization_of_the_European_Service_Mapping_ Schedule_ESMS_in_Spain/links/5669510e08ae8d6928fcfccb.pdf. [42] Salvador-Carulla* L, Romero C, Weber G, Dimitrov H, Sprah L, et al. Classification, assessment and comparison of European LTC services. Ageing And Long-Term Care 2011;17(2-3):27. [43] Becker* T, Hülsmann S, Knudsen HC, Martiny K, Amaddeo F, et al. Provision of services for people with schizophrenia in five European regions. Soc Psychiatry Psychiatr Epidemiol 2002;37(10):465–74, doi:http://dx.doi.org/ 10.1007/s00127-002-0591-2. [44] Böcker* FM, Jeschke F, Brieger P. Psychiatrische versorgung in Sachsen- Anhalt: Einrichtungen und dienste im überblick: Eine erhebung mit dem “European Services Mapping Schedule”. ESMS. Psychiatrische Praxis 2001;28 (8):393–401, doi:http://dx.doi.org/10.1055/s-2001-18616. [45] Dernovšek* MZ. A preliminary report on the implementation of the European Service and Mapping schedule (ESMS) in Slovenia to map preventive and promotion. Psychiatr Danub 2008;20(2):141–7. [46] Skiba* J, Prot K. The usefulness of the ESMS instrument for the assessment of community care. [Polish]. Postepy Psychiatrii I Neurologii 2008;17(4)319–25. . Retrieved from http://lshtmsfx.hosted.exlibrisgroup.com/lshtm?sid=OVID: embase&id=pmid:&id=doi:&issn=1230- 2813&isbn=&volume=17&issue=4&spage=319&pages=319- 325&date=2008&title=Postepy-. [47] Salvador-Carulla* L, García-Alonso C, Gonzalez-Caballero JL, Garrido- Cumbrera M. Use of an operational model of community care to assess technical efficiency and benchmarking of small mental health areas in Spain. J Ment Health Policy Econ 2007;10(2):87–100. [48] Fernandez* A, Gillespie JA, Smith-Merry J, Feng X, Astell-Burt T, et al. Integrated mental health atlas of the Western Sydney Local Health District: Gaps and recommendations. Aust Health Rev 2017;41(1):38–44, doi:http:// dx.doi.org/10.1071/AH15154. [49] Beperet* M, Nadal S, Martínez A, Salvador L, Romero C, et al. The European diagram of mental health services and its application in sector IB (Burlada). An Sist Sanit Navar 2000;23(1)63–72. . Retrieved from https://recyt.fecyt.es/ index.php/ASSN/article/viewFile/6415/5121. [50] McCrone* P, Leese M, Thornicroft G, Griffiths G, Padfield S, et al. Reliability of the camberwell assessment of need - european version : EPSILON study 6 service reliability of the camberwell assessment of need ^. European Version EPSILON Study 2000;6:, doi:http://dx.doi.org/10.1192/bjp.177.39.s34. [51] Chisholm* D, Amir M, Fleck M, Herrman H, Lomachenkov A, et al. Longitudinal Investigation of Depression Outcomes (the LIDO Study) in primary care in six countries: comparative assessment of local health systems and resource utilization. Int J Methods Psychiatr Res 2001;10(2):59– 71, doi:http://dx.doi.org/10.1002/mpr.101. [52] McCrone* P, Leese M, Thornicroft G, Schene A, Knudsen HC, et al. A comparison of needs of patients with schizophrenia in five European countries: the EPSILON Study. Acta Psychiatr Scand 2001;103(5):370–9, doi: http://dx.doi.org/10.1034/j.1600-0447.2001.00207.x. [53] Knapp* M, Chisholm D, Leese M, Amaddeo F, Tansella M, et al. Comparing patterns and costs of schizophrenia care in five European countries: the EPSILON study. Acta Psychiatr Scand 2002;105(1):42–54, doi:http://dx.doi. org/10.1034/j.1600-0447.2002._10310.x. [54] Trypka* E, Adamowski T, Kiejna A. Presentation of the cost-effectiveness technique questionnaire–the possibility of the Polish adaptation. Psychiatr Pol 2002;36(6 Suppl):389–96. [55] Brieger* P, Wetzig F, Böcker FM. Institutions and services of psychiatric care in Saxony-Anhalt: assessment with the European Services Mapping schedule. Eur Psychiatry 2003;18(3):145–7, doi:http://dx.doi.org/10.1016/S0924-9338 (03)00034-8. [56] Mastrogianni* A, Georgiadou E, Iosifidis I, Kotrotsios S, Karastergiou A. The Eunomia-Study: european evaluation of coercion in psychiatry and harmonisation of best clinical practice. Hellenic Psychiatry 2004;3(1):37–43. [57] Bebbington* PE, Angermeyer MC, Azorin J, Brugha T, Kilian R, et al. The European Schizophrenia Cohort (EuroSC): a naturalistic prognostic and economic study. Soc Psychiatry Psychiatr Epidemiol 2005;40(9):707–17, doi: http://dx.doi.org/10.1007/s00127-005-0955-5. [58] Kallert* TW, Glöckner M, Onchev G, Raboch J, Karastergiou A, et al. The EUNOMIA project on coercion inpsychiatry: study design andpreliminary data. World Psychiatry 2005;4(3):168. http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC1414770/%5Cnhttp://www.ncbi.nlm.nih.gov/pubmed/16633543. [59] Salvador-Carulla* L, Tibaldi G, Johnson S, Scala E, Romero C, et al. Patterns of mental health service utilisation in Italy and Spain. Soc Psychiatry Psychiatr Epidemiol 2005;40(2):149–59, doi:http://dx.doi.org/10.1007/s00127-005- 0860-y. [60] Tibaldi* G, Munizza C, Pasian S, Johnson S, Salvador-Carulla L, et al. Indicators predicting use of mental health services in Piedmont, Italy. J Ment Health Policy Econ 2005;8(2):95–106. [61] Roick* C, Heider D, Toumi M, Angermeyer MC. The impact of caregivers’ characteristics, patients’ conditions and regional differences on family burden in schizophrenia: a longitudinal analysis. Acta Psychiatr Scand 2006;114(5):363–74. [62] Marwaha* S, Johnson S, Be bbington P, Stafford M, Angermeyer MC, et al. Rates and correlates of employment in people with schizophrenia in the UK, France and Germany. Br J Psychiatry 2007;191(JULY):30–7, doi:http://dx.doi. org/10.1192/bjp.bp.105.020982. [63] Moreno* K. Adaptation of activity-based-costing (ABC) to calculate unit costs in Mental Health Care in Spain. Eur J Psychiat 2007;21(2)117–23. . Retrieved from http://scielo.isciii.es/pdf/ejpen/v21n2/original3.pdf. [64] Rezvyy* G, Oiesvold T, Parniakov A, Ponomarev O, Lazurko O, et al. The Barents Project In Psychiatry: A Systematic Comparative Mental Health Services Study Between Northern. Norway and Archangelsk County; 2007, doi:http://dx.doi.org/10.1007/s00127-006-0141-4. [65] Dernovšek* MS, Šprah L. Assessment of mental health services in Slovenia with the European Service Mapping schedule. Psychiatr Danub 2008;2 (3):439–42. [66] Eichler* T, Schuzwohl M, Priebe S, Wright D, Adamowski T, et al. Loss to follow-up in longitudinal psychiatric research. Epidemiologia E Psichiatria Sociale-an International Journal for Epidemiology and Psychiatric Sciences 2008;17(2):138–47, doi:http://dx.doi.org/10.1017/S1121189X00002839. [67] Moreno* B, García-Alonso CR, Negrín-Hernández MA, Torres-González F, Salvador-Carulla L. Spatial analysis to identify hotspots of prevalence of schizophrenia. Soc Psychiatry Psychiatr Epidemiol 2008;43(10):782–91, doi: http://dx.doi.org/10.1007/s00127-008-0368-3. [68] Moreno* K, Sanchez E, Salvador-Carulla L. Methodological advances in unit cost calculation of psychiatric residential care in Spain. J Ment Health Policy Econ 2008;11(2):79–88. [69] Salvador-Carulla* L, Saldivia S, Martinez-Leal R, Vicente B, Garcia-Alonso C, et al. Meso-level comparison of mental health service availability and use in Chile and Spain. Psychiatr Serv 2008;59(4):421–8, doi:http://dx.doi.org/ 10.1176/ps.2008.59.4.421. [70] Marwaha* S, Johnson S, Bebbington PE, Angermeyer MC, Brugha TS, et al. Predictors of employment status change over 2 years in people with schizophrenia living in Europe. Epidemiol Psychiatr Sci 2009;18(4):344–51, doi:http://dx.doi.org/10.1017/S1121189X00000324. [71] Pirkola* S, Sund R, Sailas E, Wahlbeck K. Community mental-health services and suicide rate in Finland: a nationwide small-area analysis. Lancet 2009;373(9658):147–53, doi:http://dx.doi.org/10.1016/S0140. [72] Gibert* K, García-Alonso C, Salvador-Carulla L. Integrating clinicians, knowledge and data: expert-based cooperative analysis in healthcare decision support. Health Res Policy Syst 2010;8:1–16, doi:http://dx.doi.org/ 10.1186/1478-4505-8-28. [73] Raboch* J, Kalisova L, Nawka A, Kitzlerova E, Onchev G, et al. Use of coercive measures during involuntary hospitalization: findings from ten european countries. Psychiatr Serv 2010;61(10):1012–7, doi:http://dx.doi.org/10.1176/ appi.ps.61.10.1012. C. Romero-López-Alberca et al. / European Psychiatry 61 (2019) 97–110 109[74] Jordanova* V, Maric NP, Alikaj V, Bajs M, Cavic T, et al. Prescribing practices in psychiatric hospitals in Eastern Europe. Eur Psychiatry 2011;26(7):414–8, doi:http://dx.doi.org/10.1016/j.eurpsy.2010.05.005. [75] Prot* K, Anczewska M, Induslka A, Raduj J, Palyska M. Satysfakcja pacjentów i rodzin z opieki _srodowiskowej – badanie pilota_zowe [Patients and families’ satisfaction from services provided in community care – pilot study]. Psychiatr Pol 2011;6:799–809 Retrieved from https://www.researchgate.net/ profile/Katarzyna_Prot-Klinger/publication/221833115_Patients’_ and_families’_satisfaction_from_services_provided_in_community_care_- _Pilot_study/links/5757184508ae05c1ec16ce84.pdf. [76] Kallert* TW, Howardová A, Raboch J, Priebe S, Kiejna A, et al. To what extent could acute general psychiatric day care reduce inpatient admissions? J Hosp Adm 2013;2(2), doi:http://dx.doi.org/10.5430/jha.v2n2p105. [77] Petersen* KL, Nicholls TL, Groden D, Schmitz N, Stip E, et al. Redevelopment of tertiary psychiatric services in British Columbia: a prospective study of clinical, social, and residential outcomes of former long-stay inpatients. Schizophr Res 2013;149(1-3):96–103, doi:http://dx.doi.org/10.1016/j. schres.2013.05.022. [78] Salvador-Carulla* L, Martinez-Leal R, Poole M, Salinas-Perez JA, Tamarit J, et al. Perspectives: the mental health care gap in intellectual disabilities in Spain: impact analysis and knowledge-to-action plan. J Ment Health Policy Econ 2013;16(3):131–41. [79] Ungewitter*C,BöttgerD,El-JurdiJ,KilianR,LosertC,etal.A.Bramesfeld.Struktur und Kooperation in der Versorgung psychisch Kranker. Nervenarzt Online 2013;84(5):307–14, doi:http://dx.doi.org/10.1007/s00115-011-3433-1. [80] Kalisova* L, Raboch J, Nawka A, Sampogna G, Cihal L, et al. Do patient and ward-related characteristics influence the use of coercive measures? Results from the EUNOMIA international study. Soc Psychiatry Psychiatr Epidemiol 2014;49(10):1619–29, doi:http://dx.doi.org/10.1007/s00127-014-0872-6. [81] Fernández* A, Salinas-Perez JA, Gutiérrez-Colosía MR, Prat-Pubill B, Serrano- Blanco A, et al. Use of an integrated Atlas of Mental Health Care for evidence informed policy in Catalonia (Spain). Epidemiol Psychiatr Sci 2015;24 (6):512–24, doi:http://dx.doi.org/10.1017/S2045796014000511. [82] Iruin-Sanz* A, Pereira-Rodríguez C, Nuño-Solinís R. The role of geographic context on mental health: lessons from the implementation of mental health atlases in the Basque Country (Spain). Epidemiol Psychiatr Sci 2015;24 (1):42–4, doi:http://dx.doi.org/10.1017/S2045796014000596. [83] Torres-Jiménez* M, García-Alonso CR, Salvador-Carulla L, Fernández- Rodríguez V. Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areas. Eur J Oper Res 2015;242(2):525–35. [84] Ala-Nikkola* T, Pirkola S, Kaila M, Saarni S, Joffe G, et al. Regional correlates of psychiatric inpatient treatment. Int J Environ Res Public Health 2016;13 (12):1204, doi:http://dx.doi.org/10.3390/ijerph13121204. [85] Ala-Nikkola* T, Sadeniemi M, Kaila M, Saarni S, Kontio R, et al. How size matters: exploring the association between quality of mental health services and catchment area size. BMC Psychiatry 2016;16:289, doi:http://dx.doi.org/ 10.1186/s12888-016-0992-5. [86] Rodero-Cosano* ML, Salinas-Pérez JA, González-Caballero JL, García-Alonso CR, Lagares-Franco C, et al. A multi-level analysis of the relationship between spatial clusters of outpatient-treated depression, risk factors and mental health service planning in Catalonia (Spain). J Affect Disord 2016;201:42–9. [87] Almeda* N, García-Alonso CR, Salinas-Pérez JA, Gutiérrez-Colosía MR, Salvador-Carulla L. Assessment of relative technical efficiency of small mental health areas in Bizkaia (Basque Country, Spain). In ICORES. . p. 377– 84, doi:http://dx.doi.org/10.5220/0006195603770384. [88] Dahl* HM, Rezvyy G, Bogdanov A, Øiesvold T. Outpatient clinics treating substance use disorders in Northwest Russia and Northern Norway: a descriptive comparative study. Int J Circumpolar Health 2017;76(1):1411733, doi:http://dx.doi.org/10.1080/22423982.2017.1411733. [89] Gutiérrez-Colosía* MR, Salvador-Carulla L, Salinas-Pérez JA, García-Alonso CR, Cid J, et al. Standard comparison of local mental health care systems in eight European countries. Epidemiol Psychiatr Sci 2017;1–14, doi:http://dx. doi.org/10.1017/S2045796017000415. [90] Ala-Nikkola* T, Pirkola S, Kaila M, Joffe G, Kontio R, et al. Identifying Local and Centralized Mental Health Services—The Development of a New Categorizing Variable. Int J Environ Res Public Health 2018;15(6):1131, doi:http://dx.doi. org/10.3390/ijerph15061131. [91] Sadeniemi* M, Almeda N, Salinas-Pérez JA, Gutiérrez-Colosía MR, García- Alonso C, et al. A comparison of mental health care systems in northern and Southern Europe: a service mapping study. Int J Environ Res Public Health 2018;15(6). [92] Cetrano* G, Salvador-Carulla L, Tedeschi F, Rabbi L, Gutiérrez-Colosía MR, et al. The balance of adult mental health care: provision of core health versus other types of care in eight European countries. Epidemiol Psychiatr Sci 2018;1–10, doi:http://dx.doi.org/10.1017/S2045796018000574. [93] Furst* MA, Salinas-Perez JA, Salvador-Carulla L. Organisational impact of the National Disability Insurance Scheme transition on mental health care providers: the experience in the Australian Capital Territory. Australas Psychiatry 2018;26(6):590–4, doi:http://dx.doi.org/10.1177/ 1039856218810151. [94] Salinas-Perez* JA, Salvador-Carulla L, Saldivia S, Grandon P, Minoletti A, et al. Integrated mapping of local mental health systems in Central Chile. Rev Panam Salud Pãoblica 2018;42:e144. [95] Romero C, Salinas JA, Saldivia S, Grandón P, Poole M, Salvador-Carulla L, et al. Comparative study of mental health ser:vices availability and use in Chile and Spain. Int J Integr Care 2009;9(June (Suppl)):e62. [96] Organization for economic Co-operation and development (OECD), world health organization (WHO) and EUROSTAT (European commission). Pre-edited version: a system of health accounts version 2.0. Paris: OECD. WHO and EUROSTAT; 2011. http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/ KS-30-11-270/EN/KS-30-11-270-EN.PDF. [97] World Health Organization. Mental health atlas 2011-Department of mental health and substance abuse. World Health Organization; 2011. [98] Bhugra D, Tasman A, Pathare S, Priebe S, Smith S, Torous J, et al. The WPA- lancet psychiatry commission on the future of psychiatry. Lancet Psychiatry 2017;4(10):775–818, doi:http://dx.doi.org/10.1016/S2215-0366(17)30333-4. [99] Furst MA, Gandré C, Romero-Lopez-Alberca C. L. Salvador-Carulla. Healthcare ecosystems research in mental health: a scoping review of methods to describe the context of local care delivery. BMC Health Serv Res 2019;19(1):173. [100] Jenkins R, Gulbinat W, Manderscheid R, Baingana F, Whiteford H, Khandelwal S, et al. The mental health country profile: background, design and use of a systematic method of appraisal. Int Rev Psychiatry 2004;16(1-2):31–47. [101] World Health Organization. Global report on urban health: equitable healthier cities for sustainable development. World Health Organization; 2016. [102] World Health Organization. Framework on integrated, people-centred health services. Report by the Secretariat. Geneva: WHO; 2016 Retrieved from www. who.int/servicedeliverysafety/areas/people-centred-care/en/on, 18.. [103] García-Alonso CR, Almeda N, Salinas-Pérez JA, Gutiérrez-Colosía MR, Salvador-Carulla L. Relative Technical Efficiency Assessment of Mental Health Services: A Systematic Review. Adm Policy Ment Health Ment Health Serv Res 2019;1–16, doi:http://dx.doi.org/10.1007/s10488-019-00921-6. 110 C. Romero-López-Alberca et al. / European Psychiatry 61 (2019) 97–110