Publish in this journal
Journal Information
Vol. 45. Issue 7.
Pages 411-420 (October 2021)
Download PDF
More article options
Vol. 45. Issue 7.
Pages 411-420 (October 2021)
DOI: 10.1016/j.medine.2019.12.011
Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center
Análisis de la aceptación y validez de los métodos utilizados para la implementación de un programa de formación basado en competencias en un servicio de Medicina Intensiva de un hospital universitario de referencia
A. Castellanos-Ortegaa, M.J. Brocha, M. Barriosa, M.C. Fuentes-Durab, M.D. Sancerni-Beitiab, C. Vicenta, R. Gimenoa, P. Ramíreza, F. Péreza, R. García-Rosc,
Corresponding author

Corresponding author.
a Servicio de Medicina Intensiva, Hospital Universitario y Politécnico la Fe, Valencia, Spain
b Departamento de Metodología de Ciencias del Comportamiento, Universidad de Valencia, Valencia, Spain
c Departamento de Psicología Evolutiva y de la Educación, Universidad de Valencia, Valencia, Spain
Article information
Full Text
Download PDF
Tables (4)
Table 1. Basic descriptors and distribution by levels of the responses of the participants referred to the items of the questionnaire.
Table 2. Basic descriptors (M=mean; SD=standard deviation), correlations matrix (Kendall's tau-b) and internal consistency (Cronbach alpha in diagonal) of the subscales of the questionnaire for assessment of the methodology used to implement CoBaTrICE.
Table 3. Basic descriptors (mean and standard deviation in parentheses) and significant differences in the 2×2 comparisons between groups in the resident and tutor assessment of the methodology used to implement CoBaTrICE.
Table 4. Descriptive statistics (mean [M], standard deviation [SD], range, asymmetry and kurtosis) and factor saturation of the items of the global assessment scale referred to management of the clinical cases.
Show moreShow less

1. To determine the satisfaction of tutors and residents with a specific methodology used to implement CoBaTrICE. 2. To determine the reliability and validity of the global rating scales designed ad hoc to assess the performance of the residents for training purposes.


Prospective cohort study.


All the residents and tutors of the ICU Department of the Hospital Universitario y Politécnico la Fe de Valencia.


CoBaTrICE implementation started in March 2016, it was based on: (1) Training the tutors in feedback techniques; (2) Performing multiple objective and structured work based assessments to achieve the competences of the program; and (3) The use of an electronic portfolio to promote learning reflection and to collect the evidence that learning was taking place.


The acceptance of CoBaTrICE was explored through a satisfaction survey conducted after 9 months of implementation of the training program. The 15 residents and 5 tutors of the ICU Department were asked about the methodology of the formative assessments, the quality of the feedback, self-learning regulation and the electronic portfolio usefulness. The validity of the global rating scales was assessed through the tests alfa de Cronbach, reliability and generalizability indexes, and intraclass correlation coefficient.


The implementation of CoBaTrICE was satisfactory in all the dimensions studied. The global rating scales used for formative purposes showed reliability and validity.


The methodology used to implement CoBaTrICE was highly valued by tutors and residents. The global rating scales used for formative purposes showed reliability and validity.

Competency based medical education
Formative assessment
Global rating scales
Electronic portfolio
Reliability and validity
Intensive Care Medicine

(1) Determinar la satisfacción de tutores y residentes con la metodología utilizada para la implementación de CoBaTrICE, y (2) determinar la validez y la fiabilidad de las escalas de valoración global diseñados ad hoc para analizar el desempeño de los residentes con fines formativos.


Estudio prospectivo de cohortes.


Todos los residentes y tutores del Servicio de Medicina Intensiva del Hospital Universitario y Politécnico La Fe de Valencia.


En marzo del 2016 se inició la implementación de CoBaTrICE sustentada en: (1) formación de los tutores en técnicas de retroalimentación; (2) realización por los residentes de múltiples ejercicios reales de evaluación objetiva y estructurada para adquirir las competencias del programa, y (3) uso de un portafolio electrónico para registrar las evidencias del progreso y estimular la reflexión.


La satisfacción con CoBaTrICE se evaluó mediante una encuesta realizada tras 9 meses de implementación a los 15 residentes y 5 tutores del servicio. Se preguntó sobre la metodología de las evaluaciones, calidad de la retroalimentación, autorregulación del aprendizaje y utilidad del portafolio. Se determinaron la consistencia interna (alfa de Cronbach), índices de generalizabilidad y fiabilidad interjueces (índice de correlación intraclase) de las escalas de valoración global.


La aplicación de CoBaTrICE fue satisfactoria en todas las dimensiones estudiadas. Se constataron la validez y la fiabilidad de las escalas de valoración utilizadas.


La metodología utilizada para implementar CoBaTrICE fue valorada positivamente por tutores y residentes. Las escalas de valoración global utilizadas en la evaluación formativa demostraron ser válidas, fiables y reproducibles.

Palabras clave:
Formación médica basada en competencias
Evaluación formativa
Escalas de valoración
Portafolio electrónico
Validez y fiabilidad
Medicina Intensiva


These are the options to access the full texts of the publication Medicina Intensiva (English Edition)
If you are a member of the Sociedad Española de Medicina Intensiva, Crítica y Unidades Coronarias::
Go to the members area of the website of the SEMICYUC ( )and click the link to the magazine.

If you already have your login data, please click here .

If you have forgotten your password you can you can recover it by clicking here and selecting the option “I have forgotten my password”
Subscribe to

Medicina Intensiva (English Edition)

Purchase article

Purchasing article the PDF version will be downloaded

Price 19.34 €

Purchase now
Phone for subscriptions and reporting of errors
From Monday to Friday from 9 a.m. to 6 p.m. (GMT + 1) except for the months of July and August which will be from 9 a.m. to 3 p.m.
Calls from Spain
932 415 960
Calls from outside Spain
+34 932 415 960
Medicina Intensiva (English Edition)

Subscribe to our newsletter

Article options
es en

¿Es usted profesional sanitario apto para prescribir o dispensar medicamentos?

Are you a health professional able to prescribe or dispense drugs?