Umeå University's logo

The Shirom-Melamed Burnout Questionnaire/Measure (SMBQ/SMBM) is a self-report instrument frequently used for assessing degree of burnout and screening for stress-related exhaustion disorder. The aim of the present study was three-fold. First, to examine reliability and construct validity of different versions of SMBM with 6–22 items in a clinical context. Second, to examine the criterion validity by assessing sensitivity and specificity and determining clinical cut-offs for these versions of the SMBM, and third to examine the prevalence of burnout in a general population and primary care sample using the proposed cut-offs. Two Swedish samples were used for the first two purposes: a clinical sample of patients diagnosed with exhaustion disorder (n = 149), and a matched sample of healthy controls (n = 60). For the third purpose a sample from the general population (n = 3406), and a primary care clinical sample (n = 326) was used. The modified versions of the SMBM showed good internal consistency, construct validity, dimensionality and model fit on the clinical exhaustion disorder sample, as well as configural measurement invariance across clinical and non-clinical samples. The sensitivity (94.6%–95.3%) and specificity (93.3%–95.0%) in identifying cases with exhaustion disorder based on the cut-off of 4.0 for the 19-, 16- and 11-items versions, and on the cut-off of 3.75 for the 6-item version was high. The prevalence of burnout was 81.2% in the primary care sample and 16.6% in the general population sample. The findings indicate that the SMBM is a useful instrument for screening for exhaustion disorder and burnout.

Burnout is an increasing public health problem. Although research indicate that cognitive and affective factors are related to burnout, there is a lack of knowledge about the extent to which specific cognitive and affective symptoms are related to burnout, and whether there are sex-related differences. An aim of this study was to identify specific self-reported cognitive and affective symptoms that are particularly associated with burnout, both in the population in general and in men and women separately. Another aim was to examine the risk of burnout for specific symptoms and total number of symptoms in the general population and in men and women separately. Cross-sectional data were used from a large population-based questionnaire study consisting of 3406 participants (18–79 years) randomly selected from a general population in northern Sweden. Eleven cognitive and affective symptoms were assessed with a subsection of the Environmental Hypersensitivity Symptom Inventory, and the 22-item Shirom-Melamed Burnout Questionnaire (SMBQ) was used to assess burnout. The findings suggest that burnout is associated with a rather large number of cognitive and affective symptoms, in particular feeling tired/lethargic, having concentration difficulties, sleep disturbance, feeling depressed and being absent minded. Women with burnout (SMBQ score ≥ 4) reported higher prevalence of feeling tired/lethargic and sleep disturbance. The results add to the understanding of affective and cognitive symptomatology in burnout, which might have implications for early identification and prevention of burnout and exhaustion disorder.

A challenge for professional psychology programs is the assessment of students’ professional competence. Despite its potential, objective structured clinical examination (OSCE) has not gained widespread use in the psychological field. However, at Umeå University and Örebro University in Sweden, the OSCE has been introduced at the Clinical psychology programs to assess professional competence. The aim of this study was to explore students’ perceptions of whether and how, preparing for and performing the OSCE benefits their professional learning and prepares them for clinical practice. A web-based questionnaire was administered to 88 psychology students who completed the OSCE and field training. Most of the students perceived the OSCE as a valuable experience that benefits their learning. The OSCE prepared them for clinical practice through practical hands-on training, and by providing essential experience in client interaction, increasing students’ confidence in the role as a psychologist. Students also reported that feedback from the OSCE was crucial for their ongoing learning, but that the authenticity of the examination can be improved. Based on these findings, recommendations for future OSCEs in professional psychology include appropriate preparations, providing constructive feedback as well as striving for high authenticity in the tasks of the OSCE stations.

The aim of this study was to investigate how self-rated health (SRH) reflects ongoing ill-health and how SRH is associated with previous ill-health and/or predicts future ill-health such as burnout, disturbed sleep, and somatic symptoms. The study used two waves from the population-based Västerbotten Environmental and Health Study in which 2 336 adult persons participated by answering a questionnaire at two time points three years apart. Hierarchical and logistic regression analyses were conducted, thus treating all variables both continuously (degree) and categorically (case). The analyses were performed both cross-sectionally and longitudinally. The results showed bidirectionality between suboptimal SRH and burnout, disturbed sleep and somatic severity caseness. Moreover, degree of poor SRH was more likely to occur simultaneously to high degrees of burnout and somatic severity than to degree of poor sleep quality. Also, caseness of burnout, disturbed sleep and somatic severity increased the risk of simultaneous suboptimal SRH. Finally, the results showed that degree of burnout three years earlier, predicted degree of poor SRH, and that degree of poor SRH predicted degree of sleep three years later. In conclusion, in a population-based, normal adult sample there is a bidirectional relationship between suboptimal SRH and caseness of burnout, disturbed sleep quality and somatic symptoms, but not between degree of these symptoms. The results can have implications for health care meeting patients complaining about poor general health.

Retrieval practice is a learning strategy that has repeatedly been found to have positive effects on memory and learning. However, studies indicate that students rarely use retrieval practice on a voluntary basis. The objective of the present study was to examine students’ self-regulated use of retrieval practice, and to determine whether sex and individual differences in cognitive and non-cognitive aspects are related to optional use of practice testing. A classroom study was conducted with 146 upper-secondary school students taking courses in mathematics and Swedish. An ABAB design was used to compare students’ optional and non-optional use of retrieval practice (i.e., repeated online quizzing). Students performed cognitive tasks to assess working memory capacity and fluid intelligence and completed self-reports of non-cognitive factors related to school achievement, such as grit, need for cognition (NFC), conscientiousness and openness. Quiz use was then compared using paired- and independent-samples t-tests, and hierarchical linear regression analyses explored relations to individual differences. The results showed that students completed significantly fewer quizzes in the optional sections than in the non-optional sections, and that females completed significantly more optional quizzes than males in Swedish, but not in mathematics. Further, the results showed that conscientiousness predicted optional quiz use in mathematics, whereas sex, NFC, conscientiousness, and openness predicted quiz use in Swedish. To conclude, although the findings show a relatively low optional/self-regulated use of practice testing, in line with earlier research, they suggest that sex and non-cognitive factors, such as personality characteristics, can predict optional use of practice testing.

The overall aim of the present study was to examine the construct validity of different versions of the Shirom-Melamed Burnout Questionnaire/Measure (SMBQ/M) suggested in previous work, as well as to provide normative data for a large population-based sample in Sweden with a broad range in age. Cross-sectional data from the Västerbotten Environmental Health Study in Sweden were used. The 3406 participants (56% women) in this study, aged 18–79 years, constituted a random sample stratified for age and sex. Participants responded to a questionnaire including the 4-factor 22-item version of the SMBM as well as background questions and a number of validated questionnaire instruments assessing for example, sleep disturbance, depression, anxiety, perceived stress, and somatic symptoms. The dimensionality of different versions of the SMBM were examined with confirmatory factor analysis. A modified 4-factor 19-item model of the SMBM provided good model-fit, and two 2-factor models (11-item and 6-item) provided excellent model fit. The relationships to relevant psychological constructs provided support for convergent validity for the suggested versions of the SMBM. Finally, normative data were obtained for a broad age group for the different versions. In conclusion, we suggest that for assessing the core of the burnout construct in terms of emotional and physical exhaustion and cognitive weariness, the SMBM-11 or SMBM-6 for repeated measures, are to be used. For a broader assessment of burnout incorporating both symptoms and information about the process of exhaustion via the subscales of listlessness and tension, we recommend the use of the modified 4-factor SMBM-19.

Purpose: Assessment of complex clinical skills and abilities is a challenge in mental health education. In the present study, an objective structured clinical examination (OSCE) was adapted to psychology and implemented in a Master in Psychology program. The purpose of the present study was to examine aspects of validity of this OSCE.

Design/methodology/approach: A total of 55 students enrolled in the Master in the Psychology program at Umeå University, Sweden, participated in two OSCE occasions. In addition to OSCE data, questionnaires were administered immediately after the OSCE to students (n = 18) and examiners (n = 13) to examine their perceptions of the OSCE.

Findings: The results provided support for different aspects of validity. The level of internal consistency was close to acceptable, and there was a good correspondence between global ratings and checklist scores for many stations. However, adding an additional category to the global rating scale and reviewing some of the station checklists might improve the assessment further. The present cut-score of the OSCE was comparable to a cut-score set by the borderline regression model. In general, students and examiners perceived the OSCE as a high-quality examination, although examiners raised some issues that could improve the OSCE further.

Originality/value: In conclusion, OSCE is a promising assessment in psychology, both from a psychometric perspective and from a test-taker and examiner perspective. The present study is an important contribution to the field as there are only a few examples where OSCE has been used in clinical psychology, and to the best of the authors’ knowledge, this paper is the first to evaluate the validity of such an assessment.

The aim of this study was to examine the psychometric properties of the Swedish version of the Clinical Outcomes in Routine Evaluation–Outcome Measure (CORE-OM) using classical test theory and item response theory (IRT). The CORE-OM is a commonly used 34-item self-report instrument measuring psychological problems/distress covering four domains: subjective well-being, problems/symptoms, functioning and risk. Despite its broad application, only a few studies have used IRT to examine the psychometric properties, and the properties of the Swedish version have only been examined in one initial study. The present study included 1,011 clients with mild to moderate symptoms of distress, applying for psychotherapy at an outpatient training clinic in Sweden. Clients' responses were subjected to classical item analyses as well as IRT (Rasch) analysis using the partial credit model. The classical analyses demonstrated high levels of internal consistency and acceptable levels of item discrimination for the majority of the items, although lower for some items, particularly in the Risk domain. IRT analyses showed that there was a rather good match between item and respondent locations and the measurement precision was high. Disordered step and average measures for some of the items in the Risk domain indicate that these items were problematic from a psychometric point of view and only applicable for a minority of the participants. Differential item functioning for gender in some of the items suggests that they might need to be revised to minimise potential gender bias.

Finding valid and reliable ways to assess complex clinical skills within psychology is a challenge. Recently, there have been some examples of applying Objective Structured Clinical Examinations (OSCEs) in psychology for making such assessments. The aim of this study was to examine students’ and examiners’ perceptions of a digital OSCE in psychology regarding quality and students’ feelings about the OSCE. Participants were 51 students enrolled in the Programme for Master of Science in Clinical Psychology during two semesters and nine examiners assessing each OSCE occasion, at Umeå University, Sweden. Web-based questionnaires were used for data collection. Psychometric analyses indicated that the subscales in the student questionnaire had adequate or close to adequate levels of item and scale reliability. Both students and examiners felt that the digital OSCE was realistic, valid and well-aligned with professional practice. Although students perceived the digital OSCE as stressful, the results showed that they were focused and concentrated and found the OSCE to be a positive learning experience, implying that the stress did not affect performance to any significant extent. Based on the examiners’ experiences, it can be concluded that there are both advantages and disadvantages which need to be considered when planning future digital OSCEs.

The aim of this study was to examine ninth-grade students' perception of a Swedish national test in science (high-stakes for the students) and a field trial (low-stakes for the students), in terms of test-taking motivation. The study is based on semi-structured interviews with 12 students. Overall, the students had a positive perception of the national test; they were motivated to do their best, believed they did well and found the test important and good. Several students were nervous before the test and some during the test whereas others felt okay, or even enjoyed taking the national test. The students talked about less effort and test anxiety in the field trial and perceived the test as less important compared to the national test. The interviews provided a rich understanding of the different aspects of test-taking motivation as described by the expectancy-value theory. Furthermore, they indicated how the test administration could be adjusted so as to achieve higher test validity.