BACKGROUND: Occupational health services (OHS) are rarely involved in preventive issues and systematic work environment management. The Structured Multidisciplinary Work Evaluation Tool (SMET) questionnaire was created to address the lack of multidisciplinary/multifactorial OHS tools with the aim to be used in preventive issues and systematic work environment management.

OBJECTIVES: The aim of this study was to evaluate trustworthiness of the inter-rater reliability in the qualitative analysis of the open-ended items and intra-rater reliability of the self-estimated items in the SMET questionnaire.

METHODS: A qualitative comparison of the inter-rater reliability in the qualitative analysis of the open-ended items was performed to evaluate trustworthiness. The intra-rater reliability of the self-estimated items in the SMET questionnaire were analysed with Elisabet Svensson method.

RESULTS: Qualitative analysis of the open-ended items showed good trustworthiness. The self-estimated items showed a high percent agreement (PA), 0.98-0.99 in the physically, 0.99 in the environmentally and 0.98-1.0 in the psychosocially demanding items. A low degree of systematic errors and individual variability were found.

CONCLUSIONS: The SMET questionnaire shows good trustworthiness and intra-rater reliability and can be used to follow up and evaluate work environmental interventions.