Evaluation of prevention measures

Evaluation is the systematic assessment of measures by means of scientific methods with regard to the formulation of targets, implementation, and effectiveness and efficiency. The IAG evaluates the efficacy and cost-effectiveness of prevention measures on behalf of its clients. This concerns, for example, safety posters, campaigns, mailshots and websites, and also BG regulations. We offer consultancy concerning all steps of an evaluation. This encompasses:

• Development of efficacy models
• Definition of robust evaluation designs
• Development and review of questionnaires or interview guides, in consideration of the targets of an evaluation
• Identification of representative spot-sampling sizes based upon good scientific practice
• Performance of surveys, for example by questionnaire or interview
• Qualitative and quantitative evaluation of data
• Processing of the content and graphical preparation of the results in scientific reports

Our work is geared to the evaluation standards of DEGEVAL, the association for evaluation.

A selection of activities is presented here:

Research and consultancy

Three major foci have emerged within our project work, in which a series of projects are being conducted for various accident insurance institutions: the evaluation of campaigns, evaluation of training provision and events, and evaluation of occupational medical and technical safety supervision.

• Evaluation of campaigns: In recent years, the accident and health insurance institutions have increasingly employed campaigns for the prevention of accidents and diseases. Campaigns are measures conducted for a limited duration, in pursuit of a defined objective, and in which different measures are combined and frequently several parties involved. They differ in their effects. It is important that the measures of a campaign reach their target groups and are effective in terms of attainment of the targets. Projects with this focus include evaluation of the nationwide Healthy Skin Prevention Campaign and of the planned "Risiko runter" (down with risks) campaign. The evaluation of the topical campaigns held by individual accident insurance institutions, such as the BG responsible for the meat-processing industry (FBG) on the subject of noise, is also supported. In addition, we have conducted a project in which we have systematically documented the experience gained with prevention campaign and compiled the effects, success factors and obstacles associated with them. At the same time, we are currently producing a brochure in conjunction with the accident insurance institutions in Austria and Switzerland (AUVA and SUVA), the aim of which is to summarize our experience in the evaluation of campaigns.
• Evaluation of training and events: Training measures are effective and efficient when those taking part learn something and following the measure are equipped to implement what they have learnt at the workplace within their own company, and thereby actually to contribute towards reducing risks to safety and health. In the area of training, we examine the quality of seminars and training courses, for example, by means of a questionnaire drawn up using scientific methods. Besides the evaluation questionnaire for seminars, the IAG has used the same procedure to develop a questionnaire for evaluation of the hotel, and another for the evaluation of events. The evaluation questionnaire for events is available in English and French in addition to German. The scale and quality of transfer of the taught material to the workplace can also be quantified by means of an online questionnaire, which has been tested. Within the research project entitled "Quality in Prevention ? Training Sub-project", the quality of the structure, process and results of OSH seminars has been studied by means of a pre- and posttest control-group design. In addition, our studies support in-plant instruction. For example, we are testing and evaluating an electronic form of instruction.
• Evaluation of occupational medical and safety supervision: This research focus is the product of a large number of requests from the BGs for support during evaluation of the new BGV A2 accident prevention regulation. This new regulation aims to implement optimized guidance strategies for small and very small enterprises which are provided by occupational physicians and OSH professionals. At present, we are evaluating this regulation on behalf of 14 BGs and one public-sector accident insurer. Evaluation is also in progress of the quality appraisal by the GQB, the society for quality assurance in occupational medical supervision.

In our project work and for the evaluation of seminars, we generate, use and evaluate questionnaires electronically in the Evaluation practical facility. This can be used for both paper-and-pencil questionnaires and online questionnaires.

up

Training and Events

The IAG hosts a range of seminars on the subject of evaluation. Seminar No. 510059 (principles of evaluation ? demonstrating and evaluating the effects of OSH measures) provides a suitable introduction. Our more in-depth seminars cover the development, use and evaluation of questionnaires and interview guides (seminar Nos. 520018/520019). A seminar (No. 520014) is also available on the use of standardized tests in occupational safety and health.

Where required by our customers, we also hold subject-specific workshops for evaluation of prevention campaigns or training courses, and organize events for specialists on the subject of quality in prevention.