Summary Evaluations

Introduction to Systematic Reviewing
31 March 2003

Introduction to Systematic Reviewing (Repeated)
2 June 2003

Developing a Systematic Review (11 June 2003)
and Specifics of Undertaking a Systematic Review (18 June 2003)

The workshop was designed around the following areas:

• Systematic research synthesis
• Different models of synthesis
• Users of evidence and question-led research synthesis
• Early stages of reviews
• Systematic maps
• Synthesis and quality assessment
• Management and quality assurance of the review process
• Challenges, critiques and misunderstandings
• Discussion and further study

The aim of the workshop series (workshops 1, 2 and 3 combined) was to develop an understanding of:

• History of systematic synthesis
• Theory and purpose of systematic synthesis
• Roles and purposes of user involvement in the research process
• Synthesis and democratic involvement
• Relevance of synthesis to the assessment of methods and purposes of primary research

Following completion of the workshop series, participants ideally should have been able to:

• Develop a conceptual framework and question for a systematic review
• Develop a protocol for a systematic review
• Undertake the different stages involved in a systematic review
• Identify and use the tools required for managing a systematic review.

The EPPI-Centre provided two prior reading papers for the workshop, distributed to each participant in advance. The workshop itself then built upon the knowledge gained through completing the prior reading and also addressed further related issues.

Evaluation Summaries

Introduction to Systematic Reviewing
31 March 2003
The workshop provided each participant a the basic understanding of how to undertake a systematic review. The knowledge gained during this workshop was ideally to be further developed during the subsequent 2 workshops (days 2 and 3 of the workshop series).

A number of participants felt that the workshop was lacking in depth but understood that certain areas would be further addressed during workshops 2 and 3. A greater number of practical tasks would have been appreciated by many individuals rather than a predominantly lecture-based approach, as the ‘hands on’ elements of the workshop were found to be extremely useful.

The majority of participants expressed various ways in which the information and skills developed during the workshop would be disseminated to their wider research communities, which would in turn help to build the research capacity of others.

The main concern regarding the workshop was the size of the seminar room and the facilities available. This issue was not one of content, rather of forward planning in relation to the available facilities, and was therefore resolvable prior to the repeat workshop. The other primary issues surrounded the number of PowerPoint slides, a number of participants felt the number was rather excessive.

Introduction to Systematic Reviewing (Repeated)
2 June 2003
The workshop provided each participant with a basic understanding of how to undertake a systematic review. The knowledge gained during this workshop was ideally to be further developed during the subsequent 2 workshops (days 2 and 3 of the workshop series).

A number of participants expressed concern with the timings of the workshop. Certain issues were felt to be somewhat overlooked on account of other areas exceeding the suggested time allocation. On account of this, certain areas were not addressed in as much detail as intended, resulting in disappointment for certain individuals.

Certain areas were felt to be too much of an overview, however workshops 2 and 3 were designed to offer a more in-depth insight into certain procedures. A number of participants expressed a desire for the workshop to have covered certain issues in greater depth.

The majority of individuals found the workshop to be extremely beneficial as an introductory session, with many dissemination methods identified involving the workshop training material. The practical tasks were felt to be particularly useful as some feedback indicated that the trainers expressed a tendency at times to re-iterate the prior reading material rather than to build upon it. Certain presenters were also thought to ‘read-out’ PowerPoint slides rather than delivering the information in a more constructive manner.

The predominant issue surrounding the workshop was one of timing. In future workshops, more time could be allowed for participant involvement and subsequent discussions so that the interactive aspects of the workshop do not result in the full programme not being delivered. The feedback generated from each participant was extremely valuable in order to continue to improve future capacity building events.

Developing a Systematic Review (11 June 2003)
and Specifics of Undertaking a Systematic Review (18 June 2003)
Days 2 and 3 of the Introduction to Systematic Reviewing workshop series proved extremely successful in terms of building upon the basic skills and knowledge gained during the first workshop.

In accordance with the feedback received, the majority of participants found the workshops to be informative and interesting, although more extensive practical interaction would have been welcomed by many.

The EPPI-Centre staff were found to be helpful and enthusiastic, although according to one participant they seemed to be lacking in information regarding further future development.

Overall however, the two workshops were extremely successful in satisfying their initial objective. They provided complete and coherent culminatory workshops to further develop the skills and knowledge gained through the first workshop and are necessitated by the systematic review.

For more detailed evaluations of these workshops please contact the RCBN.