Instructional design/Introduction to Kirkpatrick’s four levels of evaluation/Level One Evaluation Item Types

Introduction

Now that you have identified the level 1 target areas, let's proceed to the next step in the process of creating your own survey.

What do the following have in common?

If you answered all of them are questions from a level 1 evaluation or reaction sheet, you are right! While there are many types of questions you can include in a level one evaluation, these survey questions fall into two main categories: closed-ended and open-ended.

Closed-ended questions

When you want learners to choose from a given set of possible responses that you have pre-determined, use this type of question. Closed-ended questions enable you to collect quantitative data that are easy to analyze after data collection. The main closed-ended questions used in a survey are Likert-scaled questionsare and multiple choice questions.

Likert-scaled questions

Likert-scaled questions allow learners to select a response from a given range that best matches their opinion. Remember to use this type of question when you want Learners to select only one response. A Likert scale usually contains the following five points:

1—Disagree, 2—Somewhat Disagree, 3—Neutral, 4—Somewhat Agree, 5—Agree.

You may also use variations of the Likert scale.

Example
Innovate Technologies wants to find out what new employees think about their orientation program. Here are two examples of Likert-scaled questions (with slight variations in the scale) to include in a level one evaluation:

I found the orientation program's content easy to follow. File:Q1 b.png

The trainer's presentation style kept me engaged. File:Q3 b.png

Multiple choice questions

Multiple-choice questions allow learners to select one or more than one response from a given set of possible choices. When using this type of questions, make sure all the answer choices are valid. When applicable, include “Other” as one of the choices. This type of question is useful when you want to find out what learners' top preferences are.

Example
Stratford Healthcare wants to find out whether employees like the current duration of their IT training sessions or prefer other choices. Here’s an example of multi-choice question to include in a level one evaluation:

During an 8-hour session, I like:
one 15-minute break and one hour-long break
two 10-minute breaks and one 45-minute break
three 20-minute breaks
Others. Please specify:___________________

Open-ended questions

When you want to collect detailed feedback from your learners about a certain aspect of the training, use this type of question. Open-ended questions are a great way to collect qualitative data (i.e. data that does not include any numbers or figures). Use these type of questions to get descriptive input from participants, and their suggestions on key areas.
If you feel you've got a good grasp of level one target areas, test your knowledge (To return to this page, click the Back button on your browser window ). Or, click Next to go to Lesson 5.

Back

Next

ID Homepage

1. Kirkpatrick’s 4 Levels of Evaluation

2. Level 1 Sample Survey

3. Target Areas

4. Question Types

5. Structure Your Survey