Survey research and design in psychology/Admin/Evaluation/2018

Evaluation of Survey Research and Design in Psychology 2018

Changes for 2018

The main change to this unit for 2018 was migration of learning management system (LMS) from Moodle to Canvas. For this unit, students' main interface is through the LMS, with links from there to Wikiversity content.

ISEQ

The student satisfaction / educational quality monitoring mechanism used by University of Canberra (UC) is the InterFace Student Experience Questionnaire (ISEQ). ISEQ is developed and used by UC to gather feedback from students about their educational experience in enrolled units. The ISEQ consists of a few single item satisfaction rating questions and an open-ended request for further comment. The ISEQ is available online at the beginning (Week 3 to 4 - 2 items), mid- (Week 7 - 3 items), and end (Week 11 - 5 items) of a 13-week semester. The items are:

Start of Semester ISEQ1
1. I have a clear idea of what I need to do to learn successfully in this unit
2. Please provide any further comments on your learning experience in this unit
Mid-Semester ISEQ2
1. I am making the most of my opportunities to learn in this unit
2. Overall I am satisfied with my experience of this unit so far
3. Please provide any further comments on your learning experience in this unit
End of Semester ISEQ3
1. My learning in this unit will help me achieve my personal, professional or educational goals
2. I made the most of my opportunities to learn in this unit
3. Overall I am satisfied with how the staff in the unit supported my learning
4. Overall I am satisfied with the quality of this unit
5. Please provide any further comments on your learning experience in this unit

Start of semester

Here's a summary of responses.

Q1: "I have a clear idea of what I need to do to learn successfully in this unit":

57 out of 120 students (48%) responded.
90% Strongly Agreed (44%) or Agreed (46%)
9% Disagreed
0% Strongly Disagreed

Q2: "Please provide any further comments on your learning experience in this unit",

17 students responded (14%), providing a total of 32 comments.
62% of comments suggested improvements - the themes related to:
Assessment (7 comments)
- Web resources (6 comments)
- Lectures (4 comments)
- Tutorials (3 comments)
38% of comments were about what was working well - the themes related to:
- Structure/Content (2 comments)
- Staff (7 comments)
- Web resources (1 comment)
- Lectures (1 comment)
- Tutorials (1 comment)

A copy of all the comments, with unit convener responses about the suggested areas for improvement are available.

Mid-semester

46 out of 119 students (39%) responded.

Most respondents seem to be travelling along pretty well, although there were a few points of concern raised which ideally would be followed-up and addressed during the second half of semester.

Here's a summary:

Q1: "I am making the most of my opportunities to learn in this unit":

80% Agreed (Strongly Agreed (20%) and Agreed (60%))
9% Not applicable
11% Disagreed (Disagreed (11%) and Strongly Disagreed (0%)

Q2: "Overall I am satisfied with my experience of this unit so far":

78% Agreed (Strongly Agreed (20%) and Agreed (58%))
7% Not applicable
15% Disagreed (Disagreed (11% and Strongly Disagreed (4%)

Q3: "Please provide any further comments on your learning experience in this unit"

10 students responded (8%), providing a total of 15 comments.
73% of comments suggested improvements related to:
- Assessment (4 comments)
- Web resources (3 comments)
- Lectures (3 comments)
- Tutorials (1 comments)
27% of comments were about what was working well:
- General/Overall (1 comment)
- Structure/Content (1 comment)
- Web resources (1 comment)
- Lectures (1 comment)
- Tutorials (1 comment)

A copy of all the comments, with unit convener responses are available.

End of semester

End-of-semester student feedback via the University of Canberra Interface ISEQ3.

40 out of 111 students (36%) responded.

Here's a summary:

Q1: "My learning in this unit will help me achieve my personal, professional or educational goals":

73% Agreed (Strongly Agreed (20%) and Agreed (53%))
10% Not applicable
18% Disagreed (Disagreed (13%) and Strongly Disagreed (5%)

Q2: "I made the most of my opportunities to learn in this unit":

73% Agreed (Strongly Agreed (23%) and Agreed (50%))
13% Not applicable
16% Disagreed (Disagreed (8% and Strongly Disagreed (8%)

Q3: "Overall I am satisfied with how the staff in the unit supported my learning":

73% Agreed (Strongly Agreed (23%) and Agreed (50%))
13% Not applicable
18% Disagreed (Disagreed (13% and Strongly Disagreed (5%)

Q4: "Overall I am satisfied with the quality of this unit":

65% Agreed (Strongly Agreed (20%) and Agreed (45%))
13% Not applicable
23% Disagreed (Disagreed (20% and Strongly Disagreed (3%)

Q5: "Please provide any further comments on your learning experience in this unit":

12 students responded (11%), providing a total of 21 comments.
76% of comments suggested improvements related to:
- Assessment (4 comments)
- Web resources (5 comments)
- Lectures (2 comments)
- Tutorials (5 comments)
24% of comments were about what was working well:
- General/Overall (1 comment)
- Structure/Content (1 comment)
- Assessment (1 comment)
- Staff (2 comments)

A copy of all the comments, with unit convener responses are available.

If you have any other feedback, please feel free to share.

Recommendations

The single, main, consistent recommendation from the ISEQ feedback is to improve the navigability of content, particularly between UCLearn Canvas. As 2017 to 2018 saw the migration of learning management system, from Moodle to Canvas, there are definitely improvements that can be made in this area for 2019.

Other key themes for consideration for future development are:

Lectures can sometimes be slow/boring/too much content - clearer step-by-step guides and real-world examples are requested
Tutorials can sometimes be too fast/have too much content
Several students commented that quizzes are too hard, although the quiz and overall marks are reasonable and comparable to other similar units.

Positive comments reflected:

Unit is well organised
Staff/lecturer/tutor is supportive and patient