INSIGHT System

GLO The INSIGHT System

 

What is the INSIGHT System?

The Integrated Feedback on Student Learning Outcomes for Improvement and Growth (INSIGHT) System is an eLearn-integrated  web-application that allows instructors to map GLO-related course learning outcomes to assessment parts (rubric items for assignments, sections in quizzes). The INSIGHT System uses eLearn assessment scores to feed a learning outcome dashboard for students and instructors. It allows instructors to track your students progress, as individuals and as a class, for course and graduate learning outcomes

It works by mapping Assessments to Course Learning Outcomes linked to SMU’s Graduate Learning Outcomes

This allows instructors to adjust their instructional strategies in accordance with the attainment of these learning outcomes. It allows students more personalised coaching and advice during consultation sessions.

 

How does the INSIGHT System work?

The INSIGHT System works by aggregation of assessments within and across courses. all relevant assessment scores are mapped on a standard scale

 

The scale is inspired by scales developed for skills or competency levels, allowing for six levels. (Jung, E., Kim, M., & Reigeluth, C. (2016). Learning in Action: How Competent Professionals Learn. Performance Improvement Quarterly, 28(4), 55-69.)

Beginning

Developing

Progressing

Competent

Accomplished

Exemplary

 

Most students are expected to reach the Progressing or Competent Level in the targeted learning outcomes of a course. 

Accomplished and Exemplary Level would be rare, achieved by maybe 5% and 1% of students respectively, providing levels for top students to aspire.

The first three levels - Beginning, Developing and Progressing – relate to students who are undergoing growth, and conscientiously surround themselves with the relevant knowledge and skills that will help them become adept in their areas of specialisation. Once they get in line with what is expected of them, they will start scaling the ladder of mastery: the last three levels of ‘states of being’ – Competent, Accomplished and Exemplary.
What do students see?

After instructors grade the assessments, students will then be able to view their attainment levels via their own INSIGHT System dashboard (Accessible via eLearn).

GLO report for student

A report on all the Graduate Learning Outcomes tracked in ALL courses across SMU

 

Student Attainment Across Courses

Student's Graduate Learning Outcome attainment in all their courses taken in SMU - Sorted chronologically

 

GLO report specific course

A report on a specific course tracking Course Learning Outcomes and Graduate Learning Outcomes

 

GLO report recommendations

Specific attainment level recommendations on Course Learning Outcomes

How to get started using the INSIGHT System?

For Instructors

  1. Contact CTE at cte [at] smu.edu.sg to link your courses to the INSIGHT System
  2. Visit INSIGHT System support site for instructors. (Instructor Access only)The site contains video tutorials and guides for instructors.

For Students

  1. Download the GLO User Guide for Students (Student Access only)
What courses are using the INSIGHT System?

Click here for a list of courses which are tracking their GLO attainment using the INSIGHT System

Other Frequently Asked Questions

Q: How do I access the INSIGHT System?

A: If the system is linked to your course, you will see the button in your Instructor Toolbar in Elearn



Q: Can the dashboard be meaningfully decoupled from the actual grades? 

A: It is better if it is not decoupled.  One might have some assessments that lead to attainment levels of course learning outcomes in the dashboard and are not part of grading but it is better if they are.  If the link is weak, students may not put in the effort and then dismiss the dashboard scores. 


Q: Will the introduction of another set of score card create another layer of anxiety for students? 

A: We think positives of recommendations will outweigh the negatives of one more comparison and in this case the additional comparison is not really a new one.  It is just a more detailed explanation of the letter-grade comparison so we believe students will see it as value add. 


Q: How do we ensure faculty members share a broadly similar understanding of what the different levels (and labels) mean?

A: CTE will help in sharing the definitions with students and instructors through our user guides and presentations.


Q: What is the explanation in mapping the rating, i.e. what do the six labels/levels mean to students?

A: CTE will help in sharing the definitions with students and instructors in separate sessions.

References
  1. Ajjawi, R., & Boud, D. (2018). Examining the nature and effects of feedback dialogue. Assessment & Evaluation in Higher Education, 43(7), 1106–1119. https://doi.org/10.1080/02602938.2018.1434128
  2. Donia, M. B., O'Neill, T. A., & Brutus, S. (2018). The longitudinal effects of peer feedback in the development and transfer of student teamwork skills. Learning and Individual Differences, 61, 87-98.
  3. Grading Rubrics Sample Scales: https://www.brown.edu/sheridan/teaching-learning-resources/teaching-resources/course-design/classroom-assessment/grading-criteria/rubrics-scales
  4. Jung, E., Kim, M., & Reigeluth, C. (2016). Learning in Action: How Competent Professionals Learn. Performance Improvement Quarterly, 28(4), 55-69.)
  5. Power of feedback article: https://journals-sagepub-com.libproxy.smu.edu.sg/doi/full/10.3102/003465430298487
  6. Power of feedback revisited: Wisniewski B., Zierer K., & Hattie, J. (2020). The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.03087

 

	This project was officially launched in August 2019 as an institutional-wide platform.