Process of assessing learning outcomes through Brightspace LMS

1. USING D2L TO ASSESS
STUDENT LEARNING
OUTCOMES
Mohamad Ali b. Baba
College of Applied Engineering & Technology, Southern Illinois
University

2. Competencies - Overview
Competencies are the measurable or observable
knowledge, skills, abilities, and behaviors.
Competencies validate information about the
knowledge, skills and abilities of students through the
assessment of learning objectives.
D2L Competencies Tool enables us to assess:
 Program Competencies
 Course Learning Objectives
 Evaluation Activities

3. • Continuous improvement – curriculum,
pedagogy
• Student success and retention
• Program Accreditation (Compulsory)
Why?

4. Analyze
Design
Develop
Implementation
Evaluation
Analyze
Design
Develop
Implementation
Evaluation
Analyze
Design
Develop
Implementation
Evaluation
Retentio
n
Growth
Why?
Retention
Growth
Retention
Growth
Student
Retentio
n
Course
Repetition

5. D2L Competencies Structure
A competency structure is a hierarchy composed
of three basic elements:
 “Program” Competencies
 “Course” Learning Objectives
 “Assessment” Activities

6. D2L Terminology: Parent-child
relationships between competency
structure elements
Element Parents Children
“Program” Competency Other higher-order
competencies
Learning objectives.
Other lower-order
competencies
“Course” Learning
Objective
Competencies Activities
“Assessment” Activity Learning objectives

7. How it looks like in D2L
“Program”
Competency
“Course” Learning
Objective
“Assessment”
Activities

8. 5 Step Process
Work flow of Competencies Mapping

9. IT001
AKA “a”
Knowledge of Fundamentals: An understanding of the fundamentals of
management, quality, production, and automation.
IT002 Interpreting Data: An ability to interpret graphical, numerical, and textual data.
IT003 Problem Solving: An ability to apply relevant scientific and technology principles to solve
real world, open-ended industrial problems.
IT004 Design: An ability to design an industrial process to meet customer needs.
IT004 Communication: An ability to communicate effectively in oral, written and visual forms.
IT005 Teamwork: An ability to work in teams and understand the effective team dynamics and
characteristics.
IT006 Contemporary issues, non-technical issues, global awareness: An awareness of
contemporary and non-technical issues in technology profession and the role of
professionals in an interdependent global society.
IT007 Professional Ethics: An awareness and understanding of professional ethics.
Program Outcomes/Competencies:

10. Step #1
 D2L administrator (JP Dunn) enters
department level “program” competencies in
D2L database

11. Step #2
 Instructor enters course learning objectives in
D2L database
 From D2L menu - (Track/Competencies/New/Competencies or
Learning Objectives)

12. Step #3
 Mapping process – Instructor links course
learning objectives to “program” competencies

13. After the linking
“Program”
Competency
“Course” Learning
Objectives

14. Step #4
 Link Activities – Instructor select the method to
assess the course learning objectives with
identified activities (quiz items, rubrics,
assignments, discussions)

15. Step #5
 Set assessment criteria – Instructor sets the
threshold to assess the learning objectives
(e.g ≥ 60% of overall quiz score)

16. Competencies Reports

17. Reports – by learning objectives

18. Individual student report by
objective

19. Overall Individual report for one competency
“Define Key Terms”

20. D2L Insights Reports – JP generates
course and department reports
 https://documentation.desire2learn.com/en/Stand
ard%20reports
 Other D2L Insights reports include:
 Standard Report
 Accreditation report
 Competencies report
 Grade report
 Enrollment report

21. IT-208 – Fundamental of Manufacturing Process, Fall
2014

26. Important considerations
 Use standard conventions in D2L to avoid
confusions, including university-wide common
assessment terminology.
 Use measurable verbs in learning objectives,
so that they can be assessed using learning
activities.
http://www.marshall.edu/assessment/Resources/BloomsTaxonomyV
erbs.pdf
 A learning objective can be assessed with
more than one activities, and vice versa.

27. D2L demonstration

28. Thank You