Aalto University School of Engineering pilot project (Dynamic Course and Programme Level Feedback System) presentation at EUNIS 2018 – Coming of Age in the Digital World, Paris, France.

1. Supporting understanding
of students’ learning via
visual self-assessment
EUNIS 6.6.2018
Ville Kivimäki, Joonas Pesonen, Jani Romanoff, Heikki Remes,
Tomi Kauppinen

2. Background

3. Problem
• After course summative feedback is not quality data
• Around 30% answer rates
• ”This course is just another piece of ****”
• Summative feedback influences only the next round course is
lectured
• Professors on tenure track need to show how their teaching
develop
12.6.2018
3

4. Dynamic Course and Programme Level
Feedback System
- A pilot project started in Autumn 2016 in Aalto University,
Finland
- Part of Aalto Online Learning initiative
- https://onlinelearning.aalto.fi/
- Total of 12 courses has participated to this pilot to date
- MSc programme courses in School of Engineering and School of
Business
- BSc courses in School of Engineering
- University project run in collaboration with faculty, IT
Services and Rapida Ltd.
12.6.2018
4

5. Our motivation towards more dynamic
teaching and learning experience
”There is an interactive relationship between teachers’ and
students’ emotions and behaviour. Students are aware of and
influenced by teachers’ emotions (Sutton and Wheatley 2003),
and, conversely, teachers’ emotions are influenced by students’
behaviour and progress (e.g. Hargreaves 2000). It has been
found that teachers’ satisfaction and pleasure is likely to arise
from progress made by their students, and from the responsive
and cooperative behaviour of their students.
Postareff, L., Lindblom-Ylänne, S. 2011. Emotions and confidence within teaching in
higher education. Studies in Higher Education. 36:7, pp. 799-813.
12.6.2018
5

6. Visual self-
assessment =
qualitative feedback

7. Concept map / Curriculum map
Concept map templates contain four levels deep information on
curriculum/syllabus:
12.6.2018
7
1. Degree 2. Group 3. Course 4. Topic
5. Learning
objective
1.
2. 3. 4.

8. Student self-assessment data =
feedback data
Students self-assessess learning experience through visual UI:
• clicking the icons
• drawing relations
• naming relations.
12.6.2018
8

9. Teacher assess his teaching based on
feedback data
Teacher can view data through visually responsive dashboard
where data set is updated weekly during the course.
12.6.2018
9

10. Teacher’s interface: dashboard
12.6.2018
10

11. Learnings so far and next step…
To study the effects of concept mapping and dashboards, we
interviewed students and teachers and made observations from
students’ concept map files.
Students put their personal opinions and experiences into a larger
perspective.
Teachers see that this data has turned out to be sufficient feedback
for adaptive teaching.
An intervention study has been planned for next autumn to
scientifically assess the effects of this method.
12.6.2018
11

12. Technology and
Architecture

13. System Architecture
12.6.2018
13
Relational Database
(SQL Server)
Concept Mapping
Web Application
File Storage
(FTP Server)
LTI
mmap
xml
export
parse-
mmap.py
Reporting Portal
Course
Dashboard
Reporting Tools
Visualizations
(Power BI)
Ad-hoc Analysis
(e.g. Excel)
Degree Program
Dashboard
Moodle
Aalto Data Warehouse
Desktop Application
Mobile Application
Student Teacher Researcher Program Director
dashboards

14. From XML to tidy tables
12.6.2018
14

15. Links
Blog created for LAK18 conference:
http://blogs.aalto.fi/conceptmapanalytics
(includes a real working online Power BI visualisation done during the
conference workshop)
Open source project at GitHub:
https://github.com/rapidafi/la-mindmap
Youtube video from our first pilot project funding round, i.e. ideation
phase: https://www.youtube.com/watch?v=zAmFmfNaWYo&t=4s
12.6.2018
15

16. We at #EUNIS18
12.6.2018
16
Ville Kivimäki
ville.kivimaki@aalto.fi
@VilleKivi
Joonas Pesonen
joonas.pesonen@rapida.fi
@Japesone
Tomi Kauppinen
tomi.kauppinen@aalto.fi
@LinkedScience