Title: Social Epistemic Cognition in Engineering Learning: Theory, Pedagogy, and Analytics
Speaker:
Prof. Rosanna Yuen-Yan Chan, Member-at-Large, Board of Governors, IEEE Education Society
Department of Information Engineering, The Chinese University of Hong Kong
Time:
14:15-15:15, 9 June 2018 (Saturday)
Venue:
Rayson Huang Theatre, The University of Hong Kong
Sub-theme:
Learning design and learning analytics
Chair:
Dr. Gary Wong, Faculty of Education, The University of Hong Kong
http://citers2018.cite.hku.hk/program-highlights/keynote-chan/
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedagogy, and Analytics
1. CITE Research Symposium 2018
Keynote
Social Epistemic Cognition in Engineering
Learning: Theory, Pedagogy, and Analytics
Rosanna Yuen-Yan Chan
Department of Information Engineering
The Chinese University of Hong Kong
9 June 2018
Rayson Huang Theatre, HKU
2. Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 2
Social Epistemic Cognition
Theory
Learning Analytics
Learning Design
(Implementation Case in
Engineering Education)
Agenda of My Talk
7. Engineering Education in the 21st
Century
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 7
(Image source: Computer Business Review)
8. Engineering Education in the
21st Century
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 8
(Image source: The United Nations)
9. • Engineering education communities demand for
research results that can inform about the
collection and analysis of scientific evidence in
engineering students’ learning.
9Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018
Engineering Education in the
21st Century
10. Engineering Epistemology
• Engineering epistemology
is concerned with the
nature of engineering
knowledge (including the
technical, social, and ethical
aspects) and the ways of
engineering thinking (JEE,
2006).
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 10
Journal of Engineering Education (JEE). (2006). Special report: The research
agenda for the new discipline of engineering education. Journal of
Engineering Education, 95(4), 259–261.
11. Let it be assumed that there are five
qualities through which the mind
achieves truth in affirmation or denial,
namely techne (craftmanship/art or
technical skill), episteme (scientific
knowledge), phronesis (prudence),
sophia (wisdom), and nous (intelligence).
Aristotle, Nicomachean Ethics
(Book VI: Intellectual Virtues)
(Image source: Wikimedia Commons)
Harris Rackham (1996). Aristotle: The Nicomachean Ethics. Wordsworth.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 11
12. “Episteme” vs. “Techne”
• Scientific Knowledge (Episteme)
– What is scientifically knowable is learnable.
– Scientific knowledge can be communicated.
– For someone has scientific knowledge when he/she has the
appropriate sort of confidence, the origins are known to
him/her.
• Craftmanship / Art / Technical Skill (Techne)
– Craftmanship / art deals with bringing something into existence.
– To produce things deliberately in a way that can be explained.
– A craft concerned with things that are not exist by nature; its
origin is in the producer.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 12
13. What does it imply to
Engineering Education?
• Scientists investigate things which already exist;
• Engineers produce; based on true reasons; things
which do not exist.
– The three intellectual virtues: prudence (involves
judgment, understanding, and practical wisdom),
wisdom, and intelligence also play an important role
in the engineering profession.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 13
14. Graduate attributes of
engineering students
• A growing emphasis is being placed on engineering
graduates’ attributes by accreditation bodies,
employers, and also engineering students and
teachers.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 14
15. HKIE Graduate Attributes
(a) an ability to apply knowledge of mathematics, science, and engineering appropriate to the
degree discipline.
(b) an ability to design and conduct experiments, as well as to analyse and interpret data.
(c) an ability to design a system, component or process to meet desired needs within realistic
constraints, such as economic, environmental, social, political, ethical, health and safety,
manufacturability and sustainability.
(d) an ability to function on multi-disciplinary teams.
(e) an ability to identify, formulate and solve engineering problems.
(f) an ability to understand professional and ethical responsibility.
(g) an ability to communicate effectively.
(h) an ability to understand the impact of engineering solutions in a global and societal context,
especially the importance of health, safety and environmental considerations to both
workers and the general public.
(i) an ability to stay abreast of contemporary issues.
(j) an ability to recognize the need for, and to engage in life-long learning.
(k) an ability to use the techniques, skills, and modern engineering tools necessary for
engineering practice appropriate to the degree discipline.
(l) an ability to use the computer/IT tools relevant to the discipline along with an understanding
of their processes and limitations.
Engineering
Disciplinary Knowledge
and Skills
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 15
16. HKIE Graduate Attributes
(a) an ability to apply knowledge of mathematics, science, and engineering appropriate to the
degree discipline.
(b) an ability to design and conduct experiments, as well as to analyze and interpret data.
(c) an ability to design a system, component or process to meet desired needs within realistic
constraints, such as economic, environmental, social, political, ethical, health and safety,
manufacturability and sustainability.
(d) an ability to function on multi-disciplinary teams.
(e) an ability to identify, formulate and solve engineering problems.
(f) an ability to understand professional and ethical responsibility.
(g) an ability to communicate effectively.
(h) an ability to understand the impact of engineering solutions in a global and societal context,
especially the importance of health, safety and environmental considerations to both
workers and the general public.
(i) an ability to stay abreast of contemporary issues.
(j) an ability to recognize the need for, and to engage in life-long learning.
(k) an ability to use the techniques, skills, and modern engineering tools necessary for
engineering practice appropriate to the degree discipline.
(l) an ability to use the computer/IT tools relevant to the discipline along with an understanding
of their processes and limitations.
Holistic
Competencies /
Generic Skills
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 16
17. HKIE Graduate Attributes
(a) an ability to apply knowledge of mathematics, science, and engineering appropriate to the
degree discipline.
(b) an ability to design and conduct experiments, as well as to analyze and interpret data.
(c) an ability to design a system, component or process to meet desired needs within realistic
constraints, such as economic, environmental, social, political, ethical, health and safety,
manufacturability and sustainability.
(d) an ability to function on multi-disciplinary teams.
(e) an ability to identify, formulate and solve engineering problems.
(f) an ability to understand professional and ethical responsibility.
(g) an ability to communicate effectively.
(h) an ability to understand the impact of engineering solutions in a global and societal context,
especially the importance of health, safety and environmental considerations to both
workers and the general public.
(i) an ability to stay abreast of contemporary issues.
(j) an ability to recognize the need for, and to engage in life-long learning.
(k) an ability to use the techniques, skills, and modern engineering tools necessary for
engineering practice appropriate to the degree discipline.
(l) an ability to use the computer/IT tools relevant to the discipline along with an understanding
of their processes and limitations.
Practical Skills
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 17
18. Forms of Ethical and
Intellectual Development
• Nine-position scheme (Perry, 1970)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 18
Perry, W. (1970). Forms of ethical and intellectual development in the college
years: A scheme. San Francisco: Wiley.
The modifying
of dualism
The realizing of
contextual
relativism
The evolving of
commitment
19. Social Epistemic Cognition (SEC)
• Definition: SEC is a human individual’s cognition and
cognitive processes related to epistemic matters
when situated in a social context (Chan et al., 2014).
R. Y.-Y. Chan, S. Li, D. Hui, “Social epistemic cognition in online interactions,” In Proceedings of the ACM SIGCHI Conference on
Human Factors in Computing Systems (CHI), 2014, pp. 3289-3298.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 19
20. Social Cognition
• Reciprocal determinism (Bandura, 1986)
Behavior (B)
Person (P)
Environment (E)
(Social environments)
Cognitive,
affective, etc.
Bandura, A. Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice-Hall, Englewood Cliffs, NJ, USA,
1986.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 20
21. Epistemic Cognition
• Three levels of human cognitive processing on information during
open-ended problem solving (Kitchener, 1983).
– First Level: Cognition
– Second Level: Metacognition
– Third Level: Epistemic Cognition
• Epistemic beliefs predict students’ learning (e.g. Hofer and Pintrich,
2002)
Kitchener, K.S. Cognition, metacognition, and epistemic cognition. Human Development, 26, 4 (1983), 222-232.
Hofer, B.K. and Pintrich, P.R. Personal Epistemology: The Psychology of Beliefs about Knowledge and Knowing. Erlbaum,
Mahwah, NJ, USA, 2002.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 21
22. Epistemic Cognition (EC)
Framework
• 5-component EC framework (Chinn et al., 2011)
rooted in Epistemology in Philosophy.
• Chinn’s EC Framework
– Epistemic aims and values
– Structure of knowledge
– Source, justification, and epistemic stances
– Epistemic virtues and vices
– Process of achieving epistemic aims
• EC is driven by epistemic aims.
C. Chinn, L. Buckland, and A. Samarapungavan, “Expanding the dimensions of epistemic cognition: arguments from philosophy
and psychology,” Educational Psychologist, vol. 46, no. 3, pp.141-167, 2011.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 22
23. More about Epistemic Aims
Minimally justified belief
Propositional knowledge
Understanding
Knowledge construction
Attainment to truth
High Level
Low Level
∞
• Hierarchy of epistemic aims.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 23
24. Social Epistemology
• Emphasizes on the social dimensions of beliefs
formation, knowledge acquisition, and information
processing (Fuller 2002; Goldman, 1999, 2011).
• Goldman’s tripartite Social Epistemology Framework
(Goldman, 2011)
– First Variety of SE: Individual Doxastic Agents (IDAs) with
Social Evidence
– Second Variety of SE: Collective Doxastic Agents (CADs)
– Third Variety of SE: Systems-Oriented (SYSOR) SE
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 24
25. Social Epistemology (SE)
Framework – Entities (1)
• Individual doxastic agents (IDAs) which are
individuals.
• Their internal doxastic attitudes (or belief states) can
be represented by external social evidence resulted
from the acts of communication; such evidence
include pages of print or messages on computer
screens.
Individual Social evidence
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 25
26. Social Epistemology (SE)
Framework – Entities (2)
• Collective doxastic agents (CDAs) which are a group of
individuals who have rational doxastic attitudes toward
sets of related propositions.
• Examples of CDAs include juries and communities.
• CDAs can be represented by the collective social
evidence* produced by the collective individuals.
Collective
individuals and
collective social
evidence
*Subjected to group rationality.
Illustration figure inspired by Palmer, The Courage to Teach: Exploring the Inner
Landscape of a Teacher’s Life
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 26
27. Social Epistemology (SE)
Framework – Entities (3)
• Epistemic systems are social systems that maintain
social practices, procedures, and patterns of inter-
agent influences that affect the epistemic outcomes
of the members in the systems.
Epistemic System
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 27
28. Knowledge and Knowing in
Online Communities
• What knowledge and knowing can be within and across (online)
communities (Chan, 2016).
R.Y.-Y. Chan, "Social epistemic cognition and engineering students' collaborative learning in emerging areas: An
implementation case study in a course for social networking", in Proceedings of the IEEE Frontiers in Education Conference,
2016, Erie, PA.
29. Social Epistemic Cognition
Illustrated
• Social epistemic cognition in epistemic systems.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 29
SEC
30. SEC – Small Data Analyses (Chan
et al., 2014)
• SEC can be mediated by online interactions (Chan et al., 2014)
– Measured with 32-items Epistemic Cognition Instrument (ECI),
validated (N = 563)
– 4-month Human-Computer Interaction (HCI) user study (N = 205)
– Chi-sq/df = 1.62, CFI = .98, SRMR = .05
– Significant mediation effect (z = 1.78, p < .05)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 30
31. To what extent do social epistemic
cognition (SEC) influence engineering
learning in the 21st century?
How can we design meaningful
engineering learning experience to
foster and assess engineering
students’ SEC?
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 31
33. MOOC and STEM-Related
Learning
• Massive Open Online Course (MOOC)
– online course, open access via the web
– Large variety of courses in STEM subjects
Coursera
13,274,775 participants
1,042 courses, 119 partners
Began with “Machine Learning”
Code.org
The Hour of Code
118,579,607 served
48% girls
Khan Academy
140,568 participants
(as of 2014)
34. Coursera MOOCs offered by
Chinese University of Hong Kong
https://www.coursera.org/cuhk
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 34
35. Case Study One
(Ding, Zhong, Chan, 2015; Zhong, Ding, Chan, 2015)
• Machine Learning MOOC
– Andrew Ng from Stanford
University
Date Duration Number of Distinct
Participants in Forums
Session One
Session Two
Session Three
14 Oct 2013 – 23 Dec 2013
3 March 2014 – 26 May 2014
16 June 2014 – 15 Sept 2014
10 Weeks
12 Weeks
13 Weeks
4,720
3,797
3,802
Session Four 22 Sept 2014 – 25 Dec 2014 12 Weeks 2,422
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 35
Zhong, J., Ding, J. and Chan, R.Y.-Y. (2015). Large-Scale Learning Process Analytics in MOOC Online Discourses. International
Workshop on Learning Analytics, Technology Adoption, and Language Learning in the Big-Data Era (LATALL 2015). Taipei.
Ding, J., Zhong, J. and Chan, R.Y.-Y. (2015). MOOC Learner Participation Lifecycle: What Can be Found from Large-Scale Temporal Social
Network Analysis? International Workshop on Learning Analytics, Technology Adoption, and Language Learning in the Big-Data Era (LATALL
2015). Taipei.
36. Temporal Social Network
Analysis (SNA)
• Perform a temporal social network analysis (SNA)
on our data in a weekly interval.
– Nodes represent the distinct participants within the
MOOC discussion forums.
– Directed ties represent the responses to an online
discourse from one participant to another.
– 10 sociomatrices are constructed to respectively
represent the resulted social network in 10 weekly
intervals.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 36
38. SNA (Cont’)
Overall Sociograph (N = 4720)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 38
39. SEC – Content Analyses
• Developed an Epistemic Terms Dictionary
– Epistemic terms reflect the epistemic merit of a
statement (Chisholm, 2008)
– Our dictionary included 110 words that are related to
one’s epistemic engagement and justification.
– Developed by two researchers independently;
Cronbach’s alpha = .902
– Validated with small data (N=115) and confirmed
statistically significant relationship between
occurrence of epistemic terms in online discourse and
academic performance (r = .35, p < .005)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 39
40. SEC – Content Analyses
• Also produce:
– an keywords dictionary that indicates the concepts (by weeks)
learned from the course materials.
– A doxastic terms dictionary that contains word indicating beliefs
and attitudes (e.g. think, agree, disagree, etc.)
• Performed large-scale content analysis with Python and
Natural Language Processing (NLP) techniques.
• Each of the participants is represented by the discourse
he/she produced (α), with discourse scores calculated by:
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 40
41. SEC – Findings from MOOC
Content Analyses
• Occurrence of Week 1 to Week 5 keywords in discourse
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 41
42. SEC – Findings from MOOC
Content Analyses
• Occurrence of Week 6 to Week 10 keywords in discourse
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 42
43. SEC – Findings from MOOC
Content Analyses
• Epistemic Terms, Doxastic Terms, and First Week
Keywords (Fundamental Concepts)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 43
44. SEC – Findings from MOOC
Content Analyses
• Statistically significant relationship between
– epistemic terms and doxastic terms (r = .13, p < .001)
– epistemic terms and keywords (r = .15, p < .001)
– doxastic terms and keywords (r = .22, p < .001)
• Statistically significant relationship between
keywords and SNA indexes
– Outdegree (r = .05, p < .01)
– Indegree (r = .03, p < .05)
– Closeness (r = .13, p < .001)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 44
45. SEC in Engineering Learning:
Implementation Case in an
Undergraduate Course
46. SEC: Implementation Case in
Engineering Learning
• Student learning assessment can involve direct
and also indirect evidences.
• Based on the SEC framework, this course-level
implementation (Chan et al., 2017; Chan et al.,
2018) aims to collect and analyze direct as well as
indirect evidences of engineering student holistic
competencies at course level.
R.Y.-Y. Chan et al., “Direct evidence of engineering students’ generic skills learning: From research to practice in an
undergraduate course in information engineering,” in Proceedings of the IEEE Frontiers in Education Conference, 2017,
Indianapolis, IN.
R.Y.-Y. Chan et al., “Engineering Education for Sustainable Development and Global Citizenship:
A Course-Level Implementation Case in Hong Kong,” in Proceedings of the American Society for Engineering Education Annual
Conference and Exposition, 2018, Salt Lake City, UT.
47. Direct vs. Indirect Evidence of
Student Learning
• Indirect evidence (from which the fact can be inferred)
are collected by means other than looking at actual
student work.
– Offers signs that suggest students are probably learning.
– E.g., course evaluation, questionnaires on beliefs and attitudes.
• Direct evidence (evidence that support the assertion
directly without the need of any inference) are actual
student work evaluated using a standardized method or
rubric.
– Gives tangible and compelling indication that show what
students have learned.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 47
C. A., Palomba & T. W. Banta, Assessment Essentials: Planning, Implementing, and Improving Assessment in Higher Education.
San Francisco, CA: Jossey-Bass, 1999.
48. Direct Evidence of Student’s
Generic Skills Learning: The
Challenge
• While direct evidence of student learning are
often used to evaluate students’ mastery of
subject domain knowledge (e.g., assignments,
quizzes, final exam questions), its difficult to
collect direct evidence on students’ generic skills
learning.
How can I design assessment
items in my course to measure
students’ generic skills learning?
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 48
49. • Learning Outcomes
– (LO1) gain conceptual knowledge and theoretical
foundations in social media and human information
interactions and be able to apply them in explaining various
techno-societal phenomena.
– (LO2) be able to analyze and interpret social media contents
and social network structures.
– (LO3) be able to understand their professional responsibility
in sustainable development as information engineers.
– (LO4) be able to understand the impact of information
engineering solutions in a global and societal context.
– (LO5) be able to stay abreast of contemporary issues and
formulate professional recommendations and/or action
plans based on human information behaviours.
• Enrollment: 78 students majored in Information
Engineering and Computer Science (minor IE).
IERG3320 Social Media and Human
Information Interactions (2017-18)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 49
Generic skills/
Holistic
competencies
oriented
50. Implementation Case: Teaching
and Learning Context
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 50
Introduction
Social media and
HII
Environments,
elements, and
information
Big data for
sustainable
development
Recommendation
Systems
Information and
human cognition
Physical
Information
Semantic
Information
Natural language
processing
Digital
Information
Sentiment
analysis
Social media
analytics
Social Network
Analysis (SNA)
Big data
visualization:
Selected cases
from UNSD
Information
visualization
(1) Blog posting (week 1 to 8)
(2) Post commenting (week 2 to 10)
(3) Social Media & HII for SD (Submission deadline: week 12)
(4) Social Media Analytics (Submission deadline: week 14)
Conceptual
Knowledge
Practical
Knowledge
Assessments
TimeWeek 1 Week 14
Linkage between
conceptualand
practicalknowledge
Keys
Subjectknowledge
(5)Final
Examination
51. Social Media and HII for
Sustainable Development
(Group Project)
• Selected group project
topics (Policy Reports)
– Emission: An enemy of
modern world (SDG 3, 13)
– Urban-rural divide and
social media affordances in
market analysis (SDG 1, 4,
13)
– A charity mobile app for
access to safe water in
Kenya (SDG 3, 6, 9)
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 51
52. Measures
• The following direct and indirect evidences which
measure students’ generic skills were collected and
analyzed:
1. (Direct evidence) Blog post contents (as e-portfolios)
which include students’ own learning reflections and self-
collected external reference materials.
2. (Direct evidence) Online comments which reflects
students’ evaluation on their peers’ learning reflection (a
dataset with 1105 messages in course context).
3. (Direct evidence) Topological structure of the resulted
online social network (78 nodes and 1105 edges).
4. (Indirect evidence) Questionnaire on students’ beliefs
associated to SEC and collaborative learning.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 52
53. Social Network Analysis
(Direct Evidence)
• A blogger social network which is a directed graph
with 78 nodes and 1105 edges was established.
– The nodes correspond to the participating students
– The directed edge represents a “comment to” relationship
between a comment provider and a comment receiver.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 53
55. Student SEC Beliefs and Collaborative
Learning (Indirect Evidence)
• Descriptive statistics (students’ beliefs associate
to SEC and Collaborative Learning)
Note: Cronbach’s alpha values for pretest and posttest items are 0.87 and 0.80, respectively.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 55
56. Relationship between Learning
Beliefs and Behaviors
• A significant relationship between SEC gains and
social networking behavior was identified.
• Participant out-degree was significantly
correlated to belief gains in justification of social
knowledge (r = .44, p < 0.05) and social epistemic
virtues (r = .41, p < .05), respectively.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 56
57. Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 57
SEC
Theory
Learning Analytics
Learning Design
(Implementation Case in
Engineering Education)
Engaging Learning
&
Empowering
Change
58. Takeaway 1
• Social epistemic cognition connects epistemic
cognition, social epistemology, and social
cognition.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 58
59. Takeaway 2
• Students’ intellectual virtues can be nurtured by
engaging them in self-reflection on their
professional role and identity.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 59
What is engineering and
what does it mean to me
as an engineering student?
60. Takeaway 3
• Students’ SEC can be promoted (and analyzed)
by establishing an online learning community.
Social Epistemic Cognition in Engineering Learning | Rosanna Yuen-Yan Chan | CITERS 2018 60
Thanks Dr. Gary Wong for your introduction. I also want to thank HKU CITE for organizing this Symposium, and the Education Chapter of the IEEE Hong Kong Section for inviting me to speak in this session.
The title of my speech is “Social Epistemic Cognition in Engineering Learning: Theory, Pedagogy, and Analytics”. Today, I have the privilege to meet many experts and educational researchers in learning theory, pedagogy, as well as learning analytics. While we share a common research interests in these aspects, I would like to bring your focus to something that might sound less familiar with you, namely (1) Social Epistemic Cognition and (2) Engineering Learning. Today’s talk is drawn upon my published as well as on-going research findings in engineering education; and also the first handed experience gained along my professional role as an engineering faculty member for more than ten years.
I am sure that everyone here should be able to pronounce this word that is made up of 4 letters, and know what does each of the letters stand for.
Even if it is written in this way, you can still pronounce it as STEM.
But if we take away the E, then it is an acronym with no vowel which cannot be said aloud.
In fact, STEM education may sometimes be presented as STeM education (written in this way; with a small letter “e”), where Engineering is often referred to as the hidden ‘E’ when STEM is considered in K12 schooling contexts. In fact, most of the school students and teachers do not have exposure to formal engineering education, and engineering is not offered as a major subject until undergraduate level. Therefore I would like to use the opportunity today to explore a little bit about engineering education itself, before I move onto Social Epistemic Cognition, and its corresponding pedagogy and analytics.
Contemporary engineering problems are often complex and multifaceted. Furthermore, challenges faced by the engineers are further intensified by the advent of new technologies such as AI, big data, and 5G communication networks.
It has been well said that education nowadays needs to prepare students for jobs, technologies, and problems that have not yet been existed or known. Engineering students in particular, are at the frontiers of technological innovations that drive the society of tomorrow.
Well-designed engineering programmes should articulate not only the ability to apply disciplinary knowledge to solving engineering problems.
Transdisciplinary capabilities such as an understanding of professional and ethical responsibility, and the understanding of the impact of engineering solutions in a global and societal context, etc. are also essential outcomes for engineering students.
For example, on 30 December 2015, The United Nations announced a set of 17 Sustainable Development Goals that attempt to address and solve global challenges crucial for the survival of humanity.
Engineering educators have been asked to take a leading role in ensuring that engineering graduates have corresponding attitude and competencies for sustainable development.
Epistemology corresponds to the theory of knowledge. It is the philosophical study of how an individual conceptualize knowledge, where it comes from, and how it originates.
The engineering education research community has included Engineering Epistemology in its research agenda.
In Book VI of Aristotle’s Nicomachean Ethics, he pointed out five types of stable dispositions that the soul can have, and which can disclose truth. Namely craft (techne), scientific knowledge (episteme), intelligence, wisdom and understanding.
Episteme and Techne can be respectively translated into scientific knowledge and craftsmanship.
Note that technê is the Greek root word of both technology and art.
Aristotle suggests that what is scientifically knowable is learnable.
and for someone who has scientific knowledge with confidence, the origins are known to him.
Craftsmanship, on the contrary, is concerned with the production of things that do not exist by nature and its origin is in the producer.
Furthermore, a craft involves true reasoning concerning the production.
Scientists investigate things which already exist;
Engineers produce; based on true reasons; things which has never been
The other three: prudence (involves judgment, understanding, and practical wisdom), wisdom, and intelligence also play an important role in engineering learning.
For example, practical wisdom is concerned about how one acts and it involves ethics and moral values that go beyond scientific or technical knowledge.
Practical wisdom is an intellectual virtue that is ‘reasoned and capable of action with regard to things that are good or bad for man’ (Nicomachean Ethics, 1144b33–1145a11).
Contemporary philosophers and virtue epistemologists have further discussed about the link between practical wisdom, intellectual virtues, and the achievement of epistemic goods such as knowledge, understanding, and justification.
A growing emphasis is being placed on engineering graduates’ attributes by accreditation bodies, employers, and also engineering students and teachers.
GA (a). an ability to apply knowledge of mathematics, science, and engineering appropriate to the degree discipline.
GA (b). an ability to design and conduct experiments, as well as to analyze and interpret data.
GA (c). an ability to design a system, component or process to meet desired needs within realistic constraints, such as economic, environmental, social, political, ethical, health and safety, manufacturability and sustainability.
GA (d). an ability to function on multi-disciplinary teams.
GA (f). an ability to understand professional and ethical responsibility.
GA (g). an ability to communicate effectively.
GA (i). an ability to stay abreast of contemporary issues.
GA (j). an ability to recognize the need for, and to engage in life-long learning.
GA (k). an ability to use the techniques, skills, and modern engineering tools necessary for engineering practice appropriate to the degree discipline.GA (l). an ability to use the computer/IT tools relevant to the discipline along with an understanding of their processes and limitations.
One of the emerging topics discussed by the engineering education research committee is to what extent do engineering learning experience influence cognitive and epistemological development of engineering undergraduates.
In seminal work such as that by William Perry, research shows students who can restructure their thinking get more out of their higher education and are much better prepared for their careers than those who do not.
According to Perry, students move away from dualism to contextual relativism and ultimately experience and develop their professional identity. The higher stages are highly related to intellectual virtues which involves responsibility and commitment. It is also noted that, according to Perry, his scheme is rooted in contextualistic-pragmatism and existentialism, rather than relativism. Where relativism, similar to dualism, is an intermediate stage experienced by the student along his or her transition.
Social Epistemic Cognition is a tripartite conceptual framework that I established and first published in the field of Human Computer Interaction.
It corresponds to a human individual’s cognition and cognitive processes related to epistemic matters when situated in a social context. It concerns about human cognitions and cognitive processes
directed by epistemic aims and in social settings.
Rooted in philosophical epistemology and also psychology, SEC offers a theoretical framework to explain various knowledge building activities such as knowledge co-construction and collaborative learning across small and big scales.
The three theoretical components of SEC are social cognition, epistemic cognition, and social epistemology. I briefly describe them one by one.
Kitchener distinguishes three different levels of cognitive processing on unfamiliar information from her study with postgraduate students.
Level 1: Cognition: individuals memorize, read, write, and perceive media
Level 2: Metacognition: individuals monitor and self-regulate their own progress when they are engaged in these first-order tasks
Level 3: Epistemic Cognition: individuals reflect on the limits of knowing, the certainty of knowing, and criteria of knowing
Later on, Clark Chinn and his colleagues performed an extensive literature review and conceptualized a 5-component EC framework.
1) Epistemic aims and values – concerns about what aims (e.g. true beliefs, understanding, or explanations that fit the data) one may adopt in conducting cognitive processes and the expected value of the resulting achievements.
2) Structure of knowledge – concerns with one’s view about the representation and the structural forms of knowledge which can be multifaceted and highly multidimensional (e.g. probabilistic vs. deterministic, simple vs. complex etc.). This component also intertwines with the one’s ontological beliefs about the structure of the world.
3) Source, justification, and epistemic stances – corresponds to the epistemic attitudes that one may take with respect to knowledge and truth. It also include one’s beliefs about the sources (i.e. the origin) of the knowledge claims and the reasoning about their beliefs.
4) Epistemic virtues and vices – concerns about the kinds of intellectual virtues one may exhibit (e.g. intellectual courage and intellectual carefulness versus epistemic vices), and how one might response to dilemmas related to intellectual virtues and obligations in social situations.
5) Processes of achieving epistemic aims – concerns about the processes (e.g. data analyses and methods of inquiries) one may conduct to achieve the epistemic aims, and the reliability of such processes.
The epistemic aims as discussed in the philosophy literature include minimally justified belief, propositional knowledge, understanding, knowledge construction, and ultimately the attainment, or at least the approximation, to truth. It goes from a lower level to a higher level; while a higher level epistemic aim require deeper cognitive processing.
For example, information seeking is an attitude associated to minimally justify beliefs; but it is also possible of us to shift from low level epistemic aims to high level epistemic aims such as the construction of new knowledge; especially when we can be able to find out the value associate to the task in concern. For example, why do I need to study a certain textbook in probability? You may approach the same task without different level of epistemic aims if it is only for passing the examination or if you want to understand more about probability in order to design a new algorithm of your own.
This picture further depicts what knowledge and knowing can be within a community of engineering students.
Social epistemic cognition refer to the cognitive interaction between human and information within the complex epistemic system.
I have developed an instrument for measuring SEC.
The tool has been verified and validated. It was also proven statistically that SEC can be mediated by online interactions.
However, because of time limitation today, please refer to my article for the details.
Given all these, I always have two questions in my mind.
To what extent do social epistemic cognition (SEC) influence engineering learning in the 21st century?
How can we design meaningful engineering learning experience to foster and assess engineering students’ SEC?
In the rest of the time I would like to share some of the findings of my previous work on learning analytics of SEC over MOOC big data.
Nowadays MOOC become a very popular mode of STEM education on a large scale.
CUHK also offer a few MOOC courses at Coursera, including the one for Information Theory taught by Professor Raymond Yeung from my Department with over tens of thousands of enrolled students.
My postgraduate students and I had performed learning analytics on one of the most popular MOOCs using natural language processing and social network analysis techniques.
We analyzed the first implementation of Andrew Ng’s Machine Learning MOOC. Which involved 4 thousands and 7 hundreds participants.
The participants have produced a total number of 26,961 online discourses.
We’ve performed temporal SNA in a weekly interval to identify the pattern of online social interactions amongst the MOOC learners.
We established a graph model in which the nodes represent individual participants in the MOOC forum.
And the directed ties represent the responses to an online discourse from one participant to another.
In the end, 10 sociomatrices are constructed.
In the end, 10 sociomatrices are constructed and these are the corresponding sociograms.
This slide list the temporal variation of centralities, and also the overall online social networks resulted from the forum discussions amongst the participants in Session One.
We’ve further performed content analysis using natural language processing method. We’ve constructed an epistemic term dictionary with 165 English words carefully identified from the philosophy literatures, including know, define, and understand.
It was developed by two researchers independently, with Cronbach’s alpha higher than .9 which indicate appreciable reliability.
We’ve further validated and identified significant statistical relationship between the term usage and academic performance.
We then apply our dictionary to perform content analysis on the Coursera discourse. Over 1 million of word have been processed by our Python programme.
These are the results showing the occurrence of keywords along time.
Interestingly, we found that the usage pattern of epistemic terms across the 10-week interval is very similar to the occurrence of keywords taught in Week 1. This pattern is not found in other weeks.
This suggest that when having online argumentation, participants usually quote the content they learn from Week One – which is the introduction to the subject.
Furthermore, we also found statistically significant relationship between the content and social network behavior (measured by centrality).
These results show how we can operationalize SEC in learning analytics, by utilizing online discourses as a meaningful representation of an individual doxastic agent’s SEC.
Lastly, I would like to share about how SEC have been effectively implemented in engineering teaching and learning at undergraduate course level.
The implementation was done in a course that I taught in 2017. Guided by the SEC framework, we aimed to define, collect, and analyze direct as well as indirect evidences of engineering student generic skills learning at course level.
Indirect evidence, such as course evaluation questionnaire, suggest students are probably learning.
While direct evidence (such as quizzes and written final examinations) show what students have actually learned.
In engineering, direct evidence are often used to evaluate students’ mastery of subject domain knowledge. However, it is difficult to collect direct evidence on students’ holistic competencies and generic skills learning.
So here is what I have done in my course.
Class blogs listing: https://ierg3320.wordpress.com/links-2017-2018-t1/
SEC provides a solid theoretical foundation explaining the students’ intention and the dynamics in knowledge-driven social interactions.
After going through the theory, analytics, and pedagogical design of SEC, I would like to wrap up my talk and to response to the symposium theme, Engaging Learning and Empowering Change” with a few takeaways.
Although the context of my case is in engineering education, I believe the pedagogy can be adapted and generalized to other academic disciplines.
SEC is a very rich construct that connects epistemic cognition, social epistemology, and social cognition. It covers philosophical components such as epistemic virtues, and relate an individual’s epistemic belief to his or her externally observable behavior.
SEC explains students’ intention in knowledge-driven social interactions; and enable inner epistemic beliefs to be detected and measured by external social evidence across different scales.
E.g., by writing a reflective essay on “What is Engineering and What Does it Mean To me As an Engineering Student?” or “What is education and what does it mean to be as a pre-service teacher?”
This can also help to promote students towards higher positions in William Perry’s scheme, such as Commitment.
E.g., Establish a class blogger community under a collective theme (such as sustainable development).
Perform learning analytics (e.g., social network analysis and content analyses).
Share the blogs to boarder audience such as international stakeholders. For example, I have informed my students that their blogs will be presented at the ASEE, which is the flagship engineering education conference with delegates from different countries. They are encouraged to write them even better.
Lastly, it is my sincere invitation to all participant, no matter which discipline you come from, to join hand together with the engineers, to engage learning and empower change in students from all disciplines, for a more sustainable society in the future. Thank you.