This presentation was about the development of indicators for measurement of KT within KBHN NCE's KT Core, and the associated database created in order to track data and generate reports for use in progress reporting to the NCE and to inform internal management decision-making. A handout was provided in conjunction with this presentation, for attendees to use to create their own indicator definitions (also uploaded to slideshare).

1. www.kidsbrainhealth.ca
Anneliese Poetz, PhD – Manager, KT Core
David Phipps, PhD, MBA – Lead, KT Core
Renee Leduc, MSc – Program Officer, NCE Secretariat
Mobilizing Science Knowledge and Research: NCE Sharing of Best Practices Symposium
Thursday January 29, 2015 11:00am – 12:00pm (Sable Room A -D)
Halifax, Nova Scotia

2. Outline
1. What is KBHN, KT Core
2. Evaluation, KT Core
3. Tool Development Process & Lessons Learned

3. 1. What is KBHN, KT Core

4. What is KBHN
• FASD, CP, ASD
• NI, NE, KT
• KTEE
• HQP

5. KT Core
“KT maximizes the impact of research and
training in neurodevelopmental disorders”
Services for researchers and trainees in NDN
1. Knowledge Brokering
2. KT Events
3. KT Products
4. Evaluation
5. KT Planning

6. 2. Evaluation, KT Core

7. Role of Evaluation
How are the KT Core services helping KBHN
researchers & trainees?
How have we made a difference for children with
NDDs and their families, in Canada?

8. Evaluation Framework
Phipps, D. (2013)

9. Indicator Definitions
Research Dissemination Uptake Implementation Impact

10. Anatomy of indicator
Definition components
1) Name/title of indicator
2) Definition (including N/D if
applicable)
3) Type
4) Rationale
5) Strengths/Limitations
6) Data Source(s)
7) Stage in CPPI
8) Date
9) Responsibility for collecting
data
Example
1) [CB] % increase in knowledge
2) Sum of scores/#attendees x 100
3) Impact
4) Measure knowledge gained
5) S: measures change/impact,
L: bias & missing data
6) Pre-Post questionnaires
7) All
8) May 28, 2014
9) KT Core

11. 3. Tool Development Process
& Lessons Learned

12. Process
• Map services onto CPPI evaluation framework
• Define indicators for tracking each service
• Design and develop database for tracking
• Fully define indicators

13. First System
-Excel-
1) To enable tracking of service data (indicators)
Database/system requirements:

14. First System
-Excel-
1) To enable tracking of service data (indicators)
Database/system requirements:

15. First System
-Excel-
1) To enable tracking of service data (indicators)
Database/system requirements:

16. First System
-Excel-
2) To map services onto CPPI framework
Database/system requirements:

17. First System
-Excel-
2) To map services onto CPPI framework
Database/system requirements:

18. Updated (current) System
-Access-
1) To enable tracking of service data (indicators)
2) To map services onto CPPI framework
3) Must be easy to enter data
4) To generate useful reports (analysis)
i. To report data within date constraints
ii. To capture and report “Dan #” vs “David #”
iii. To capture and report what we did for each service
(part of def’n)
5) Must be able to add services/indicators as KT
Core & services evolve (long-term req’m)
Database/system requirements:

19. Updated (current) System
-Access-
3) Must be easy to enter data
Database/system requirements:

20. Updated (current) System
-Access-
4) To easily generate useful reports
Database/system requirements:

21. Demonstration

22. Take away messages
1) Have an evaluation framework to position your
indicators
2) Define indicators to the fullest extent possible
3) Define requirements for your database/system
4) Be willing to revise the system as new
requirements become apparent

23. www.kidsbrainhealth.ca
Questions?
Anneliese Poetz, PhD
Manager, Knowledge Translation Core
Kids Brain Health Network
apoetz@yorku.ca

24. Services Onto Framework

25. Services Onto Framework

26. Data Collection