Using Metrics that Matter to Embrace our Mobile/Social World
•Download as PPTX, PDF•
1 like•749 views
It’s a mobile and social world—make sure your measurement solutions are keeping up. Get a look at the brand new Metrics that Matter® Mobile app that helps employees find the learning that will have the most impact on their jobs. Understand the experience your students are having if they complete their evaluations on their smartphone. See demonstrations of Metrics that Matter® functionality for measuring the impact of your informal and social learning platforms and programs, as well as how to shift your learning and talent analytics into the mobile/social realm.
Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (15)
Recently uploaded
Recently uploaded (20)
Using Metrics that Matter to Embrace our Mobile/Social World
- 1. Using Metrics that Matter to Embrace our Mobile/Social World 9 January 2014 Jeff Grisenthwaite VP, Operations
- 2. Purpose Tour of Metrics that Matter tools & features to help you: 1. Leverage mobile/social technologies in your measurement approaches 2. Measure effectiveness & impact of mobile/social programs & platforms
- 3. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 4. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 7. Scrap Learning Typical Company 50% MTM Client Average within 6 Months Not relevant MTM Client Average Already knew info 33% MTM Top 25% MTM Top 5% Not practical 18% Bad timing 10% 38%
- 9. Metrics that Matter Mobile Free App for Android & iOS Quick and easy class search Course reviews with star ratings & comments
- 10. Search by Topic or Training Location
- 11. MTM Feed: Classes, Ratings, Comments
- 12. How Do I Get It? Implement for Your Organization Free! Ready within 2 weeks Contact KnowledgeAdvisors team: 1. Logo 2. Email domains 3. Schedule of future classes Free App Download for Employees: Search App Store or Google Play for Metrics that Matter
- 13. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 14. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 15. Your Need Course evaluation feedback is available here Your employees or customers are here
- 16. Bridge the Gap with Web Services Course evaluation feedback is available here Web Service Data Transfer Industry standard On-demand Your employees or customers are here
- 17. MTM Course Data Points Data Point Description Overall Average Score Overall Average Score for the Course N-Count Number of Respondent for the Course Number of Evals for each scale header Based on Overall Evaluation score, number of respondents for each scale value Overall Eval Score Overall Average Score for each Eval Qualitative Data Comments for each Eval for the Course Demographic Answers Demographic associated with comments
- 18. Course Star Ratings Example 1
- 19. Course Star Ratings Example 2 microsoft.com/learning
- 21. Get Started with Star Ratings Web Service Discuss with your KnowledgeAdvisors team $2,500 one-time setup fee Configuration within your system to: 1. Receive web-service 2. Display as desired
- 22. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 23. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 24. Collect Evaluations on SmartPhones Maximize response rates by collecting class & conference evaluations on laptops, tablets, AND smartphones
- 26. Conference Evaluations Laptop / Tablet Smartphone
- 27. QR Code to Complete Evals
- 28. Smartphone Tracking How are your learners completing evaluations? Web Paper Import from another system Smartphones Data Download Report:
- 29. Get Started with Mobile Optimized Evaluations As a follow up to this webinar, you’ll receive a guide to the Metrics that Matter smartphone experience Free and easy to enable for your evaluations Interested in evaluating conferences and not doing so today? Talk to your KnowledgeAdvisors account team
- 30. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 31. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 32. What Social Learning to Measure? 1. Programs with large investments Performance support systems Knowledge sharing systems Mentoring programs Communities of practice 2. Solutions replacing formal learning Content portals Knowledge Bases
- 33. When to Measure? At the conclusion Email Periodically Pop-Ups 5. Complete and/or recommit 1. Become aware / consider 4. Use, learn , practice, contribute 2. Search, access, sign in or join 3. Engage At each interaction Micropolls
- 36. Where Else Have Clients Added Micropolls? SharePoint Salesforce.com Simulations Intranet Portals Public websites
- 37. What to Measure? Solution Experience Benefits Availability/ Accessibility Value / Belonging Business Results / ROI Fulfills objectives Quality Performance impact Effectiveness Engagement Application to the job Usability Right solution for needs Professional growth Support Systems (Manager, Resources, Rewards)
- 38. Social Learning Analytics Report By: Author/Creator Content Type Content Name Delivery Method Design Method Component Name Learning Need Learning Type
- 39. Get Started with Social Learning Measurement 1. Assess your amount of social / informal learning 2. If significant, assess level of measurement 3. If it’s limited or only volume-based, talk to your KnowledgeAdvisors team about adding on the Social Learning Measurement module 5. Complete and/or recommit 4. Use, learn , practice, 1. Become aware / consider 2. Search, ac
- 40. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 41. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 45. Get Started with the MTMDashboard App Requires subscription to Dashboards You will receive the easy setup steps as a follow up to this webinar: 1. Create (unlimited) Mobile Users via Admin account 2. Assign Dashboard Views to Mobile Users 3. Download MTMDashboard from the iPad App Store
- 46. Select the right learning experience Assess learning effectiveness Metrics that Matter Mobile App Mobile-Optimized Evaluations Course Star Ratings Web Service Social Learning Measurement Report on results iPad Dashboard
- 48. Thank You! Jeff Grisenthwaite Contact me to: VP, Operations +1 312.676.4450 jeffg@knowledgeadvisors.com Get advice View a demo Receive these slides knowledgeadvisors.com
Editor's Notes
- PurposeIntended for Metrics that Matter users, as well as those considering subscribing to Metrics that Matter
- Agenda
- Before I go to a restaurant, buy a product, or watch a movie, I always check reviews first. Life is too short to waste—we leverage the experiences of others to avoid bad experiences.
- But when it comes to selecting the optimal learning event, we make regularly make these choices blind.
- The result is scrap learning: time that employees are spending in training events for which there is no new knowledge or skills applied back on the job. Estimates from multiple sources place the average scrap learning of organizations at 50% or more.What if there was a way to stop scrap before it starts?
- Enter the Metrics that Matter Mobile app for learners.
- Questions?
- You have great data in Metrics that Matter about the effectiveness and impact of your courses. But your employees, partners, and customers live in other systems.
- We can bridge that gap and unlock more potential in that data by using a web service to serve that course evaluation feedback to your learners in the systems that they use every day.
- The web-service can pass a number of different useful data points, including scores, comments, and key demographics.
- Here’s an example of what you could do with that data. Imagine displaying this wealth of information to your potential learners before they select a class. Seeing not only the overall scores, but also comments that are identified by meaningful demographics like tenure or role, will help learners to make better decisions in selecting classes that will be impactful for their jobs.
- Here’s another example that you can visit. For the thousands of customers who are planning to take Microsoft training every year, after clicking Find Training…
- They’re able to see the customer feedback in star ratings based on Metrics that Matter scores for each of the training providers.
- Questions?
- To get the highest response rates for your evaluations, you need to provide every possible avenue for people to provide feedback. In this day and age, you HAVE to provide a mobile option. Luckily that’s built right into Metrics that Matter as a standard option on all your evaluations. When publishing just choose to Optimize for smartphone users. This won’t change the experience for those on laptops and tablets, but when accessing on SmartPhones, it will reduce the number of graphics to download and optimize the layout for the smaller screen size.Apple, Android, Windows, and Blackberry phones are all supported.
- Here are examples of what each of the different possible pages in the class evaluation process look like on SmartPhones. Note that you might just jump right to the evaluation today. If so, that exact same experience would occur on SmartPhones.
- Where clients have found mobile evaluations to be particularly helpful is for conferences. After each session, the speaker can ask the participants to provide a quick rating and comments for the session on their phones before they head to the next session. The conference organizers get real-time feedback with high response rates.
- In addition to using simple URLs and emailing out links to respondents, you can also now generate Quick Response or QR Codes for each evaluation. Display these in PowerPoints or print them in materials to provide another avenue for learners to access evaluations.
- Finally, if you’re taking all these steps to enable smartphone data collection, you’re going to want to know how much of your data is coming from mobile devices. In the Data Download, now, you’ll see SmartPhone listed as an entry method alongside Web, Paper, and imports from other systems.
- Questions?
- Informal and social learning might be hot topics of late, but they’ve been going on since the beginning of time. Whenever one person provides guidance or info to another, a bit of social learning is going on. But do we need to measure those interactions? Not likely.Instead, we recommend focusing your measurement in 2 areas:
- One of the most critical items to think through in social learning measurement is at what point in the process does measurement make the most sense? Metrics that Matter supports multiple measurement vehicles that correspond to each of the points.Micropolls are useful to get feedback at each interaction, and I’ll show an example in a moment.Pop-up surveys, that I’m sure you’ve seen before, can be useful for gathering in-depth feedback from users.And email-based surveys can be distributed periodically or at the conclusion of a program to users, as well as non-users.
- Earlier this year, KnowledgeAdvisors established a Strategic Partnership with Triple Creek, the leading provider of enterprise social learning and knowledge sharing software.
- This is screenshot of their cloud-based social learning software, River. In the lower right corner, you see an example of a Metrics that Matter micropoll. Micropolls are single question surveys that you can embed into your learning platforms. The micropolls can pull from a question bank, so you can get feedback on a range of topics while only presenting each learner with a single question.It’s a great way to get real-time feedback at the point that users are interacting with your social learning platforms.
- Clients have added micropolls to a wide variety of platforms…
- When you implement the Social Learning module, you unlock a range of new types of items to report on: authors, content type, and design method are a few examples. This allows you to analyze the effectiveness and impact of each of your informal and social learning platforms and programs utilizing the same reports that you’re accustomed to using to analyze formal learning.
- Questions?
- The MTMDashboard iPad app is a free download that enables you to extend the reach of your Metrics that Matter dashboards. The most common use of this that we see from clients is to get their strategic Metrics that Matter data into the hands of executives.
- The MTMDashboard app enables you to include all the data visualizations that you have in your web-based dashboards, but in a friendly touch-based form. Users can swipe through the automatically updated data and mark key widgets as their favorites.
- When you touch a widget, you get a zoom-in view that can include a detailed analysis of the data.
- Questions?
- Qualcomm is giving a breakout on March 3 on mobile learning and learning measurementThere is a panel on March 4 to discuss mobile learning and learning measurementWe will have a mobile app of the event and we will use the conference technology during the event to augment the mobile experience.
- I appreciate your time today and I hope this was helpful to you to learn more about leveraging mobile/social capabilities of Metrics that MatterAND measuring effectiveness & impact of mobile/social programs & platforms.At this time, I’ll stay on the line to take any questions you may have. If you do not have any questions and need to run, you’re welcome to drop off. Thank you!