Jeff Dieffenbach, Associate Director, MIT Integrated Learning Initiative (MITili)
Matt Valencius, Manager, Offering Management & Learning Design: IBM Learning
Our observation of outcomes in a wide array of learning settings suggests learning has a profound impact in the lives of many workers; however, we find there are a limited number of tools that help us assess learning’s contributions to such outcomes. We would like to build additional tools by expanding our foundational knowledge by creating/conducting the following:
An inventory of behaviors to measure and, for each, describe a measurement methodology.
Literature review of “21st century skills” (creativity, problem-solving, communication, collaboration, others desired) and existing measurement approaches, if any. Existing measurement approaches would be improved and, where necessary, new measurement approaches would be created.
Literature review of “leadership skills” (management, public speaking, decision-making, negotiation, likely numerous others) and existing measurement approaches, if any. Existing measurement approaches would be improved and, where necessary, new measurement approaches would be created.
Key Questions to Explore
How do we measure the right thing [learning outcome] at the right time?
How do we measure level 3 (behavior) and 4 (results) of Kirkpatrick’s scale?
How do we measure leadership, problem-solving, and learning agility?
How do we tell an effective measurement story (for learners, stakeholders, leaders)?
Should we have consistent workplace measurements and standards?