ASTDBR Monthly Meeting: WEBINAR - Crack the Code of Test Question Design and Take your Level 2 Evaluation to 2.5!

Take Your Level 2s Up a Notch: Learn How to Measure Application Not Just Recall

According to a 2009 ASTD research study, 81 percent of organizations evaluate some learning programs at Level 2 of the Kirkpatrick/Phillips five-level evaluation model. Yet only 55 percent view the data they collect to be valuable.  Why the disconnect? One answer is that most WLP professionals are not savvy in the art and science of test creation and develop questions that are either too simple or overly difficult. In addition, they often only develop questions that test knowledge or recall and not application of what was learned. The result is that business executive stakeholders don’t view the data as credible and WLP professionals fail to collect valuable information on whether learners can apply back on the job what was learned.

In this session, you will examine the most common methods for conducting Level 2 evaluations, assess the common mistakes made by many WLP professionals when creating multiple choice test questions for Level 2 knowledge tests and learn twelve tips for creating valid, scientifically sound multiple choice questions that measure job application and not just recall.

Learning Objectives:

• Examine 12 common mistakes made when creating Level 2 multiple choice test questions and tips on how to prevent them.
• Analyze the critical difference between multiple choice test questions that test for application and those that test for recall.

About the Presenter:

Ken Phillips is founder and CEO of Phillips Associates, a consulting company with expertise in performance management, measurement and evaluation of learning and sales performance. Ken has more than 25 years experience designing learning instruments and assessments and has authored more than a dozen published instruments. He also regularly speaks to American Society for Training and Development (ASTD) groups and university classes. For the past four years, he has spoken at the ASTD International Conference on topics related to measurement and evaluation of learning.

Prior to pursuing a Ph.D. in the combined fields of organizational behavior and educational administration at Northwestern University, Ken held management positions with two colleges and two national corporations. In addition, he has written articles that have appeared in T+D magazine, Training Today and HR.com.

Currently, Ken is serving his eighth year on the board of directors of the Chicagoland Chapter of the American Society for Training and Development (CCASTD), and was chapter president in 2008. He earned the Certified Professional in Learning and Performance (CPLP) credential from national ASTD in 2006 as a pilot pioneer and was re-certified in 2009. Ken is also certified in Measuring and Evaluating Learning and Test Design and Delivery by ASTD and in the Kirkpartick Four Levels TM Evaluation. In January 2009, he also was appointed to serve a three-year term (2009-2011) as a member of the ASTD National Advisers for Chapters (NAC) committee.

Meeting Schedule:

Online information will be provided to registered attendees by e-mail before the event.

Meeting starts at: 12:00 PM