E-learning Goals

The e-learning should accomplish the following:

• Increased confidence from managers that they are able to complete their role effectively
• Increased satisfaction from team members of manager
• Increased retention in manager roles
• Increased retention in employee roles on teams who have managers complete the training

Kirkpatrick Levels

Level 1 Reaction – learners will rate the training as favorable

Level 2 Learning – learners will have increased knowledge on how to perform their manager role

Level 3 Behavior – learners will have increased confidence to effectively complete their role, and increased satisfaction from team members

Level 4 Results – learners will have increased retention rates in manager roles, and there will also be increased retention in employee roles on teams of the managers completing training

Assessment Techniques and Tools

Assessment Techniques

• Whether you will include formal grading; if not, why not?
  • I will utilize rubrics, but I don’t believe I will use formal grading. I want the experience to be customizable with certain “achievements” to hit, but with soft skills, it can be tricky to grade.
• How learners will know how well they are progressing in your course (formative assessment)
  • I would like to have feedback built into the course as much as possible. In my initial project plan, I also had some scenarios where they will submit certain portions of a course to a SME, and eventually have a meeting with them to discuss (such as building a one-on-one as an assignment). For things that are submitted to SMEs for review, I can build a rubric so they know the best way to complete the “assignment”.
• How learners will know whether they have successfully completed your course (summative assessment)
  • There will be an assessment at the end to test knowledge. For the more subjective areas, they will fill out a self-review for further discussion with the SME to ensure they feel they are confident to go on in their new role.
• How you will address validity and reliability of your testing instruments
  • I will ensure the questions, assignments, and automated feedback are delivered to everyone in the same way, and that participants will answer in the same way for reliability. For validity, I will ensure that questions and rubrics are crafted appropriately in order to measure the leadership/management skills I want to measure.
• Type of knowledge (declarative vs. procedural knowledge) you will test and why
  • I would like to test both declarative and procedural knowledge. Declarative through them learning concepts, and procedural in being able to apply some of those concepts.
• Whether the assessment tool captures qualitative or quantitative data and why that’s most appropriate for your course
  • It will measure both. There will be some multiple choice answers and the amount that they get correct would be quantitative data. However, given that this is about practicing soft skills, we’ll be measuring qualitative data as well through the assignments and longer form responses.
• What role the online instructor will play in assessing your course. If no online instructor is used, how will learners receive feedback on their performance?
  • The instructor/SME will assess submitted assignments and provide feedback. They will also meet with the learner in a one-on-one meeting as mentioned above.

Assessment Tools

• Description of the types of electronic assessment tools you’ll use in your course. It should be clear from your description why these tools are the best choices for your course;
  • I will utilize Google Forms for the assessment at the end of the course. This is the best choice for my course as google encompasses multiple choice questions, as well as extended response questions that SME’s can have access to. I will also use Google Forms for employees to assess their manager, as well as managers to assess themselves.
• Example of an item from each kind of assessment (the example can be described, it does not have to be produced in the tool)
  • Multiple choice
    • One of your direct reports is often gossiping about another member of the team during one-on-ones. It’s not related to their quality of work, the gossip is surrounding their personal life. What do you do?
      • Join in – you love a good gossip session!
      • Redirect the conversation
      • Abruptly end the conversation -they should not be discussing these things with you!
      • Ignore the gossip as it happens time and time again
  • Extended response (which will be graded based on rubrics)
    • “Based on what you have learned about leadership and management qualities, please write about 3 areas of strength as qualities you have, as well as 3 areas of improvement. For each area, provide an example of why you believe this is a strength or area of improvement. Then, provide how you plan to continue implementing this quality (areas of strength) or how you plan to improve on this quality (areas of improvement).”
  • Assessment of Manager
    • How likely are you to approach your manager when you are unsatisfied about something in your role?
      • Very Unlikely
      • Unlikely
      • Neutral
      • Likely
      • Very Likely
  • Assessment of Self
    • Since taking the course, how confident have you felt in your ability to identify strengths within yourself and areas of improvement related to management and leadership?
      • Not Confident
      • Slightly Confident
      • Somewhat Confident
      • Fairly Confident
      • Completely Confident
• URLs to any electronic tools you’re using that are accessible online

https://www.google.com/forms/about/

Questionnaire

The following questionnaire will be given after the training is complete, as well as their assessment. Their assessment will be identifiable to the manager, however the questionnaire is anonymous in order to improve the training.

1. How would you rate this training?

Very favorable

Somewhat favorable

Neither favorable nor unfavorable

Somewhat unfavorable

Very unfavorable

2. Please list 3 things you have learned after taking this course.

3. Since taking the course, how confident have you felt in your ability to identify strengths within yourself and areas of improvement related to management and leadership?

Not confident

Slightly confident

Somewhat confident

Fairly confident

Completely confident

4. Picture yourself one month from now. After taking this course, what is the likelihood that you would leave this role specifically due to a lack of training and knowledge on how to be a manager?

Extremely unlikely

Unlikely

Neutral

Likely

Extremely likely