Welcome to the Instructional Design: The Looking Glass of Learning blog


Welcome to the Instructional Design: The Looking Glass of Learning blog. Although we will not be discussing the theories behind Lewis Carroll's meaning of Alice's adventures beyond the rabbit hole, we will however be able to take this opportunity to share educational feedback, theories and philosophies pertaining to Instructional Design, learning practices and ideologies openly.



The purpose of this blog is to keep our creative thoughts following and partake in thought provoking discussions that allow each us to learn even more about ourselves, one another and the worlds in which we teach and learn.



Making eLearning Design Look Easier

Thursday, March 10, 2011

Learning from a Project “Post-mortem”

Upon the conclusion of any project, questions may be raised regarding the actual effectiveness of the implementation. In The Project Management Minimalist, Greer (2010) raises various post-mortem questions regarding the project, its effectiveness, and thoughts surrounding best practices and better approaches for the next release (p. 42-43). Referencing some of these questions, the following provides a high-level post-mortem analysis for a project executed and implemented for a regional supply chain customer service organization.

In January 2010, the regional Customer Service Centers were faced with a massive overhaul in system integrations and upgrades. Such changes prompted differences in business with customers as well as daily business processes. By March 2010 the return rate increased 3 times more than the previous year. With raised concerns, the Returns Business Process Owner raised the task in determining the reason for such an influx and how the data translated into a quality performance metric. Through data validation two areas of opportunity were identified: training and system functionality. From a training perspective, it was identified that the Associates required cognitive skill building in the area of customer returns. The training session were scheduled in June through July 2010. Each session was structured in three two-hour blocks and delivered by one instructor and facilitator daily. To drive learner engagement, the sessions focused on cognitive skill building through interactive group activities and open forum discussions. Due to the limited timeframe, the training was delivered without performing an initial needs assessment or conducting a formal evaluation phase. At the conclusion of each training session the associates were asked to complete a reaction survey on a non-mandatory basis (Evans, 2010).

From a general overview of the project, there were many identified successes. Many of the completed reaction surveys reflected extremely positive reactions and feedback regarding the approach to the subject matter and training environment. Many times, training sessions conducted for the organization were instructor-led and highly didactic. To promote learner engagement, the sessions took on the structure similar to an open forum, or outlet, for the associates to discuss concerns or regarding the returns process among peers which promoted engaged discussions allowing the chance to dispel misconceptions and provide insight on how to effectively and efficiently approach the varying customer situations when managing returns. Because of such an approach, learner engagement was higher than expected driving success in the area of interpersonal skill building, collaboration, and communication. To drive deeper engagement, learners were further stimulated by viewing “how to” directed video podcasts. The podcasts served a dual purpose. One purpose of the podcasts were to engage the learners visually and in an auditory manner to potentially commit the process to memory, and the second purpose was to allow the learner to have access to the podcasts for later retrieval for self-learning, and/or reinforcement, sessions.

Conversely this approach also created a greater possibility in training variances. Although the training was led by a primary instructor with rotating facilitators, at times the posing of different questions from session to session caused a slight deviation from the prepared materials and training session structure.Yet, the most challenging aspects of the project were in making the attempts to draw out cognitive reasoning in relation to the processes. It was unfortunate that during the information sessions, the Return BPO was unable to provide any insight regarding the intricate processes and how each impacts the site (local) or regional model. Taking this into consideration, it would have been ideal to schedule mandatory meetings with the BPO to ensure all pertinent information was being addressed and the processes were aligned with the intended regional model.
Another identified area of opportunity was in direct relation to the lack of a needs assessment and a formal evaluation. Due to time constraints, the conduction of a needs assessment was curtailed eliminating visibility to any learner weaknesses and/or strengths to aid in the design and delivery of the training. Assumptions were high in the area of delivery, being certain to steer away from a traditional method of delivery (i.e. didactic) versus the more unconventional method (i.e. open forum). Although the collected reaction surveys identified this as a success, it masked any underlying issues for those associates that were not readily active during the sessions or may not have comprehended the information being delivered. To rectify this issue in future trainings, a mandatory reaction survey will be conducted prior to and after the sessions to set the tempo and gauge the best approach for those attending each session.

In retrospect, the project lacked project management. Portny, et al. (2008) urge consideration of whether a project should begin before moving forward with any aspect of the project at all (p. 77). If it has been determined to proceed with the project, than unlike the manner in which the returns project was handled, it is essential to establish, or define, a plan. Although the overall concepts were presented, the returns project lacked a firm and formal plan. For instance, the involvement of other team members would have alleviated strain on the primary instructor and would have level set expectations regarding deliverables and goals. As noted by Portny, et al. (2008), it is ideal to “Prepare a separate description of needs for each category of personnel to be recruited” (p. 85). Doing so provides transparency to the needs and responsibilities of those actively involved in the project and promote organization and efficiency. With such lessons learned, it is recommended, regardless of how small or large of a project that project management be highly considered.


Resources

Evans, R. (2010, August 11). The importance of evaluation [Msg 1]. Message posted to http://sylvan.live.ecollege.com/ec/crs/default.learn

Greer, M. (2010). Project “post mortem” review questions. In The project management minimalist: Enough PM to rock your projects!. Retrieved from http://sylvan.live.ecollege.com/ec/courses/56611/CRS-CW-4894953/educ_6145_readings/pm-minimalist-ver-3-laureate.pdf

Portny, S. E., Mantel, S. J., Meredith, J. R., Shafer, S. M., Sutton, M. M., & Kramer, B. E. (2008). Project management: Planning, scheduling, and controlling projects. Hoboken, NJ: John Wiley & Sons, Inc.

4 comments:

jdedden said...

Response to Renee Evans

Hi Renee, You stated that the training sessions were conducted in a open forum context. Was it difficult to keep the conversations on track? I think that approach works very well in certain situations. For example, having a decent amount of pre-requisite knowledge among a group of learners can lead to educational conversations that are focused on the objectives of the training. But I have also experienced an open forum get completely off track. It turned more into a complaint session, causing a lot of learners to disengage.

Justin

WebsterDesigner said...

Renee,

I think that your evaluation of the project is very thorough and well-considered. Agreed, delineating and defining peoples' responsibilities keeps people accountable. For that matter so do establishing checkpoints (for the project manager, especially), and, during discussions, establishing roles such as a "timekeeper."

Lisa

Just, Rita said...

Hello Renee...

At least you were able to receive some formative observation; it sounds like they received some really good training, even though some information was not provided.

Thank you for your post; I hope I read it correctly.

Rita

Renee Evans said...

Overall the project was successful. Yet there are continuous concerns regarding the returns module, training, and the related processes. Ironically, there was a request for a regional retrain based upon a potential change in process to steer away from working smart and lean based upon "recently" identified issues relating to credit and warehouse management.

It becomes discouraging at times, in such cases, when the business owner does not understand the overall process nor cares to get to a point where they can have educated discussions from regional perspective.

So to each of your points, there was an area of success, but there the concerns are so deeply rooted this will always be a learning opportunity until a positive change is put into place.