Smart evaluation

2013-04-09

When holding short courses (2-3 days), it's difficult for instructors and teachers to find answers to questions like

 -  How successful is/was my teaching?
 -  How well do/did the students learn the subject taught?
 -  How much do/did the students learn of the subject taught?

The ongoing iQVET project is currently developing a solution to this challenge.

The in-class communication, interaction and collaboration processes that may enhance effective peer learning processes, where students use their peers to learn, evaluate and validate, are difficult to measure by use of existing ICT technologies. Short and intense courses are frequently used to improve and update the working knowledge and skill set for professionals in industry or service organizations.

  • The short time that is available for the actual interaction between the trainer and the trainees makes it challenging for the teacher to assess trainees' level of knowledge related to the course material and the prerequisite knowledge required
  • The assessments and certification usually targets the amount of knowledge retained by the trainees immediately after the course rather than the amount of knowledge applied on the job a period after the course
  • VET teachers are currently unable to judge and assess on the fly the trainer`s reproduction, demonstration and performance of learning

The iQVET project is addressing new evaluation methods, by constructing, testing and applying a new model which will make it possible to mesure (by use of mobile technology)

  • Reaction evaluation: measures trainers pre-knowledge and how they thought and felt about the training and learning experience
  • Learning evaluation: measures the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
  • Behaviour evaluation: measures the extent of applied learning back on the job (implementation of knowledge)

The learning and evaluation process is going to include four disruptive evaluation-learning activities: pretests, learning, posttests and comparison.
                                               

The new mobile technology-based Evaluation Tool is going to provide:

  • Pretest of attitude and behaviour, to improve the learning phase
  • Pretest of knowledge before the learning starts, to improve the learning phase
  • Evaluate satisfaction during learning phase
  • Perform posttest of knowledge during learning phase
  • Some time after finishing learning, provide posttest in attitude and behaviour
  • Use these results to compare and improve the effect of training for participants and companies.

The picture at the top shows Aleksandra Mykowska, Domszkolen, Krakow, Poland, and Robin Støckert, HiST, testing peer learning assessment systems. 
9.04.2013

SRS 2.0, PELE 1.5, Eval 1.0 and iLike 1.0 are available for use.