Evaluation and efficiency of e-learning systems

Abstract

E- learning system is a complex issue not only because of its success and effectiveness but also because of its evaluation. Reliable ways to measure the success and effectiveness of the e-learning system are required for e-learning applications to be used efficiently. The purpose of this thesis is to provide a prototype to evaluate e-learning systems’ success and effectiveness by addressing the success criteria. E-learning systems and testing tools used in this thesis were especially selected from among non-commercial and open source software. In order for a successful e-learning system assessment, different dimensions of the system such as standards, quality attributes and several other criteria should be taken into consideration. In this thesis study, some automated software testing tools are examined and then selected to execute to test the e-learning systems’ software. Open source Learning Management Systems were selected to evaluate, namely Moodle, Ilias, Dokeos, Docebo, Claroline and Efront. Assessment of e-learning systems success was focused on software testing, the whole e-learning process was not considered. It is assumed that performance, accessibility, security and standard compliance, and functionality comparisons of the systems can be indicators of the whole e-learning system success. Some non-commercial testing tools were used to evaluate e-learning systems according to the previously defined criteria except functionality. In order for the functionality testing of the systems, functionality comparison matrix was developed. Each criterion in the matrix weighted according to the survey results, which was answered by 22 e-learning specialists. Weighted sum of the standardized scores of tests were used to evaluate systems overall success according to the defined criteria. Weights were calculated according to the third part of survey. LMSs’ scores according to these calculations were figured out in the order of Docebo, Dokeos, Moodle, Claroline, Ilias and Efront, whereas the scores of Dokeos and Docebo were very close to each other