Comparative and non-comparative evaluation in educational

First Study

Study title: A comparison of student outcomes with and without teacher
facilitated computer-based instruction
Conducted by: Jack V. Powella,*, Victor G. Aeby Jr.b, Tracy Carpenter-Aebyc
Published in 2003
This study is a comparative study related to Learners’ perception and performance and the purpose of this study was to determine if there were significant differences in academic and psychosocial outcomes for
disruptive students assigned to an alternative school who received teacher facilitation with CBI, As it compares student outcomes with and without teacher facilitated computer-based instruction. Basically the evaluation instrument used in this study were student grades so called documentation review, as this was
the main data collection strategy used in the study, and the purpose of this data collection methodology was to find out the final results of both study groups and compare their result, since the study is a comparative study, and the authors need to conduct an outcomes comparison of both group as the first group is considered as control group which taking teacher facilitated CBI where the second group is taking CBI without teacher facilitation, and basically the participant were around 215 students and the study monitored student results for period of 2 academic years and once again the evaluation instrument used was comparison of student results or degrees in period of 2 years.
Advantages and Disadvantages of this evaluation methodology
Basically documentation review is a great instrument when evaluating for long period of time as it gives overall results of a program being evaluated and it also provide accurate information since documents were created original for example student grades are original grades not affected by student and/or teacher perception as we know many instrument could be affected by social related response such as survey could be affected by student readiness or aptitude toward completing that survey, does the student completed it because he have to or he really wants to give accurate information for the study. The benefits of using this evaluation methodology are the following first this method provide accurate data, second it wouldn’t interferes with the program being evaluated for example the evaluator doesn’t need to attend the class to evaluate, going to disadvantages of this evaluation instrument firstly data be exists but not available for research purposes, administrative issues, second need for longer time to collect data for example if need to collect student results/outcomes.
Finally the results were as the following the group 2 with teacher facilitated CBI scored significantly higher results comparing with the group 1 without teacher facilitated CBI, results were in terms of student achievement.

Second Study

Study title : Multi-dimensional students’ evaluation of e-learning systems in the higher education context: An empirical investigation
By: Sevgi Ozkan *, Refika Koseler
Informatics Institute, Middle East Technical University, Ankara, Turkey This study is non-comparative studies, and the purpose of evaluation of this study is to develop a comprehensive e-learning assessment model using existing literature as a base, incorporating concepts from both information systems and
education disciplines, and it attempted to propose an e-learning evaluation model comprising a collective set of measures associated with an e-learning system and it use a survey that applied to 84 graduate and post-graduate students at Brunel University, UK. This survey used to collect data from students about their perceptions of the blended learning environment and LMS in regards to their benefits and satisfaction level. The responses to the questionnaire were analyzed using the Statistical Package for the Social
Sciences (SPSS), and the Reliability was evaluated by assessing the internal consistency of the items representing each factor using Cranach’s alpha.
The advantageous of this instrument are: it measures the learner’s perspective, instructor attitude, information content quality, and it is easy to collect information and result, also it has deferent types of question.
There are some disadvantages of this instrument e.g. it need more time to create, and apply for all students, spatially the sample of study was two type “graduate and post-graduate students”,
also it doesn’t measure the usability of the e-learning system.
The result of this study, there is a positive statistically significant relationship between learner’s
attitudes and overall learner satisfaction; also the attitudes of learners towards U-Link are positively related with the learner’s past LMS experience, and for the instructor quality there is a strong
relationship between the instructor’s quality and learner’s perceived satisfaction. Then the system quality, the result show that there is a highly positive relationship between system quality of the LMS and overall learner satisfaction, and the result of information (content) quality show that there is a strong positive relationship between information quality of the LMS and overall learners’ perceived
satisfaction