Designing for eAssessment of higher order thinking : An undergraduate IT online distance education course in Sri Lanka

Sammanfattning: Distance education has seen rapid growth over the recent decades. The rapid development of Information Communication Technology [ICT] has been one of the main drivers of this growth in distance education. However, distance education and ICT themselves posts challenges to both students and educators alike. This thesis finds its basis in the problem of high failure rates and quality assurance issues in the Bachelor of Information Technology [BIT] distance degree programme conducted by the University of Colombo School of Computing in Sri Lanka. A Formative Assessment for Distance Education [FADE] model that promotes the development of and assesses higher-order skills in a collaborative online distance-learning environment was designed based on a methodological approach involving design-based research. The main study was focussed on two main problems, plagiarism in distance education [part A] and the use of technology to address the issues of learning and assessment [part B]. Research questions arising from different aspects of the design required the use of multiple methodologies. Issues of plagiarism in technology aided assessment in distance education put forward questions that required the use of a quasi-experiment and a literature survey. The empirical material of this phase of the study comprised of keystroke logs and questionnaire data. The design and evaluation of the FADE model employed a mixed method two-phase sequential explanatory strategy. The empirical material of this phase of the study comprised of questionnaires, observations coding, interviews and examination and registry data. The quasi-experimental data was analysed using a fuzzy logic engine. The questionnaire, observation coding and examination and registry data were statistically analysed and interviews were used to interpret and explain finding. The results of the part A of the study indicate that there are keystroke patterns for individuals that are stable within and across different tasks. However, the results of the literature review on plagiarism suggested the use of both technological and pedagogical approaches to plagiarism. Part B of the study, showed relationships between higher order thinking demonstrated by students and their course results and attitudes.  Collaborative learning skills demonstrated by students showed relationships to the students’ purpose of use of the FADE forum and their experience on the social web. This study finds that both technological tools and pedagogical practices have to be used in conjunction to limit the possibility of plagiarism. With reference to assessment with a focus on the development of higher order thinking, the study indicates that assessment should be based on the student’s perspective, the purpose and aim of the assessment and the assessment environment. Furthermore, the study finds that in distance education collaboration seems particularly important.