• Educational Technology International
• /
• v.24 no.2
• /
• pp.295-329
• /
• 2023

The recent development of metaverse-related technology has led to efforts to overcome the limitations of time and space in education by creating a virtual educational environment. To make use of this platform efficiently, applying learning analytics has been proposed as an optimal instructional and learning decision support approach to address these issues by identifying specific rules and patterns generated from learning data, and providing a systematic framework as a guideline to instructors. To achieve this, we employed an inductive, bottom-up approach for framework modeling. During the modeling process, based on the activity system model, we specifically derived the fundamental components of the learning analytics framework centered on learning activities and their contexts. We developed a prototype of the framework through deduplication, categorization, and proceduralization from the components, and refined the learning analytics framework into a 7-stage framework suitable for application in the metaverse through 3 steps of Delphi surveys. Lastly, through a framework model evaluation consisting of seven items, we validated the metaverse learning analytics framework, ensuring its validity.

• Educational Technology International
• /
• v.17 no.2
• /
• pp.175-202
• /
• 2016

Most of the learning analytics research has investigated how quantitative data can affect learning. The information that is provided to learners has been determined by teachers and researchers based on reviews of the previous literature. However, there have been few studies on standard learning activities that are performed in e-learning environments independent of the teaching methods or on learning behavior data that are obtained through learning analytics. This study aims to explore the general learning activities and learning behaviors that can be used in the analysis of learning data. Learning activities and learning behavior are defined in conjunction with the concept of learning analytics to identify the differences between teachers' and learners' learning activities. Learning activities and learning behavior were verified by an expert panel review in an e-learning environment. The differences between instructors and learners in their usage were analyzed using a survey method. As results, 8 learning activities and 29 learning behaviors were validated. The Research has shown that instructors' degree of utilization is higher than that of the learners.

• Educational Technology International
• /
• v.17 no.1
• /
• pp.117-150
• /
• 2016

The purpose of this study was to develop design guidelines on the learning analytics which can help to promote students' self-regulated learning (SRL) strategies in MOOCs learning environments. First of all, to develop the first draft of design guidelines, relevant literature review and case analysis on current MOOCs platforms such as edX, K-MOOC, Coursera, Khan Academy and FutureLearn were conducted. Then, to validate the design guidelines, expert reviews (validation questionnaires and in-depth interviews) and learner evaluation (in-depth interviews) were conducted. Through the recursive validation, the design guidelines were finalized. Overall, the final version of design guidelines on learning analytics to facilitate SRL strategies was suggested. The final design guidelines consist of 15 items in 10 categories related to the information analyzed based on individual student's learning behaviors and activities on MOOCs environments. Moreover, the results of interview also revealed that the social comparisons, learning progress reports, and personalization might contribute to the improvements of their SRL competences. This study has an implication that MOOCs could offer a higher success or completion rate to students with low SRL skills by taking advantage of the information on learning analytics

• International Journal of Computer Science & Network Security
• /
• v.22 no.9
• /
• pp.334-342
• /
• 2022

Nowadays, as we can notice on social media, most users choose to use more than one language in their online postings. Thus, social media analytics needs reviewing as code-switching analytics instead of traditional analytics. This paper aims to present evidence comparable to the accuracy of code-switching analytics techniques in analysing the mood state of social media users. We conducted a systematic literature review (SLR) to study the social media analytics that examined the effectiveness of code-switching analytics techniques. One primary question and three sub-questions have been raised for this purpose. The study investigates the computational models used to detect and measures emotional well-being. The study primarily focuses on online postings text, including the extended text analysis, analysing and predicting using past experiences, and classifying the mood upon analysis. We used thirty-two (32) papers for our evidence synthesis and identified four main task classifications that can be used potentially in code-switching analytics. The tasks include determining analytics algorithms, classification techniques, mood classes, and analytics flow. Results showed that CNN-BiLSTM was the machine learning algorithm that affected code-switching analytics accuracy the most with 83.21%. In addition, the analytics accuracy when using the code-mixing emotion corpus could enhance by about 20% compared to when performing with one language. Our meta-analyses showed that code-mixing emotion corpus was effective in improving the mood analytics accuracy level. This SLR result has pointed to two apparent gaps in the research field: i) lack of studies that focus on Malay-English code-mixing analytics and ii) lack of studies investigating various mood classes via the code-mixing approach.

• International Journal of Computer Science & Network Security
• /
• v.24 no.1
• /
• pp.71-84
• /
• 2024

This paper presents a critical analysis of the current application of big data in higher education and how Learning Analytics (LA), and Educational Data Mining (EDM) are helping to shape learning in higher education institutions that have applied the concepts successfully. An extensive literature review of Learning Analytics, Educational Data Mining, Learning Management Systems, Informal Learning and Online Social Networks are presented to understand their usage and trends in higher education pedagogy taking advantage of 21st century educational technologies and platforms. The roles of and benefits of these technologies in teaching and learning are critically examined. Imperatively, this study provides vital information for education stakeholders on the significance of establishing a teaching and learning agenda that takes advantage of today's educational relevant technologies to promote teaching and learning while also acknowledging the difficulties of 21st-century learning. Aside from the roles and benefits of these technologies, the review highlights major challenges and research needs apparent in the use and application of these technologies. It appears that there is lack of research understanding in the challenges and utilization of data effectively for learning analytics, despite the massive educational data generated by high institutions. Also due to the growing importance of LA, there appears to be a serious lack of academic research that explore the application and impact of LA in high institution, especially in the context of informal online social network learning. In addition, high institution managers seem not to understand the emerging trends of LA which could be useful in the running of higher education. Though LA is viewed as a complex and expensive technology that will culturally change the future of high institution, the question that comes to mind is whether the use of LA in relation to informal learning in online social network is really what is expected? A study to analyze and evaluate the elements that influence high usage of OSN is also needed in the African context. It is high time African Universities paid attention to the application and use of these technologies to create a simplified learning approach occasioned by the use of these technologies.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.6
• /
• pp.2799-2823
• /
• 2019

With the help of learning analytics, MOOCs have wider potential to succeed in learning through promoting self-regulated learning (SRL). The current study aims to apply and validate visualization design guidelines for a MOOC dashboard to enhance such SRL capabilities based on learning analytics. To achieve the research objective, a MOOC dashboard prototype, LM-Dashboard, was designed and developed, reflecting the visualization design guidelines to promote SRL. Then, both expert and learner participants evaluated LM-Dashboard through iterations to validate the visualization design guidelines and perceived SRL effectiveness. The results of expert and learner evaluations indicated that most of the visualization design guidelines on LM-Dashboard were valid and some perceived SRL aspects such as monitoring a student's learning progress and assessing their achievements with time management were beneficial. However, some features on LM-Dashboard should be improved to enhance SRL aspects related to achieving their learning goals with persistence. The findings suggest that it is necessary to offer appropriate feedback or tips as well as to visualize learner behaviors and activities in an intuitive and efficient way for the successful cycle of SRL. Consequently, this study contributes to establishing a basis for the visual design of a MOOC dashboard for optimizing each learner's SRL.

• Journal of the Korea Convergence Society
• /
• v.9 no.3
• /
• pp.23-29
• /
• 2018

There is a growing interest in computer based learning system that can learn a new concept of epistemic frames in response to the demands of $21^{st}$ century Skills. However, there is little research on the theoretical models for the epistemic frames applicable in the changing educational environment and the measurement theories (Psychometric theory, Learning Analytics) that can be evaluated. Therefore, in this study, we propose the core elements of the learning system prototype that can educate the epistemic frames in the practical community. Furthermore, this study explores and suggests an appropriate psychometric measurement theory (learning analytics) that allows us to measure, infer, and evaluate a learner.

• Educational Technology International
• /
• v.18 no.1
• /
• pp.1-25
• /
• 2017

Educational applications of big data analysis have been of interest in order to improve learning effectiveness and efficiency. As a basic challenge for educational applications, the purpose of this study is to develop a comprehensive data set scheme for learning analytics in the context of digital textbook usage within the K-12 school environments of Korea. On the basis of the literature review, the Start-up Mega Planning model of needs assessment methodology was used as this study sought to come up with negotiated solutions for different stakeholders for a national level of learning metrics framework. The Ministry of Education (MOE), Seoul Metropolitan Office of Education (SMOE), and Korean Education and Research Information Service (KERIS) were involved in the discussion of the learning metrics framework scope. Finally, we suggest a proposal for the national learning metrics framework to reflect such considerations as dynamic education context and feasibility of the metrics into the K-12 Korean schools. The possibilities and limitations of the suggested framework for learning metrics are discussed and future areas of study are suggested.

• The Journal of Korean Association of Computer Education
• /
• v.20 no.6
• /
• pp.1-15
• /
• 2017

The purpose of this study is to design a LMS(Learning Management System) dashboard for instructor feedback support based on learning analytics and to apply a LMS dashboard incorporating such taxonomy which allows an instructor to give a student personalized feedback according to the class content and a student's traits. In the dashboard design phase, usable instructional data were selected from LMS based on feedback taxonomy in terms of learning analytics. Two validity tests were conducted with 8 instructional technologists over 8 years of experience, and were revised accordingly. The final dashboard screen has three parts: A comprehensive analysis screen to provide appropriate feedback based on instructor feedback taxonomy analysis, a summary screen for learner analysis, and a recommended feedback guide screen. Detailed analysis information are provided through other dashboards that are displayed in eight screens: login analysis, learning information confirmation analysis, teaching materials learning analysis, assignment/tests, and posts analysis. All of these dashboards were represented by analysis information and data based on learner analytics through visualization methods including graphs and tables. The implications of educational utilization of the dashboard for instructor feedback support based on learning analytics and the future researches were suggested based on these results.

• Educational Technology International
• /
• v.18 no.2
• /
• pp.73-99
• /
• 2017

The learning analytics dashboard (LAD) is a supporting tool for teaching and learning in its personalized, automatic, and visual aspects. While several studies have focused on the effect of using dashboard on learning achievement, there is a research gap concerning the impacts of learners' characteristics on it. Accordingly, this study attempted to verify the differences in learning achievement depending on learning motivation level (high vs. low) and dashboard intervention (use vs. non-use). The final participants were 231 university students enrolled in a basic statistics course. As a research design, a 2 × 2 factorial design was employed. The results showed that learning achievement varied with dashboard intervention and the interaction effect was significant between learning motivation and dashboard intervention. The results imply that the impact of LAD may vary depending on learner characteristics. Consequently, this study suggests that the dashboard interventions should be offered after careful consideration of individual students' differences, particularly their learning motivation.