The Challenge

Despite affecting ~3.6 million Australians, arthritis remains widely underdiagnosed and mismanaged due to gaps in clinical education. This creates significant variability in care and poorer patient outcomes.

The Solution

Supporting the National Strategic Action Plan for Arthritis and the goals of the Australian Rheumatology Association, ATLAS was designed to directly address these gaps by translating complex, evidence-based clinical guidelines into engaging, accessible eLearning - enabling time-constrained healthcare professionals to apply best-practice arthritis care in real-world settings.

5. Evaluation

5.1 Evaluation Framework

We measured impact through learner feedback, behavioral change, and clinical outcomes using a comprehensive approach:

  • Applied Kirkpatrick Levels 1–3 (Reaction, Learning, Behavior)

  • Monitored LMS data: engagement, completion, and knowledge gain

  • Collected structured feedback via MS Forms and in-platform surveys

  • Implemented continuous updates based on learner behavior and SME input

  • Established ongoing formal impact study in collaboration with the University of Sydney

5.2 Formative Evaluation

During the pilot phase, we conducted weekly learner feedback polls, which informed iterative refinements to module pacing and quiz difficulty. This real-time adjustment process ensured optimal learning experiences before full launch.

5.3 Summative Evaluation (Mar 2025)

Analytics Dashboard Results:

  • 1,200 registered users

  • 75% module completion rate

  • Average time 8 minutes per module

Learner Survey Findings (n=287, 41% response rate):

  • 92% agreed "I feel more confident managing OA/RA"

  • 88% found modules "relevant and practical"

5.4 Impact Measurement

In follow-up interviews, 60% of GPs reported increased lifestyle counseling, while 45% reported reduced immediate surgical referrals. These behavioral changes align with best practice guidelines and indicate successful knowledge transfer to clinical practice.

5.5 Continuous Improvement Plan

  • Quarterly analytics reviews

  • Annual content update cycle (next: Q2 2025)

  • Upcoming pilot of AI-driven adaptive quizzes and VR knee exam simulation

Key RA Pathway metrics

Hover over the graph to reveal stats. Completion progress: 635 completed modules with 540 in progress (54% completion rate)