{
  "abstract": "Objectives To evaluate whether integration of AI-generated post-consultation feedback in social robotic VP interactions improves medical students’ clinical performance.Methods We conducted a quasi-experimental study with 115 sixth-semester medical students at Karolinska Institutet (KI), Sweden. During their clinical rotation within rheumatology, students were allocated to either receive (n=61) or not receive (n=54) AI-generated feedback following interactions with a Social AI-enhanced Robotic Interface (SARI). Students in both arms participated in case-specific follow-up seminars led by clinical experts following each VP encounter. Clinical performance was assessed during objective structured clinical examination (OSCE) with a standardised patient, evaluated by consultant rheumatologists using a 10-point rubric.Results Students receiving AI-generated feedback achieved significantly higher total OSCE scores (7.39 ± 0.86 versus 6.68 ± 1.04 points; mean difference: 0.70; 95% CI: 0.35–1.06; p<0.001; Cohen’s d=0.74). Domain-specific analysis revealed significant improvement only in generic medical history, also after Bonferroni correction (2.46 ± 0.65 versus 2.03 ± 0.79 points; p=0.004). Pass rates were significantly higher in the feedback group (96.7% versus 79.6%; OR: 7.55; 95% CI: 1.51–72.2; p=0.006), with a number needed to treat of six.Abstract PO:12:310 Figure 1Conclusions AI-generated feedback following social robotic VP interactions significantly improved medical students’ clinical performance in standardised examination. These findings support integrating AI feedback systems in VP platforms for clinical skill training in rheumatology, while highlighting the importance of targeted, competency-specific feedback design.",
  "authors": [
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Alexander Borg"
    },
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Jonathan Schiött"
    },
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "William Ivegren"
    },
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Cidem Gentline"
    },
    {
      "affiliations": [
        "Division of Clinical Epidemiology, Department of Medicine Solna, Karolinska, Stockholm, Sweden"
      ],
      "name": "Viking Huss"
    },
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Anna Hugelius"
    },
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Benjamin Jobs"
    },
    {
      "affiliations": [
        "Department of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Mini Ruiz"
    },
    {
      "affiliations": [
        "School of Education, Culture and Communication, Mälardalen University, Västerås, Sweden",
        "Unit of Teaching and Learning, Karolinska Institutet, Stockholm, Sweden",
        "School of Health Sciences, Örebro University, Örebro, Sweden"
      ],
      "name": "Samuel Edelbring"
    },
    {
      "affiliations": [
        "Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden"
      ],
      "name": "Carina Georg"
    },
    {
      "affiliations": [
        "Division of Speech Music and Hearing, Royal Institute of Technology (KTH, Stockholm, Sweden"
      ],
      "name": "Gabriel Skantze"
    },
    {
      "affiliations": [
        "Division of Rheumatology, Department of Medicine Solna, Karolinska Institutet, Stockholm, Sweden",
        "Department of Rheumatology, Faculty of Medicine and Health, Örebro University, Stockholm, Sweden"
      ],
      "name": "Ioannis Parodis"
    }
  ],
  "title": "PO:12:310 Outcome of AI-generated feedback with AI-enhanced social robotic virtual patients: a quasi-experimental study evaluating undergraduate medical students’ performance during clinical examination",
  "uid": "71377490-0d02-53ad-bd48-bf575ff36848"
}