How are cases scored in CyberPatient?

The AI scoring system at each stage of a case.

Premium Student, Free Student (1000 × 50 px) (50 × 50 px) (150 × 40 px) (1500 × 400 px) (6) - EditedCyberPatient cases are scored with AI through our Integrated Intelligent Tutoring System (IITS).  




History Taking

History Taking questions and answers are broken into 3 categories:

  • Most Relevant - (green in feedback)
  • Relevant - (orange in feedback) 
  • Less Relevant - (red in feedback)

CyberPatient scores a user based on the Most Relevant questions chosen. The others, Relevant and Less Relevant, are not scored. For example, if a case has 100 questions and 50 of these questions are considered most relevant, and a user chooses to ask all 50 most relevant questions, the score will be 100%.

Screenshot 2024-04-25 125142

If users skip the history taking process, they will score 0%, the same as asking all available questions instead of selecting the most relevant case. 


Screen Shot 2022-11-23 at 4.24.29 PM



Physical Examination

The scoring for physical examination is divided into 2 parts; general examination and special exams.

Screenshot (3)

During general exams, vital signs plus height and weight (see below) are scored for all cases. Additionally, all appropriate special exams per case are scored. Score deductions occur when the most relevant and appropriate exams have not been completed.


Screenshot 2024-04-24 132345

Further scoring occurs when the most relevant additional general physical exam options are selected that are most appropriate to each case. Irrelevant general exams will not be deducted from the score; however, all decisions (relevant or less relevant) are highlighted in the feedback section. 



Patient Chart

Although the patient chart is not included in the automated scoring system in CyberPatient, it is medical best practice to document all patient interactions, including history taking, examination, findings, diagnosis, etc. Clear documentation allows faculty to assess and provide feedback to the user. A user can still move forward in the case without completing the chart. The patient chart can be exported to a printable PDF.

The patient chart cannot be edited once the case is completed. Click here to learn more.


Screenshot 2024-04-19 103419

Do not close the patient chart without saving the chart - SAVE and CLOSE before clicking on the rest of the platform. 





Investigations (Lab Tests) 

The most relevant lab test/s appropriate to each case are scored. There are over 700 lab tests to choose from in CyberPatient. If irrelevant tests are selected, points are not deducted; however, they are highlighted in the feedback. Irrelevant lab tests chosen will affect the overall cost of care highlighted on the feedback page. 



Provisional Diagnosis 

The cases have 3 or 4 provisional diagnoses to choose from at this stage of the case. One option will always be incorrect. When incorrect options are selected, a window pop-up will inform the user. Each incorrect option selected will deduct 50%. Three correct options chosen first are scored at 100%. 

After 3 mistakes, level 3 users will move forward, but the score will be zero. In level 4, the case is terminated and the user is prompted to restart the case.


Provisional_diagnosis - Edited



Final Diagnosis 

For each case, a single final diagnosis is the correct one. For every incorrect answer chosen, 50% is deducted from the score. Three mistakes made on level 3 will allow the user to advance in the case, and the user will advance. However, three mistakes on level 4 will end the case, and the user will have to start from the beginning. 

All sections showing multiple choices have the ‘3 mistakes rule’ appropriate for each user level. Remember to check the user levels before starting a case, as changing it midway through the case will prompt the user to start the case from the beginning. 




Management Recommendations 

The most appropriate recommendation for each case selected from the drop-down menu is scored. User can choose their own recommendations and add to them; however, they are not scored.  


Screenshot 2024-04-25 141033



Treatment / Prescribing Medications 

 Scoring is based on the name and the strength of the medication. North American Gold Standard medications are the most appropriate in CyberPatient. The platform also follows World Health Organization’s ATC classification. Because different institutions and global regions use other options as the Gold Standard, the score will not be penalized when alternative medications are selected. 

Screenshot 2024-04-24 095831



Follow-up

Users are prompted to select from the provided options during the follow-up section. For each case, a single follow-up is the correct one. For every incorrect answer chosen, 50% is deducted from the score. The user can make 3 mistakes on level 3, and the user will advance. However, on level 4, the case will end, and the user will have to start from the beginning.

Screenshot 2024-04-24 100055-1



Overall Results 

Users can see all the results for each case section (as seen below). Users can investigate further by clicking on the tabs and feedback. 

Screenshot 2024-04-25 120942

 

 

Have any questions❓ Please reach out to info@cyberpatient.ca