Situational Judgement Test Results: How Scores Work
Free, no sign-up to start.
Learn how situational judgement test results work, from raw vs. scaled scores and percentiles to AAMC PREview consensus keys and Casper Z-scores.
Free, no sign-up to start.
Situational judgement test results measure how well your responses to workplace or academic dilemmas match expert keys or rater rubrics. Testing organizations report your standing relative to other examinees, such as AAMC PREview scaled scores released about 30 days after your testing window. On open-response assessments like Acuity Insights' Casper test, 14 independent scenario ratings are averaged and converted into a peer-group Z-score and percentile rank. Sources: AAMC: Understanding Your AAMC PREview Professional Readiness Exam Scores, AAMC: Register for the AAMC PREview Exam (2026 Calendar and Fees), AAMC: About the AAMC PREview Exam. Last checked November 12, 2026.
On this page
- How Situational Judgement Test Results Work: Raw vs. Relative Scores
- Scoring Mechanics: Consensus Keys, Partial Credit, and Human Raters
- Score Report Formats: Scaled Scores, Percentiles, Z-Scores, and Bands
- Reading Precision and Reliability: Standard Error of Measurement
- How Admissions Committees and Reviewers Use Your SJT Results
- Score Release Timelines, Retakes, and Where to Find Your Report
- Checklist: How to Read Your Score Report and Plan Your Next Step
- Practice question
- Frequently asked questions
- Sources
How Situational Judgement Test Results Work: Raw vs. Relative Scores
A situational judgement test (SJT) presents hypothetical scenarios and evaluates how you respond to interpersonal, ethical, and professional dilemmas. Unlike a classroom exam with fixed letter-grade cutoffs, a raw point total on an SJT means very little on its own. Test publishers convert your raw total into a relative benchmark, such as an equated scaled score, a percentile rank, or a Z-score, so reviewers can see where you stand against a comparison group of peers facing similar items.
That relative benchmark explains why SJT score reports do not carry a universal pass or fail mark. Each academic program or employer sets its own expectations based on its applicant pool and role demands. Prompt framing and response format also shape what your result actually measures.
As documented in the Casper Technical Manual, situational judgement research distinguishes between knowledge questions, which ask what you should do in a given situation, and behavioral tendency questions, which ask what you would actually do. Closed-response tests like the AAMC PREview professional readiness exam ask you to rate the effectiveness of 186 proposed responses across text-based scenarios in about 75 minutes. Open-response tests like Casper ask what you would do in your own words through timed typed and video answers, which you can explore further in our complete guide to the Casper test.
- Raw score: The initial sum or average of points earned across scored scenarios before statistical adjustment.
- Equated scaled score: A standardized number adjusted for slight differences in difficulty across test forms so a score carries the same meaning on any test date.
- Percentile rank: The percentage of examinees in your reference cohort who scored below your result.
- Z-score: A standardized distance metric with a mean of 0 and a standard deviation of 1 showing how far above or below your test-instance average you performed.
Scoring Mechanics: Consensus Keys, Partial Credit, and Human Raters
How points accumulate behind the scenes depends on whether your test uses predetermined answer options or open-ended responses. Closed-response SJTs rely on a master scoring key created with subject matter experts. For the AAMC PREview exam, the AAMC builds its effectiveness key with medical school admissions officers, faculty, and student affairs representatives, incorporating scenario feedback from students.
On rating-scale SJTs, partial credit rewards near misses that stay on the correct side of professional judgment. Under the AAMC PREview scoring rule, examinees rate each proposed action as Very Ineffective, Ineffective, Effective, or Very Effective. Matching the medical educators' consensus rating earns full credit. Selecting a rating 1 step away on the same side of the scale (such as rating an item Very Effective when the consensus key is Effective, or Very Ineffective when the key is Ineffective) earns half credit. Crossing to the opposite side of the scale (rating an Effective item as Ineffective) does not receive credit.
To see how partial credit adds up in practice, consider a worked example on a 4-item scenario using the official AAMC scoring rule. By our calculation from the AAMC PREview scoring guidelines, if you match the consensus key on 2 items (2 times 1.0 equals 2.0 points), land 1 step away on the same side of the scale on 1 item (1 times 0.5 equals 0.5 points), and cross to the opposite side on 1 item (0 points), you earn 2.5 out of 4.0 raw points, or 62.5%, before equating.
Open-response SJTs replace fixed answer keys with trained human raters. As of the 2023-2024 cycle, the Casper test consists of 14 scenarios: 8 of which require a typed response and 6 of which require a video response, with open-ended questions completed under strict per-scenario time limits.
Instead of checking off specific catchphrases, a unique independent rater grades each of your 14 Casper scenarios globally across 10 core competencies: collaboration, communication, empathy, equity, ethics, motivation, problem solving, resilience, self-awareness, and professionalism. Because no rater ever sees more than 1 of your scenarios, a weak first answer cannot trigger a halo effect on your remaining 13 scenarios, and your final raw score is the average of all 14 independent ratings.
| Scoring Feature | AAMC PREview Exam | Acuity Insights Casper | Impact on Your Result |
|---|---|---|---|
| Prompt Framing | Evaluate whether proposed actions make a situation better or worse | Behavioral tendency prompts asking what you would do | Per the Casper Technical Manual, behavioral tendency questions produce lower gender and race demographic differences than knowledge questions |
| Grading Method | Automated comparison against medical educators' consensus key | 14 unique human raters assigning 1 global score per scenario | Independent human raters dilute individual rater bias and eliminate halo effects |
| Partial Credit Rule | Full credit for consensus match, half credit 1 step away on same side, no credit on opposite side | Continuous evaluation of justification, nuance, and multiple perspectives | Near-consensus choices still preserve points on rating scales |
| Score Reported to Schools | Equated scaled score and percentile rank | Standardized Z-score and percentile rank within exact test instance | Both formats benchmark you against peers rather than raw percentages |
Score Report Formats: Scaled Scores, Percentiles, Z-Scores, and Bands
Once raw points are tallied, testing organizations translate them onto reporting scales designed to keep comparisons fair across different test dates. On the AAMC PREview exam, raw totals pass through statistical equating to adjust for minor variations in item difficulty across forms. As the AAMC explains, equating ensures that a scaled score of 6 carries the exact same meaning regardless of which test form you receive or which month you test.
On Casper, Acuity Insights controls for test-version difficulty by calculating a Z-score within your exact test instance. Every Z-score distribution has a mean of 0 and a standard deviation of 1. A positive Z-score means you scored above the average of peers who took that exact same test sitting, while a negative Z-score means you scored below the average. Programs also receive a percentile rank showing the share of examinees below your mark, so a 75th percentile result means you outperformed 75% of that comparison group.
Admissions offices also translate continuous Z-scores and percentiles into interpretable groupings of performance within a scoring rubric, as outlined in the Acuity Insights Casper Implementation Guide, so reviewers can weigh SJT results alongside GPA, entrance exams, and reference letters.
| Report Format | How It Is Calculated | What Reviewers See | Typical Setting |
|---|---|---|---|
| Equated Scaled Score | Raw consensus points adjusted via statistical equating across forms | A standardized number (such as 6 on AAMC PREview) with uniform meaning across test dates | Medical and health professions admissions |
| Percentile Rank | Percentage of examinees in the norm group scoring below your mark | Relative rank (for example, 75th percentile means outperforming 75% of peers) | AAMC Score Reporting System and program-facing Casper reports |
| Standardized Z-Score | Distance from the exact test-instance average (mean of 0, standard deviation of 1, per Acuity Insights) | Positive values above peer average and negative values below peer average | Program-facing Casper admissions score reports |
| Rubric Performance Groupings | Percentiles or Z-scores grouped into defined point tiers in a scoring guide | Interpretable groupings of performance alongside GPA, exams, and reference letters | Institutional admissions rubrics |
Reading Precision and Reliability: Standard Error of Measurement
Show details
Every test score is an estimate of your true skill on exam day. Score users check reliability and the Standard Error of Measurement (SEM) to see how precise that estimate is. Internal consistency uses Cronbach's alpha on a 0.00 to 1.00 scale to check whether scenarios measure the same construct. Across 861,329 applicants and 1,049 test instances documented in the Casper Technical Manual from 2016-2017 through 2023-2024, Casper's mean alpha ranged from 0.78 to 0.87. In 2023-2024, mean alpha sat at 0.82 across 133,137 applicants, with a mean Z-score SEM of 0.42.
A generalizability study of 2,495 US medical school applicants broke down where score differences come from, finding an overall generalizability coefficient of 0.85. Differences in applicant ability accounted for the largest share of variance (22.6%), followed by rater differences (20.7%), applicant-by-scenario interaction (9.3%), and scenario difficulty (0.6%). When 24,147 applicants repeated Casper across consecutive cycles, test-retest intraclass correlation also reached 0.85.
Validity studies also confirm that Casper scores are not affected by spelling, grammar, or reading level. Strict time limits and disabled copy-and-paste protect score integrity as well. In an experimental study, participants using ChatGPT scored only 0.33 points higher than non-users and reported that timing and interface limits made external tools hard to use. A separate 52-participant study found no significant difference in mean scores between solo test-takers (5.9) and pairs (6.2).
How Admissions Committees and Reviewers Use Your SJT Results
Programs use situational judgement test results to measure interpersonal and ethical competencies that grades and technical exams miss. In a validity regression analysis, Casper scores accounted for only 1% of the variance in Physician Assistant National Certifying Exam (PANCE) technical scores, proving that SJT results add distinct information rather than duplicating academic tests. You can see which health and graduate programs weigh these attributes by reading more on how Casper works for admissions.
Meanwhile, a synthesis in the journal Medical Education cited by Acuity Insights in October 2026 analyzed 27 independent studies and 100 effect sizes on constructed-response SJTs. That meta-analysis found that higher open-response SJT scores predicted stronger interview evaluations, curricular peer ratings, clinical supervisor ratings, and real-world professionalism, and that predictive validity nearly doubled when schools aligned their downstream evaluations with the exact competencies tested at admissions. With 35% of applicants admitting in an Acuity Insights survey to using AI tools during the application process, standardized timed SJT scores carry growing weight alongside personal statements and reference letters.
Programs generally implement SJT scores into selection decisions using formulaic, rubric, or qualitative methods, while moving away from rigid single-number knockout thresholds. Implementation guidelines caution committees against strict screen-in or screen-out cut scores because tiny numerical gaps (like the difference between a 3.49 and a 3.5 GPA) cut quality candidates, while strict cut scores reduce flexibility and promote cohort homogeneity.
- Formulaic integration: Combining weighted metrics into a composite pre-interview rank. In the River Fork University model (3,000 applicants for 700 interviews and 300 seats), committees weight GPA at 1/3, GRE at 1/3, and Casper Z-score at 1/3 to fast-track the top 600 candidates and conduct file reviews on ranks 601 to 800 for the final 100 interview invites.
- Rubric scoring: Converting Z-scores or percentiles into point tiers (such as up to 3 points for each of the 4 measures across GPA, GRE, Casper, and reference letters for a maximum score of 12), fast-tracking candidates at 10 points or higher while reviewing whole files between 6 and 10 points.
- Qualitative whole-file review: Reading the SJT result alongside transcripts, experiences, and essays without a rigid numerical formula so trained reviewers can weigh context before extending interview offers.
Score Release Timelines, Retakes, and Where to Find Your Report
When and how you see your situational judgement test results depends on the testing organization. In 2026, the AAMC offers the PREview exam from April through October across 8 testing windows, beginning with Window 1 on April 15 and 16 (registration closes April 1 at 11:59 p.m. ET, scores released May 19) and concluding with Window 8 on October 14 and 15 (registration closes September 30 at 11:59 p.m. ET, scores released November 13). Score reports are released about 30 days after each testing window closes and appear alongside MCAT scores inside the AAMC Score Reporting System. Examinees pay a $105 standard registration fee ($0 for a first attempt with AAMC Fee Assistance Program approval, and a 50% discount on subsequent attempts) and a $25 fee to reschedule at least 2 weeks ahead.
Both major higher-education SJT providers restrict repeat testing so scores reflect authentic judgment rather than repeated exposure. Starting in the 2024 testing year, the AAMC limits PREview examinees to no more than 2 attempts per testing year and 4 attempts in a lifetime. On Casper, applicants may take only 1 test per program vertical per application cycle, and can review step-by-step guidance on test dates, score distribution, and retake policies in the Acuity Insights Help Centre.
Checklist: How to Read Your Score Report and Plan Your Next Step
Use your SJT score report to guide where you apply, how you weigh a retake, and how you prepare for interviews. Research on Casper shows that candidates who familiarize themselves with the test format avoid losing marks simply from facing an unfamiliar, timed task for the first time. Follow our team's 5-step checklist to put your result to work, and if you have an upcoming open-response test date, practice Casper scenarios with timed prompts so typing and video pacing feel natural on exam day.
- Step 1, Identify your reference group: Check whether your report compares you against a single test-date sitting (like Casper Z-scores) or an equated multi-form scale (like AAMC PREview) before judging your standing.
- Step 2, Account for measurement bands: Remember that an SJT score has a natural margin of error (such as Casper's 0.42 Z-score SEM in 2023-2024) and that admissions rubrics group scores into broad tiers rather than ranking tiny decimal differences.
- Step 3, Audit your target schools' selection models: Check each program's admissions page to see if your SJT is used early for interview prioritization or weighed alongside GPA, test scores, and MMI stations in final selection.
- Step 4, Decide on retakes using official benchmarks: If you are eligible for a second AAMC PREview attempt within the 2-per-year cap, take the AAMC's 2 free practice exams and the $20 Official Prep Hub Scored Practice Exam under timed conditions to verify improvement before paying $105 to retest.
- Step 5, Align your interview preparation with SJT competencies: Because open-response SJT constructs overlap directly with MMI stations, practice articulating multiple perspectives, empathy, and clear justification aloud before interview season begins.
Practice question
You are working in a 4-student lab team whose final data presentation counts for 30% of your course grade. Maya, who is responsible for running the statistical tables due Friday, missed today's group review and has not uploaded her slides. Two teammates want to email the professor tonight to have her removed from the group grade. What would you do?
See an example answer
Example answer written by our team. The applicant is invented. First, I would reach out to Maya privately right after our study session so she does not feel ambushed, while asking my 2 teammates to hold off on emailing the professor until we have the full facts. Right now we only see the missing slides, not what is happening outside class, so I would ask open, non-judgmental questions to learn whether she is facing an illness, a work shift conflict, or trouble with the statistical software. If she is stuck on the analysis, I would offer to sit down together for 30 minutes tonight to split that dataset into manageable pieces we can finish before Friday. At the same time, our 4-person team depends on accurate numbers for a shared grade, so I would set a concrete check-in deadline with Maya for tomorrow afternoon. If she still cannot complete her share after we adjust the workload, I would let her know transparently that our team needs to ask our teaching assistant early for guidance.
Independent SJT raters look for non-judgmental information gathering, empathy, collaboration, and accountability rather than taking a rigid side. This response pauses premature escalation, checks on Maya's context privately, offers concrete teamwork support with a clear time boundary, and protects the team's academic obligation if the issue remains unresolved.
Frequently asked questions
What is considered a strong situational judgement test result?
Because SJT scores are norm-referenced rather than graded on a fixed pass-fail scale, any positive Z-score places you above the average of peers in your exact test instance. On percentile scales, higher ranks show stronger relative standing, so scoring in the 75th percentile means you performed better than 75% of your comparison group.
How long does it take to get situational judgement test results back?
Release timelines vary by exam provider and scoring method. According to the AAMC, AAMC PREview score reports are released about 30 days after each testing window closes, while Casper test dates and score distribution rules are tracked inside your account.
Why are raw situational judgement test scores converted into scaled scores or Z-scores?
Different test dates use unique scenario sets that can vary slightly in difficulty. Equating raw scores into scaled scores (on AAMC PREview) or standardizing them into within-instance Z-scores with a mean of 0 and standard deviation of 1 (on Casper) ensures fair comparison across every test version.
Do spelling mistakes or typing errors lower open-response SJT results like Casper?
No. Construct-irrelevant variance studies on Casper show that scores are not affected by spelling, grammar, or reading level, because trained human raters evaluate the reasoning, empathy, and judgment behind your response.
Can a low situational judgement test result automatically disqualify my application?
Official Casper implementation guidelines caution admissions committees against using strict screen-in or screen-out cut scores because rigid cutoffs reduce flexibility and promote cohort homogeneity. Instead, programs typically combine SJT scores with GPA, exams, and essays using weighted formulas, point rubrics, or whole-file reviews.
Can I retake a situational judgement test if I am unhappy with my score?
For the AAMC PREview exam, examinees may test up to 2 times in a single testing year and up to 4 times in their lifetime (starting in the 2024 testing year). For Casper, applicants may take only 1 test per program vertical during each application cycle.
Sources
- AAMC: Understanding Your AAMC PREview Professional Readiness Exam Scores
- AAMC: Register for the AAMC PREview Exam (2026 Calendar and Fees)
- AAMC: About the AAMC PREview Exam
- AAMC: Prepare for the AAMC PREview Exam
- Acuity Insights: Casper Admissions Assessment Overview
- Acuity Insights: Casper Implementation Guide
- Acuity Insights: What Open-Response SJTs Tell Us About Future Professional Performance
- Acuity Insights: Casper Technical Manual
- Acuity Insights Help Centre: Casper Test Guide and FAQs