Immigration Bench

Partners in Evaluation

Immigration Bench is a joint effort by the Talent Mobility Fund, a program of Renaissance Philanthropy, and Vals AI.

Key Takeaways

• No AI model performs well enough to be trusted with immigration guidance. The top-performing model, Claude Fable 5.1, met 75.4% of each question’s rubric items on average, and gave a fully correct answer (defined as meeting every item on the rubric) on only 26.3% of questions. For the most vulnerable users, including those with Deferred Action for Childhood Arrivals (DACA) or Temporary Protected Status (TPS), even the best model met only 63.9% of rubric items on average.
• Models explain the law better than they apply it. Immigration advice depends on the specific person’s facts. Every model was better at explaining general rules than at working out what those rules mean for the person asking. Models that asked the person more questions did not score higher overall: asking questions earned credit on fact-finding items but did not improve the legal guidance itself.
• No single model has the full picture. Together, the 25 models met about 93% of what the experts asked for — but the best individual model met only 75.4%, meaning a significant share of what the benchmark requires sits outside any one model’s reach. Recent policy is the starkest exception: on rules from 2025 and 2026, even all 25 models combined met only about 29% of rubric items. The knowledge gap on recent immigration law is not a model-selection problem — it is a structural one.
• Recent policy changes are an invisible gap. Models met only 7.3% of rubric items involving policy rules from 2025 and 2026, compared to 64.0% for established law. Web search helps, but does not reliably close this gap: even the best model with web search met only 43.1% of recent-rule items.
• Employer questions gain the most from web search. Web search raised the average score on Employer questions by 10.4 points, well ahead of its effect on any other persona (6.0 points for University Advisor questions, the next largest). For example, without search, no model knew about a March 2026 change in how ICE enforces I-9 violations.
• Fixing the gaps requires more than better models. The knowledge AI needs to reliably answer immigration questions, such as agency policy memos and adjudication trends, is fragmented across the Department of Homeland Security, the Department of State, immigration courts, and legal practice. Closing the gap will require AI developers to collaborate with immigration attorneys, legal service organizations, and federal government experts to build narrowly scoped, retrieval-grounded tools rigorously tested against real immigration questions.
• Models perform far better on student work permits than on long-term visas for STEM workers. Rubric items on student work authorization (OPT and STEM OPT) were met 76% of the time. Items on the employment-based green card and talent pathways that scientists and engineers use to stay long-term, such as the National Interest Waiver, PERM labor certification, O-1, and EB-5, were met 57% to 60% of the time.

This report presents an independent evaluation of how leading AI models perform on U.S. immigration law questions, and what it means for the international students, entrepreneurs, employers, and other people who rely on AI to navigate the U.S. immigration system.

Background

About half of U.S. adults now use AI chatbots, according to the Pew Research Center. Immigration questions – about visa eligibility, filing deadlines, work authorization, and what to do when a status is at risk – are among the most consequential. This benchmark tests whether AI gets these answers right.

The consequences of a wrong answer are serious: a missed deadline can mean losing work authorization, incorrect advice about immigration status can trigger removal proceedings, and misinformation about a visa category can cost an employer a key hire.

Vals AI and the Talent Mobility Fund partnered to build an expert-validated benchmark for AI performance on U.S. immigration law. We tested 25 leading AI models against hundreds of questions written by immigration experts. This work is intended as a guide to improvement for AI labs, and to give the public, practitioners, and policymakers a clear, evidence-based picture of where AI stands on U.S. immigration knowledge.

Note: This benchmark focuses on common immigration pathways used by scientists, engineers, and other professionals, such as student visas, work visas, and those transitioning from an uncertain situation, such as Deferred Action for Childhood Arrivals (DACA), to a more durable immigration status. There are many other immigration domains that are out of scope for this study, such as the asylum system and the immigration court system, where the consequences of incorrect information could be even more consequential.

About the Benchmark

Every question has an expert-written rubric: a list of items a complete answer must include. A rubric item counts as met when the model’s answers include it anywhere in the conversation, as judged by an AI grader (see Methodology). A model’s average answer accuracy is the share of each question’s rubric items it met, averaged over all questions.

Immigration experts drafted a benchmark of 519 questions designed to reflect the complexity and stakes of real immigration questions; not textbook scenarios, but the kinds of issues that actually appear on an attorney’s desk or in an immigrant’s search bar. Each question was written from the perspective of a specific persona, such as an international student, an employer, a DACA recipient, or a university advisor, reflecting the range of individuals who actually turn to AI for immigration support. Questions were designed around ambiguous facts, multi-step legal analysis, and situations where the wrong answer carries serious consequences. The goal was not to catch models out on technicalities, but to test whether the models can handle the kind of complexity that people actually encounter.

This page reports results on the 262-question test set, which is kept private to allow ongoing, tamper-resistant evaluation. The other 257 questions are not part of these results and are reserved for the labs to license for their own benchmarking and evaluation work.

See the full report for a representative question from each persona.

Results

Overall performance

The top-scoring model, Claude Fable 5.1, met an average of 75.4% of each question’s rubric items. This means that even the best AI model left out roughly one in four pieces of information an immigration expert would consider essential to a complete answer. Fully correct answers, where a model met every rubric item, were rare: the best rate was 26.3% (Claude Fable 5.1), and rates ranged from 12.6% to 26.3%.

Claude Fable 5.1 leads at 75.4%, 3.3 points ahead of Claude Opus 5.5 (72.1%), a clear lead: on the same questions it scores 1.2 to 5.4 points higher (95% interval). Behind it, 10 models scored within 4.4 points of each other (67.7% to 72.1%).

See the full report for how Claude Fable 5.1 did by persona and what the 25 models achieve together.

Significant challenges

Performance varied significantly across personas, from 85.6% average answer accuracy for International Students down to 48.5% for University Advisors. International Students, whose questions tend to be more standardized, such as questions related to Optional Practical Training (OPT) timelines, Curricular Practical Training (CPT) authorization, and maintaining status, received the most reliable answers. University Advisors scored lowest; their questions carry the longest rubrics in the benchmark with 19.5 items on average. Individuals with Fragile or Temporary Status scored second-lowest, at 51.1% average answer accuracy, and for these users the cost of a wrong answer is potentially the most severe. For every model, these two personas were consistently the two lowest.

The people in the most vulnerable immigration situations, likely with the least access to legal counsel, get the weakest answers

For individuals with fragile or temporary status, including DACA recipients and those on TPS, even the best model scored only 63.9% average answer accuracy. Some of the lowest-cost models tested scored as low as 38.9% for this persona.

AI knows the rules better than it knows how to apply them

This pattern holds at the rubric item level too. Rubric items requiring the model to confirm something about the person’s circumstances — their visa stage, their eligibility, their filing history — were met only 43% of the time, compared to 63% for items asking AI to explain the law or recommend a next step, and 86% for items warning it away from a specific mistake. AI is better suited as a research and explanation tool than as a diagnostic one. It can tell you what the law says — but it struggles to tell you what the law means for you. Asking the user more questions was not the fix: when a model asked questions in its first reply, it met about 4 points more of the fact-finding items on that question, but its overall score barely moved (under 1 point) and its legal guidance did not improve.

See the full report for the DACA renewal example, the low-cost models’ scores on Fragile / Temporary Status questions, and the questions models found hardest and easiest.

Persona Strengths Relative to the FieldEach model's score by persona, against the field mean on the same questions

Immigration Bench•Oct 28, 2026

Vs. field mean:

BelowAbove

Persona Strengths Relative to the Field

Models	International Student	International Scholar / Faculty	Employer	Entrepreneur	Self-Petitioner	Fragile / Temporary Status	University Advisor
Field mean	85.6	66.7	64.6	64.2	63.6	51.1	48.5
Claude Fable 5.1	90.2+4.6	74.8+8.1	76.1+11.5	72.9+8.7	74.5+11.0	63.9+12.8	60.9+12.4
Claude Opus 5.5	88.9+3.3	74.6+7.9	74.5+10.0	68.0+3.8	65.2+1.7	59.8+8.7	57.2+8.7
Wonder Full	88.2+2.7	73.4+6.7	74.9+10.4	68.9+4.7	66.9+3.3	55.3+4.2	53.6+5.1
Qwen 3.8 Max	86.7+1.1	71.8+5.1	64.9+0.3	71.5+7.2	71.2+7.6	55.1+4.0	53.0+4.5
Wonder	86.3+0.7	72.8+6.1	69.0+4.4	66.1+1.9	70.0+6.4	51.7+0.6	54.1+5.6
Claude Sonnet 5.5	86.5+1.0	65.6-1.2	70.9+6.3	69.6+5.4	63.60.0	57.7+6.6	51.3+2.8
Kimi K3	85.2-0.4	71.3+4.6	72.8+8.2	64.3+0.1	66.4+2.8	51.4+0.3	49.0+0.5
Gemini 4 Argon	86.6+1.0	67.6+0.9	63.9-0.6	61.3-2.9	71.3+7.7	55.5+4.4	51.9+3.4
Grok 4.7	87.2+1.7	71.7+5.0	64.0-0.6	64.0-0.2	65.3+1.7	53.3+2.2	51.8+3.3
GPT-6.1 Sol	88.3+2.8	70.4+3.6	66.0+1.4	66.7+2.5	63.9+0.3	50.1-1.0	48.60.0
GPT-6 Astra	88.6+3.0	69.9+3.2	68.2+3.7	68.6+4.4	58.4-5.2	49.4-1.7	49.6+1.1
MiMo V2.6 Pro	86.1+0.5	68.5+1.8	63.6-1.0	64.5+0.3	65.4+1.8	56.6+5.4	49.7+1.1
GLM 5.3	85.5-0.1	66.9+0.2	67.4+2.8	60.8-3.4	67.1+3.5	48.3-2.8	51.9+3.4
Muse Spark 1.2	86.3+0.8	66.5-0.3	62.5-2.1	67.5+3.3	65.5+1.9	48.9-2.2	48.50.0
Grok 4.6	84.0-1.5	69.4+2.7	61.7-2.9	63.9-0.3	66.2+2.6	52.9+1.8	45.7-2.8
DeepSeek V4.1 Flash	86.8+1.2	69.0+2.3	59.4-5.2	62.1-2.2	65.0+1.4	47.6-3.5	48.4-0.2
Muse Spark 1.3	83.4-2.2	65.5-1.2	62.5-2.1	64.8+0.6	61.8-1.7	50.3-0.8	48.2-0.3
Muse Spark 1.3 Max	86.6+1.0	63.1-3.7	64.2-0.4	63.7-0.5	58.3-5.3	50.6-0.6	46.6-2.0
Mistral Large 4	82.4-3.2	62.9-3.8	67.0+2.4	65.1+0.9	62.2-1.4	47.0-4.1	40.3-8.2
Gemini 3.8 Flash	84.3-1.3	63.2-3.5	61.0-3.6	60.5-3.8	58.4-5.2	49.8-1.4	46.1-2.4
GPT-6 Luna	83.8-1.7	65.3-1.4	55.3-9.3	63.4-0.8	58.4-5.2	43.3-7.9	46.7-1.8
Claude Haiku 5.5	83.9-1.7	58.8-8.0	60.8-3.8	57.3-6.9	57.8-5.8	54.5+3.4	38.4-10.1
DeepSeek V4 Pro 0813	82.2-3.3	59.5-7.2	55.0-9.6	63.7-0.5	61.1-2.5	43.1-8.0	46.2-2.3
MiniMax-M3	81.0-4.6	58.2-8.5	51.7-12.8	52.4-11.8	52.4-11.2	42.9-8.2	41.2-7.3
Gemini 3.5 Flash Lite	80.2-5.4	47.4-19.3	57.3-7.3	53.8-10.4	53.3-10.3	38.9-12.2	34.3-14.2

Personas run from easiest to hardest; models are ranked by overall score.Each cell shows the score and its difference from the 25-model mean, shaded fully at ±19 points.

The heatmap above removes question difficulty: each cell is a model’s score on that persona minus the 25-model mean on the same questions. Every model scores 29 to 46 points lower on University Advisor questions than on International Student questions.

With 30 to 64 questions per persona, the standard error on a persona score is about 2 to 6 points. Thus, these scores should be read as indicative rather than definitive.

Where the Field AgreesCriteria every model passes or fails, by persona

Immigration Bench•Oct 28, 2026

Share of criteria

Criteria:

All models passSplitAll models fail

Checks / QField meanBest-of-field

International Student64 questions553 criteria

57%38%

8.6

85.6%

95.2%

International Scholar / Faculty33 questions519 criteria

21%74%

15.7

66.7%

86.2%

Employer34 questions164 criteria

16%79%

4.8

64.6%

93.8%

Entrepreneur34 questions166 criteria

20%73%

4.9

64.2%

88.9%

Self-Petitioner34 questions150 criteria

16%76%8%

4.4

63.6%

89.2%

Fragile / Temporary Status30 questions279 criteria

18%63%19%

9.3

51.1%

73.5%

University Advisor33 questions643 criteria

10%74%16%

19.5

48.5%

70.6%

262 questions across 25 models, an unfinished conversation failing every criterion: 2,474 criteria, 245 of them failed by every model.Best-of-field is the mean score if the best model were picked for each question.

AI is flying blind on recent immigration law

Immigration policy has changed significantly in 2025 and 2026, with new rules affecting OPT, H-1B, and other key pathways. 65 rubric items cite a rule from 2025 or 2026. Without web search, pooled across all 25 models, these rubric items were met 7.3% of the time, against 64.0% for every other item. The best model on these items, Claude Fable 5.1, met these rubric items 18.5% of the time. Even with web search, these rubric items were met only 29% of the time.

For example, when an international student asked how the end of “duration of status” affects them, no model distinguished, without web search, between students admitted before and after the July 2026 DHS Duration of Status final rule was scheduled to take effect. With web search, only 3 of 25 did (see Example 1).

The takeaway: users should verify anything touching on recent policy against primary sources such as USCIS.gov, the Federal Register, or current agency guidance, whether or not the tool searches the web.

2025–2026 Policy CriteriaPass rate on criteria citing a 2025 or 2026 rule, against all other criteria

Immigration Bench•Oct 28, 2026

Pass rate

Criteria:

Other criteriaCriteria citing a ’25 or ’26 rule

Claude Fable 5.1

73.4%

18.5%

Claude Opus 5.5

70.4%

18.5%

Wonder Full

69.1%

9.2%

Qwen 3.8 Max

68.4%

4.6%

Wonder

67.8%

4.6%

Grok 4.7

66.7%

6.2%

Claude Sonnet 5.5

66.5%

12.3%

MiMo V2.6 Pro

66.1%

6.2%

Gemini 4 Argon

66.0%

4.6%

Kimi K3

65.8%

6.2%

GLM 5.3

65.1%

3.1%

GPT-6.1 Sol

65.0%

12.3%

GPT-6 Astra

64.8%

13.8%

DeepSeek V4.1 Flash

64.3%

3.1%

Muse Spark 1.2

64.3%

6.2%

Grok 4.6

63.5%

4.6%

Muse Spark 1.3

62.6%

4.6%

Muse Spark 1.3 Max

62.4%

4.6%

Gemini 3.8 Flash

61.6%

3.1%

GPT-6 Luna

60.8%

10.8%

Mistral Large 4

60.3%

7.7%

DeepSeek V4 Pro 0813

59.5%

3.1%

Claude Haiku 5.5

58.2%

10.8%

MiniMax-M3

56.5%

1.5%

Gemini 3.5 Flash Lite

51.8%

3.1%

View 15 more models

Rows are ranked by pass rate on other criteria.Rates cover 1,625 dated and 60,225 other scored checks across 25 models.

Does turning on web search help?

We also tested every model with web search enabled, on the exact same questions and with the same simulated person and grader. Web search helped some models substantially: MiniMax-M3 (an increase of 9.1 points), Claude Haiku 5.5 (an increase of 9.0 points) and DeepSeek V4.1 Flash (an increase of 8.3 points). For 7 of the 25 models run with search, it added less than two points, including Claude Fable 5.1 (1.2 points).

No Search vs. Web SearchSame model, same questions: accuracy on every question

Immigration Bench•Oct 28, 2026

Accuracy

Run:

No search (board run)Web search

ChangeQuestions

Qwen 3.8 Max

70.1%

77.5%

+7.4

262

Claude Fable 5.1

75.4%

76.6%

+1.2

262

Wonder Full

71.2%

76.3%

+5.1

262

Claude Opus 5.5

72.1%

75.1%

+3.0

262

Claude Sonnet 5.5

69.0%

74.3%

+5.3

262

Grok 4.7

68.0%

74.1%

+6.1

262

DeepSeek V4.1 Flash

65.6%

73.9%

+8.3

262

Wonder

69.6%

73.8%

+4.2

262

GLM 5.3

66.7%

73.7%

+7.0

262

MiMo V2.6 Pro

67.5%

72.3%

+4.8

262

Grok 4.6

66.0%

72.1%

+6.1

262

Mistral Large 4

63.7%

71.5%

+7.8

262

Claude Haiku 5.5

61.8%

70.8%

+9.0

262

Muse Spark 1.3 Max

64.9%

70.8%

+5.9

262

Muse Spark 1.3

65.0%

70.4%

+5.4

262

Muse Spark 1.2

66.5%

70.2%

+3.7

262

Gemini 4 Argon

68.1%

70.0%

+1.9

262

GPT-6.1 Sol

67.8%

69.2%

+1.4

262

Kimi K3

68.3%

69.1%

+0.8

262

GPT-6 Astra

67.7%

68.8%

+1.1

262

DeepSeek V4 Pro 0813

61.7%

68.2%

+6.5

262

MiniMax-M3

57.5%

66.6%

+9.1

262

Gemini 3.8 Flash

63.4%

65.0%

+1.6

262

GPT-6 Luna

62.5%

64.3%

+1.8

262

Gemini 3.5 Flash Lite

55.7%

58.5%

+2.8

262

View 15 more models

Search scores are not on the leaderboard. As on the leaderboard, a conversation that did not finish scores 0.

By persona, web search helped most on Employer questions, adding 10.4 points on average, adding 6.0 points for University Advisor questions, the next largest, and 1.6 points for International Student questions. Models searched in nearly every conversation (98.9%), but how much they searched did not predict how much they gained: GPT-6 Luna averaged over 100 searches per conversation and gained only 1.8 points, while DeepSeek V4 Pro averaged about 10 searches and gained 6.5 points.

Web Search Gains by PersonaAccuracy across 25 models

Immigration Bench•Oct 28, 2026

Accuracy

Run:

No search (board run)Web search

ChangeQuestions

Employer

64.6%

74.9%

+10.4

34

University Advisor

48.5%

54.6%

+6.0

33

Self-Petitioner

63.6%

69.0%

+5.4

34

Entrepreneur

64.2%

69.1%

+4.9

34

International Scholar / Faculty

66.7%

70.4%

+3.7

33

Fragile / Temporary Status

51.1%

54.6%

+3.4

30

International Student

85.6%

87.1%

+1.6

64

Each model is compared with itself on every question, an unfinished conversation scoring 0, then averaged across the 25 models.Rows are sorted by gain.

Search helped most on recent policy: every model met more of the 2025 and 2026 rubric items with web search, but even the best model reached only 43.1% on those items. The takeaway: web search is not a reliable fix for the knowledge gaps these models have on immigration law.

2025–2026 Policy Criteria With Web SearchPass rate on dated and all other criteria, with and without web search

Immigration Bench•Oct 28, 2026

Pass rate

Criteria:

Other criteria2025–26 rules

Run:

Web searchNo search

Qwen 3.8 Max

74.3%

68.4%

43.1%

4.6%

Claude Opus 5.5

71.6%

70.4%

43.1%

18.5%

Claude Haiku 5.5

66.5%

58.2%

41.5%

10.8%

Claude Sonnet 5.5

70.4%

66.5%

40.0%

12.3%

Claude Fable 5.1

73.3%

73.4%

38.5%

18.5%

Mistral Large 4

69.3%

60.3%

35.4%

7.7%

MiMo V2.6 Pro

69.8%

66.1%

35.4%

6.2%

DeepSeek V4.1 Flash

70.6%

64.3%

33.8%

3.1%

GLM 5.3

70.1%

65.1%

32.3%

3.1%

Muse Spark 1.3 Max

68.6%

62.4%

30.8%

4.6%

Gemini 4 Argon

66.4%

66.0%

26.2%

4.6%

Kimi K3

65.6%

65.8%

26.2%

6.2%

GPT-6 Luna

61.0%

60.8%

26.2%

10.8%

DeepSeek V4 Pro 0813

64.7%

59.5%

24.6%

3.1%

Grok 4.6

68.7%

63.5%

24.6%

4.6%

Wonder

70.2%

67.8%

24.6%

4.6%

Muse Spark 1.3

67.5%

62.6%

24.6%

4.6%

GPT-6 Astra

66.5%

64.8%

24.6%

13.8%

GPT-6.1 Sol

66.2%

65.0%

24.6%

12.3%

Grok 4.7

71.5%

66.7%

23.1%

6.2%

Wonder Full

72.8%

69.1%

23.1%

9.2%

Muse Spark 1.2

67.6%

64.3%

23.1%

6.2%

MiniMax-M3

63.1%

56.5%

23.1%

1.5%

Gemini 3.5 Flash Lite

54.7%

51.8%

13.8%

3.1%

Gemini 3.8 Flash

63.0%

61.6%

7.7%

3.1%

View 15 more models

Rows are ranked by pass rate on 2025–26 rules with search.Search scores are not on the leaderboard; each model is paired with itself on the test set.

See the full report for web search gains by model and persona, two examples where web search made the difference, how much longer conversations took, how answer length affects the ranking, and which websites models read.

Cost and speed matter too

Cost does not have to mean a large drop in quality for some models.

The top-ranked model, Claude Fable 5.1, costs roughly $2.11 per question. Lower-cost models from U.S. developers come within 7.4 to 8.9 points of it for a fraction of the price: Grok 4.7 and GPT-6.1 Sol score 68.0% and 67.8% for about 24 cents a question, nearly nine times cheaper, and Muse Spark 1.2 scores 66.5% for under 4 cents, more than 50 times cheaper. That makes them practical options for legal aid organizations, nonprofits, and others operating on limited budgets. The steep drop comes at the very cheapest tier: on Fragile/Temporary Status questions, Gemini 3.5 Flash Lite scored 38.9%, against 63.9% for Claude Fable 5.1 — a 26-point gap for the population that can least afford bad advice.

Speed is also a practical concern. Claude Fable 5.1 takes about 7 minutes per conversation, and a person seeking help may give up before they receive a complete answer. Muse Spark 1.2, 8.9 points below the top score, finished in about 40 seconds.

See the full report for a note on cost and token use and the free and low-cost models most people reach first.

What This Means for the Immigration Community

• For immigration attorneys: AI can assist with general research and drafting, but should not be relied on to independently advise clients on their specific situation. The gaps in applying the law to a client’s facts are particularly concerning.
• For universities’ international offices: AI performed the worst on the University Advisor persona – questions from school officials advising students – which carry the longest rubrics in the benchmark. Before relying on AI for compliance guidance, Designated School Officials (DSOs) should test it against their most common scenarios and verify its answers against government guidance and the institution’s legal counsel.
• For employers and HR teams: AI performed in the mid-range on Employer questions, and web search helped more on these than on any other persona. It may be useful for general orientation to a visa category, but should not substitute for counsel on specific sponsorship decisions or compliance requirements.
• For legal aid organizations: Of the seven personas, individuals with Fragile or Temporary Status ranked second lowest, just above University Advisors. This benchmark gives concrete evidence of the risks when clients rely on AI for immigration guidance, and a basis for educating them about those risks.

What This Means for AI Labs

This benchmark gives every lab whose model was tested a concrete, evidence-based picture of where it stands. These findings demonstrate the need for progress on at least three fronts:

• Prioritize keeping models current in fast-moving regulatory domains. Immigration law changes constantly, through executive orders, agency policy memos, court decisions, and rulemaking. Models met only 7.3% of rubric items involving rules from 2025 and 2026, and web search only partly closed that gap. Improvements could include more retrieval-augmented tools, real-time policy feeds, and clear disclosures when a model’s knowledge may be out of date.
• Improve how models apply the law to a person’s situation, not just explain it. Knowing the law is not enough; the gap that matters is between explaining a general rule and working out what it means for the specific individual asking. That is where AI falls short most often, and where improvement would have the greatest impact. As in other domains, there is a need for improving how models identify what they need to know about a person’s situation before giving advice, and how they apply general rules to specific circumstances.
• Engage with experts to expand training data access. Much of the knowledge reliable immigration advice depends on is not publicly available in formats AI systems can use. Closing this gap requires proactive collaboration between labs and the immigration legal community on data-sharing arrangements and retrieval-grounded tools.

Methodology

This benchmark was designed to reflect how real people interact with AI on immigration questions, not how researchers in a lab might test a model.

Scoring rubrics

For each question, experts wrote a rubric, which consisted of a checklist of everything a complete and accurate answer must cover: the key legal thresholds, factual elements, recommended next steps, and statements a model should explicitly avoid saying (such as guaranteeing an outcome). All rubrics were cross-reviewed by a second expert before being used. Rubric items were grouped by type into actions a model should confirm about the individual’s situation, points it should explain or recommend, and statements it should avoid — categorized automatically based on each item’s leading verb. Items that only list legal authorities are recorded but not scored.

Evaluation pipeline

Rather than asking each model a single question, we simulated a realistic conversation of up to five exchanges. The benchmark uses three models in different roles:

1. Tested model: receives the question and tries to help.
2. Simulated person: GPT-6 Luna plays the person asking, given the persona’s facts and background, and answers the tested model’s follow-up questions from those facts only.
3. Grader: Claude Sonnet 5 evaluates every rubric item as met or not met against the full transcript, with a reason. It was selected through alignment testing with human experts: two immigration experts independently graded the same conversations, and on the rubric items where they agreed, Claude Sonnet 5 matched their verdict 88.6% of the time, the highest of the graders tested.

An item counts as met if the model covers it anywhere in the conversation, not just in its first response. Every model was run twice: once on its own, and once with web search, which could access pages published up to September 21, 2026, the date the question set was finalized. Each conversation had a 30-minute time limit, or three hours with web search; a conversation that exceeded its limit scored zero, and comparisons with and without web search use the questions a model finished in both conditions. Conversations that failed for infrastructure reasons, including grading failures, were re-run. Models were accessed through their providers’ APIs at default settings.

See the full report for how the simulated person was chosen.

Example Questions and Scoring

See the full report for all nine example questions; one is shown here.

Conclusion

This benchmark is a first step, not a final word. Our goal is not to discourage the use of AI in immigration; it is to ensure that AI is used responsibly, with a clear understanding of where it falls short and what is at stake when it does. AI has real potential to expand access to immigration information, but only if it is accurate. Right now, the gaps are too significant to rely on AI alone for anything but general orientation.

AI is most reliable on settled, foundational law. It is least reliable on recent policy changes, on questions that require applying the law to a specific person’s facts, and for people with fragile or temporary status. Closing those gaps will take AI labs, legal practitioners, policymakers, and other stakeholders working together to build tools tested against the questions real people actually ask.

This benchmark exists because a team of immigration experts wrote 519 questions and cross-reviewed every rubric. We are grateful for their work.

Citation

Talent Mobility Fund and Vals AI, Can AI Get Immigration Right? An Independent Evaluation of AI Performance on U.S. Immigration Law Questions, October 2026. https://vals.ai/benchmarks/immigration

@misc{immigration2026,
title        = {Can AI Get Immigration Right? An Independent Evaluation
                of AI Performance on U.S. Immigration Law Questions},
author       = {{Talent Mobility Fund} and {Vals AI}},
year         = {2026},
month        = oct,
howpublished = {Vals AI},
url          = {https://vals.ai/benchmarks/immigration},
}