Skip to content

feat(experiments): add gpt-5.5-pro#20

Open
Niki2k1 wants to merge 3 commits into
nuxt:mainfrom
Niki2k1:claude/add-gpt-5.5-eval-F9MPc
Open

feat(experiments): add gpt-5.5-pro#20
Niki2k1 wants to merge 3 commits into
nuxt:mainfrom
Niki2k1:claude/add-gpt-5.5-eval-F9MPc

Conversation

@Niki2k1
Copy link
Copy Markdown

@Niki2k1 Niki2k1 commented May 16, 2026

Adds a gpt-5.5-xhigh experiment using the codex agent with reasoningEffort=xhigh, matching the existing gpt-5.4-xhigh config. Registers it in scripts/export-results.ts and the README models table.

Note

Transparency: this PR was vibecoded — written by an AI agent and only watched over by a human. Flagging so reviewers know to scrutinize accordingly.

@vercel
Copy link
Copy Markdown

vercel Bot commented May 16, 2026

@claude is attempting to deploy a commit to the Nuxt Team on Vercel.

A member of the Team first needs to authorize it.

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 16, 2026

Review Change Stack

📝 Walkthrough

Walkthrough

This PR adds support for a new gpt-5.5-xhigh experiment configuration. The change spans three files: a new experiment config file that defines the setup with the codex agent and gpt-5.5?reasoningEffort=xhigh model, a script entry that maps the experiment key to a display name for results export, and a README update that documents the new model in the supported models table.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Title check ⚠️ Warning The PR title states 'feat(experiments): add gpt-5.5-pro' but the actual changes add 'gpt-5.5-xhigh', not 'gpt-5.5-pro'. This is a clear mismatch. Update the PR title to 'feat(experiments): add gpt-5.5-xhigh' to accurately reflect the experiment being added.
✅ Passed checks (4 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description check ✅ Passed The pull request description clearly explains the changes: adding a gpt-5.5-xhigh experiment with specific configuration details and where it's registered.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Adds the GPT 5.5 (xhigh) model as a new eval experiment, matching the
existing gpt-5.4-xhigh config and registering it in MODEL_NAMES and the
README models table.

https://claude.ai/code/session_01Qhtx79h1nu23gBZvQqZpnp
@Niki2k1 Niki2k1 force-pushed the claude/add-gpt-5.5-eval-F9MPc branch from 95c5d08 to 6025810 Compare May 16, 2026 14:13
match upstream next-evals-oss config: use vercel-ai-gateway/codex agent
with openai/gpt-5.5-pro model, timeout 1800, runs 1.
@benjamincanac benjamincanac changed the title feat(experiments): add gpt-5.5-xhigh feat(experiments): add gpt-5.5-pro May 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants