Plugin Eval plugin for Codex
Ask Codex to evaluate a plugin or skill, give you a full analysis of a named plugin such as game-studio, explain why it scored that way, show what to fix first, explain its token budget, measure real token usage, benchmark a plugin, or tell you what to run next. Plugin Eval keeps the path engineer-friendly: start with a natural chat request, then use the local `plugin-eval start` entrypoint or the routed workflow command it recommends.
How to install Plugin Eval in Codex
codex plugin add plugin-eval@openai-curatedCommand format from the Codex CLI reference (codex plugin add <plugin[@marketplace]>); openai-curated is the marketplace name in OpenAI's catalog file. You need to be signed in to Codex. Source: Codex CLI reference.
Or in Codex CLI type /plugins and pick it from the OpenAI curated marketplace; in the ChatGPT desktop app, open the Plugins tab. Start a new session afterwards so the plugin's skills and tools load. (OpenAI plugin docs)
What it contains
Skills (5)
evaluate-plugin— Evaluate a local Codex plugin in engineer-friendly language. Use when the user says "evaluate this plugin", "audit this plugin", "why did this score that way", "what should I fix first", "help me benchmark this plugin", or asks for a plugin-wide report…evaluate-skill— Evaluate a local Codex skill in engineer-friendly terms. Use when the user says "evaluate this skill", "give me an analysis of the game dev skill", "audit this skill", "why did this score that way", "what should I fix first", or asks for a skill-specific…improve-skill— Turn plugin-eval findings into a concrete rewrite brief for a Codex skill. Use when the user already evaluated a skill and now wants Codex to improve it, especially after asking what to fix first.metric-pack-designer— Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics. Use when the user wants their own evaluation criteria or visualizations.plugin-eval— Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next. Use when the user says things like "evaluate this skill", "give me an…
Example prompts from the manifest
- Give me an analysis of the game studio plugin.
- Evaluate this plugin.
- Why did this score that way?
About this listing
Plugin Eval is in OpenAI's official curated Codex plugin catalog, published by OpenAI Codex. It shows up in the Codex CLI plugin browser (/plugins) and in the ChatGPT desktop app's Plugins tab. The catalog lists it for the Codex product only. From its files we found 5 skills. The manifest says version 0.1.2. It's one of 79 listings in the Developer Tools category.
Get new Codex plugins like Plugin Eval every week
The weekly CodexStacks drop: what's new and updated in the directory, in one short email.
You'll get a confirmation email first. Unsubscribe anytime.
Plugin Eval FAQ
How do I install Plugin Eval in Codex?
Run codex plugin add plugin-eval@openai-curated (format from the Codex CLI reference). Or in Codex CLI type /plugins and pick it from the OpenAI curated marketplace; in the ChatGPT desktop app, open the Plugins tab. Start a new session afterwards so the plugin's skills and tools load.
Is Plugin Eval an official Codex plugin?
Yes. Plugin Eval is in OpenAI's official curated Codex plugin catalog (marketplace openai-curated), published by OpenAI Codex. It appears in the Codex CLI plugin browser and the ChatGPT desktop app's Plugins tab.
What does Plugin Eval include?
From its files in OpenAI's plugin repo, Plugin Eval includes 5 skills: evaluate-plugin, evaluate-skill, improve-skill, metric-pack-designer, plugin-eval.
Details
- Type
- Plugin
- Category
- Developer Tools
- Source
- Official OpenAI curated
- Publisher
- OpenAI Codex
- Version
- 0.1.2
- License
- MIT
- Sign-in
- Asks you to connect/sign in when you install it
- Availability
- Codex only (per the catalog's products field)
- Keywords
- codex, plugin, skill, evaluation, quality, budget
- Source
- https://github.com/openai/plugins/tree/main/plugins/plugin-eval
- Website
- https://openai.com/
- Listed in
- OpenAI catalog file
- Tested by CodexStacks
- Not yet
Something wrong or missing? Submit or improve this listing. Listings also refresh automatically every night.
For maintainers: badge and embeds
Maintain Plugin Eval? Add the badge; it links to this page.
Markdown
[](https://codexstacks.com/p/plugin-eval/)HTML
<a href="https://codexstacks.com/p/plugin-eval/"><img src="https://codexstacks.com/badge.svg" alt="Listed on CodexStacks" width="172" height="28"></a>Embed card (static HTML and inline CSS, no JavaScript). Preview:
<a href="https://codexstacks.com/p/plugin-eval/" style="display:block;max-width:380px;box-sizing:border-box;padding:14px 16px;border:1px solid #3a2c26;border-radius:12px;background:#0d0b0a;color:#f3ece6;font:14px/1.45 -apple-system,Segoe UI,Roboto,Helvetica,Arial,sans-serif;text-decoration:none"><span style="display:block;font-size:16px;font-weight:700;color:#f3ece6">Plugin Eval</span><span style="display:block;margin:2px 0 8px;font-size:12px;color:#b5a9a1">Official Codex plugin · 5 skills</span><span style="display:block;margin:0 0 10px;color:#ddd3cc">Ask Codex to evaluate a plugin or skill, give you a full analysis of a named plugin such as game-studio, explain why…</span><span style="font-size:12px;font-weight:600;color:#ffb347">View on CodexStacks →</span></a>Markdown summary
**[Plugin Eval on CodexStacks](https://codexstacks.com/p/plugin-eval/)**: Official Codex plugin with 5 skills. Install: `codex plugin add plugin-eval@openai-curated`More on badges, embeds and keeping your listing up to date: CodexStacks for plugin authors.
Also in Developer Tools
Build iOS Apps
Use Build iOS Apps to design App Intents and App Shortcuts, build or refactor SwiftUI UI, render SwiftUI previews in the Codex in-app browser, adopt modern iOS patterns such as Liquid Glass, audit runtime performance, capture ETTrace profiles, investigate memory leaks, and debug apps on simulators with XcodeBuildMCP-backed workflows.
Build macOS Apps
macOS development workflows for discovering local projects, building and running desktop apps, implementing native SwiftUI scenes, bridging into AppKit when necessary, adding lightweight Logger telemetry, triaging test failures, inspecting signing and entitlements, and debugging desktop-specific build or runtime errors.
Build Web Apps
Use Build Web Apps to create frontend application surfaces with Codex-generated visual assets, verify them with the Browser plugin and built-in app browser, compose shadcn/ui, wire Stripe payments, and design or tune Supabase/Postgres data flows.
Build Web Data Visualization
Use Build Web Data Visualization to choose, design, implement, test, and export browser charts, dashboards, maps, WebGL/Three.js scenes, Canvas/D3 visuals, Gantt charts, UML/software diagrams, scrollytelling, reports, PDFs, and slide decks. It emphasizes source-backed data, accessible responsive layouts, URL-shareable analysis state, and concept-first design for advanced visual stories.
CircleCI
Bring testing, deployment, and CI best practices into Codex
Cloudflare
Bring Cloudflare platform guidance into Codex with curated skills for the broader platform, Wrangler CLI, and the Agents SDK, plus the official Cloudflare API MCP server for authenticated access to live account data and workflows across Workers, Pages, storage, AI, networking, security, and analytics services.