OpenAI 2026 hackathon

PlotProof for MATLAB

A Codex-native review loop that catches misleading MATLAB charts, applies controlled repairs, and exports reproducible evidence.

Solo project by William Isode · 1 likes · 0 comments

Archive position — measured, not model output

1 like on Devpost

506 of the 7,856 archived projects have more likes, and 1,758 share exactly 1 — so this project's #1,675 place in the like-ranked listing is a tie-break inside that group, not a ranking.

Projects (log scale)

1
10
100
1k
10k
05,592
11,758
2285
3–4132
5–975
10+14

Likes on Devpost. ▲ marks this project's group.

Show the figures
LikesProjectsShare of archive
05,59271.2%
11,75822.4%
22853.6%
3–41321.7%
5–9751.0%
10+140.2%
Devpost like counts for all 7,856 archived projects, captured when this archive was built.

Executive Summary

What the company appears to be

PlotProof for MATLAB is a self-reported tool that uses AI (specifically Codex + GPT-5.6 Sol) to review scientific charts generated in MATLAB. It compares multiple ranked chart candidates, applies controlled repairs, and exports reproducible evidence.

What changed

The author describes building this as part of an OpenAI 2026 hackathon submission. The project includes a demo workflow with validation gates, adversarial testing, and offline HTML reporting — all self-reported by the single-member team.

Single most important open question

Is there any evidence of real-world usage or adoption beyond the author’s own development and demonstration?

Note: This analysis is based entirely on the self-reported project description provided. No external verification, traction data, revenue figures, customer names, or independent sources are available. All claims are treated as stated by the author.

Back to contents

What The Product Actually Is

The description states that PlotProof for MATLAB:

  • Reads CSV, Excel, or MAT data
  • Uses a MATLAB plotting engine to render two to five ranked chart candidates
  • Applies GPT-5.6 Sol in Codex to review candidate images against research goals
  • Scores claims on support, legibility, accessibility, honesty, and reproducibility
  • Enforces strict schema validation before MATLAB starts
  • Allows only five controlled figure repairs (no executable MATLAB code)
  • Exports PNG/SVG figures, before-and-after comparisons, Markdown/JSON evidence, and a self-contained HTML decision report
  • Includes a manifest recording byte count and SHA-256 digest of source artifacts for tamper-proofing

Inference: The product is not a general-purpose charting tool but a specialized workflow for scientific visualization review with AI-assisted quality control.

Back to contents

Positioning & Claim Evolution

The author claims:

  • A scientific chart can be polished and still be misleading
  • Rule-based recommenders are useful but assign meaning the data does not contain
  • The goal is to go beyond generating figures — challenge choices, leave evidence for every decision

Claim: This positions PlotProof as a tool for improving reproducibility and transparency in scientific visualization workflows.

Inference: It evolved from a hackathon idea into a structured system with validation layers, adversarial testing, and offline reporting capabilities.

Back to contents

Target Customer & ICP

The description does not explicitly name target customers or personas. However:

  • The tool is built for MATLAB users who generate scientific charts
  • It targets researchers or data scientists working in environments where chart accuracy and reproducibility matter
  • The focus on controlled repairs and evidence suggests it may appeal to those needing audit trails or compliance

Not evidenced: No explicit customer segments, use cases, or ICP defined.

Back to contents

Business Model & Pricing Evidence

There is no mention of pricing, monetization strategy, or business model in the description.

Not evidenced: No indication of how this would be sold or whether it has a commercial model.

Back to contents

Technical & Delivery Signals

The author states:

  • Built with bash, codex, github, json, matlab, openai, python
  • Uses MATLAB R2025a
  • Implements Codex as primary development environment
  • Includes contract tests, validation gates, adversarial benchmarking
  • Has a release gate including shell, unit, visual, privacy, provenance, and GitHub Actions checks
  • Demonstrates offline HTML report generation with embedded evidence

Inference: The technical stack shows integration of AI (Codex/GPT), MATLAB, and CI/CD practices. It suggests a focus on robustness and reproducibility.

Back to contents

Traction & Maturity Signals

The description includes:

  • One-command demo workflow
  • 15/15 reproducible contract checks
  • All 14 adversarial outputs fail closed
  • SHA-256 integrity verification across 12 real MATLAB evidence artifacts
  • A GitHub repository with documented development history and test results

Not evidenced: No user feedback, customer base, or adoption metrics beyond the author’s own testing.

Back to contents

Competitive Context

The description does not reference competitors or existing tools in the space. It implies a niche for AI-assisted scientific chart review, especially where reproducibility and auditability are important.

Not evidenced: No competitive landscape or market positioning provided.

Back to contents

Key Risks & Red Flags

  • The project is self-reported by one person (William Isode) with no third-party validation
  • No evidence of real-world usage or customer feedback
  • No mention of scalability, integration with other tools, or enterprise readiness
  • The tool is tied to a specific MATLAB version (R2025a), which may limit adoption
  • The claim that GPT-5.6 Sol reviews images and scores them raises questions about image-to-text accuracy and consistency

Inference: The project appears experimental and limited in scope, with no clear path to commercial viability or widespread use.

Back to contents

Diligence Questions To Ask The Founders

  1. What is the actual workflow for integrating this into a research lab or engineering team?
  2. How does it handle edge cases not covered in the demo?
  3. Are there plans to support other plotting environments beyond MATLAB?
  4. Has anyone outside of the author tested or used this tool?
  5. What are the long-term maintenance and upgrade plans for MATLAB compatibility?

Back to contents

Investment/Partnership Verdict

This is a self-reported hackathon project with no demonstrated traction, revenue, or customer base. It shows technical sophistication in building a controlled review loop with AI and MATLAB, but lacks evidence of commercial viability or real-world application.

Confidence level: Low

Verdict: Not ready for investment or partnership consideration without further evidence of market demand, user feedback, or product maturity.

Back to contents

Source

Submitted to the OpenAI 2026 hackathon on Devpost. Project home on DevPost.

The analysis above was generated by a language model from the project's own one-line description. It is not independent research and contains no verified traction, revenue or customer data.