Archive position — measured, not model output
1 like on Devpost
506 of the 7,856 archived projects have more likes, and 1,758 share exactly 1 — so this project's #1,675 place in the like-ranked listing is a tie-break inside that group, not a ranking.
Projects (log scale)
Likes on Devpost. ▲ marks this project's group.
Show the figures
| Likes | Projects | Share of archive |
|---|---|---|
| 0 | 5,592 | 71.2% |
| 1 | 1,758 | 22.4% |
| 2 | 285 | 3.6% |
| 3–4 | 132 | 1.7% |
| 5–9 | 75 | 1.0% |
| 10+ | 14 | 0.2% |
Executive Summary
What the company appears to be
PlotProof for MATLAB is a self-reported tool that uses AI (specifically Codex + GPT-5.6 Sol) to review scientific charts generated in MATLAB. It compares multiple ranked chart candidates, applies controlled repairs, and exports reproducible evidence.
What changed
The author describes building this as part of an OpenAI 2026 hackathon submission. The project includes a demo workflow with validation gates, adversarial testing, and offline HTML reporting — all self-reported by the single-member team.
Single most important open question
Is there any evidence of real-world usage or adoption beyond the author’s own development and demonstration?
Note: This analysis is based entirely on the self-reported project description provided. No external verification, traction data, revenue figures, customer names, or independent sources are available. All claims are treated as stated by the author.
What The Product Actually Is
The description states that PlotProof for MATLAB:
- Reads CSV, Excel, or MAT data
- Uses a MATLAB plotting engine to render two to five ranked chart candidates
- Applies GPT-5.6 Sol in Codex to review candidate images against research goals
- Scores claims on support, legibility, accessibility, honesty, and reproducibility
- Enforces strict schema validation before MATLAB starts
- Allows only five controlled figure repairs (no executable MATLAB code)
- Exports PNG/SVG figures, before-and-after comparisons, Markdown/JSON evidence, and a self-contained HTML decision report
- Includes a manifest recording byte count and SHA-256 digest of source artifacts for tamper-proofing
Inference: The product is not a general-purpose charting tool but a specialized workflow for scientific visualization review with AI-assisted quality control.
Positioning & Claim Evolution
The author claims:
- A scientific chart can be polished and still be misleading
- Rule-based recommenders are useful but assign meaning the data does not contain
- The goal is to go beyond generating figures — challenge choices, leave evidence for every decision
Claim: This positions PlotProof as a tool for improving reproducibility and transparency in scientific visualization workflows.
Inference: It evolved from a hackathon idea into a structured system with validation layers, adversarial testing, and offline reporting capabilities.
Target Customer & ICP
The description does not explicitly name target customers or personas. However:
- The tool is built for MATLAB users who generate scientific charts
- It targets researchers or data scientists working in environments where chart accuracy and reproducibility matter
- The focus on controlled repairs and evidence suggests it may appeal to those needing audit trails or compliance
Not evidenced: No explicit customer segments, use cases, or ICP defined.
Business Model & Pricing Evidence
There is no mention of pricing, monetization strategy, or business model in the description.
Not evidenced: No indication of how this would be sold or whether it has a commercial model.
Technical & Delivery Signals
The author states:
- Built with bash, codex, github, json, matlab, openai, python
- Uses MATLAB R2025a
- Implements Codex as primary development environment
- Includes contract tests, validation gates, adversarial benchmarking
- Has a release gate including shell, unit, visual, privacy, provenance, and GitHub Actions checks
- Demonstrates offline HTML report generation with embedded evidence
Inference: The technical stack shows integration of AI (Codex/GPT), MATLAB, and CI/CD practices. It suggests a focus on robustness and reproducibility.
Traction & Maturity Signals
The description includes:
- One-command demo workflow
- 15/15 reproducible contract checks
- All 14 adversarial outputs fail closed
- SHA-256 integrity verification across 12 real MATLAB evidence artifacts
- A GitHub repository with documented development history and test results
Not evidenced: No user feedback, customer base, or adoption metrics beyond the author’s own testing.
Competitive Context
The description does not reference competitors or existing tools in the space. It implies a niche for AI-assisted scientific chart review, especially where reproducibility and auditability are important.
Not evidenced: No competitive landscape or market positioning provided.
Key Risks & Red Flags
- The project is self-reported by one person (William Isode) with no third-party validation
- No evidence of real-world usage or customer feedback
- No mention of scalability, integration with other tools, or enterprise readiness
- The tool is tied to a specific MATLAB version (R2025a), which may limit adoption
- The claim that GPT-5.6 Sol reviews images and scores them raises questions about image-to-text accuracy and consistency
Inference: The project appears experimental and limited in scope, with no clear path to commercial viability or widespread use.
Diligence Questions To Ask The Founders
- What is the actual workflow for integrating this into a research lab or engineering team?
- How does it handle edge cases not covered in the demo?
- Are there plans to support other plotting environments beyond MATLAB?
- Has anyone outside of the author tested or used this tool?
- What are the long-term maintenance and upgrade plans for MATLAB compatibility?
Investment/Partnership Verdict
This is a self-reported hackathon project with no demonstrated traction, revenue, or customer base. It shows technical sophistication in building a controlled review loop with AI and MATLAB, but lacks evidence of commercial viability or real-world application.
Confidence level: Low
Verdict: Not ready for investment or partnership consideration without further evidence of market demand, user feedback, or product maturity.
Source
Submitted to the OpenAI 2026 hackathon on Devpost. Project home on DevPost.
The analysis above was generated by a language model from the project's own one-line description. It is not independent research and contains no verified traction, revenue or customer data.
