OpenAI 2026 hackathon

ProofMode

An autonomous AI QA agent that verifies whether software actually delivers what it promises, using real browser tests, screenshots, and evidence-backed fixes.

Solo project by Maanya Chugh · 0 likes · 0 comments

Archive position — measured, not model output

0 likes on Devpost

2,264 of the 7,856 archived projects have more likes, and 5,592 share exactly 0 — so this project's #6,140 place in the like-ranked listing is a tie-break inside that group, not a ranking.

Projects (log scale)

1
10
100
1k
10k
05,592
11,758
2285
3–4132
5–975
10+14

Likes on Devpost. ▲ marks this project's group.

Show the figures
LikesProjectsShare of archive
05,59271.2%
11,75822.4%
22853.6%
3–41321.7%
5–9751.0%
10+140.2%
Devpost like counts for all 7,856 archived projects, captured when this archive was built.

Executive Summary

What the company appears to be

ProofMode is an autonomous AI QA agent that verifies whether software delivers what it promises by running real browser tests based on product claims. The system uses GPT-5.6 for interpretation and planning, Playwright for execution, and structured outputs to tie verdicts to evidence.

What changed

This is a self-reported project submitted to the OpenAI 2026 hackathon. It represents an early-stage prototype built by one person (Maanya Chugh) using author-declared technologies including Next.js, TypeScript, Playwright, GPT-5.6, and Zod.

Single most important open question

Does ProofMode actually work as described in practice — i.e., can it reliably convert natural-language product claims into executable browser tests and produce actionable verdicts with evidence?

Note: All information is self-reported and unverified. No revenue, customer data, traction or funding history is available beyond what the author states.

Back to contents

What The Product Actually Is

The description states that ProofMode:

  • Takes a website URL and one or more product claims (e.g., “Users can create an account with a valid email and receive a confirmation message”)
  • Uses GPT-5.6 to interpret the claim
  • Generates explicit success criteria and a structured test plan
  • Uses Playwright to perform workflow in a real browser
  • Captures screenshots, page observations, URLs, timing information, and console errors
  • Uses GPT-5.6 again to evaluate collected evidence
  • Classifies the claim as Verified, Failed, Partial, or Inconclusive
  • Produces reproduction steps, root cause analysis, and suggested fix

It also includes an intentionally flawed demo application to test against.

Inference: The system separates reasoning from execution by using GPT-5.6 for planning and evaluation, while Playwright handles deterministic browser actions. This is described as a safer approach than allowing models to generate arbitrary automation code.

Claim: ProofMode is built with Next.js, TypeScript, Tailwind CSS, Playwright, OpenAI API, GPT-5.6, Zod, and local artifact storage.

Back to contents

Positioning & Claim Evolution

The author states that ProofMode answers a more useful question than “Is this website broken?” — it asks: “Does this product actually deliver the experience it promises?”

Claim: The goal is to bridge the gap between what software teams say their products do and how they behave in practice.

Inference: This positions ProofMode as a tool for validating user experience claims rather than just technical functionality. It targets early-stage products where such gaps are common due to broken validation, missing feedback, inaccessible controls, or unexpected browser errors.

Claim: The system is designed to produce evidence-backed verdicts, not just model judgments.

Back to contents

Target Customer & ICP

The description does not explicitly name target customers or personas. However, it implies:

  • Early-stage product teams
  • Product managers, founders, designers, QA teams
  • Developers who want to validate that software delivers on its stated promises

Inference: The tool is likely aimed at teams building products where user experience and claim alignment matter more than raw functionality.

Claim: It's intended for use by developers, product managers, designers, and QA teams — not just engineers.

Back to contents

Business Model & Pricing Evidence

No evidence of pricing or business model is provided in the description.

Not evidenced

Back to contents

Technical & Delivery Signals

The author states that ProofMode uses:

  • Next.js and TypeScript
  • Tailwind CSS
  • Playwright for browser automation
  • OpenAI API (GPT-5.6)
  • Zod for validating structured responses
  • Local artifact storage for screenshots, plans, evidence, and reports

Claim: The system separates reasoning from execution — GPT-5.6 does not generate arbitrary browser code but instead creates a constrained test plan using approved actions like clicking, filling fields, pressing keys, checking visible text, capturing screenshots.

Inference: This structure makes the system safer, easier to debug, and more reliable during demonstrations.

Claim: Codex was used throughout the development loop — scaffolding, schema definition, implementation, testing, debugging, documentation.

Back to contents

Traction & Maturity Signals

The description provides no evidence of traction or maturity:

  • No revenue data
  • No customer base
  • No usage metrics
  • No product roadmap beyond future features

Not evidenced

Back to contents

Competitive Context

No mention of competitors or competitive landscape is made in the description.

Not evidenced

Back to contents

Key Risks & Red Flags

Several potential risks and red flags are evident from the self-reported account:

  1. Unverified claims: The author states that ProofMode works as described, but there is no independent verification.
  2. Single-person team: Only one member (Maanya Chugh) is listed; this raises questions about scalability and long-term maintenance.
  3. Prototype nature: This is a hackathon submission — not a production-ready product.
  4. Dependency on GPT-5.6: The system relies heavily on a single AI model, which may introduce instability or unreliability if the model changes or becomes unavailable.
  5. Limited scope: Current functionality focuses on basic browser testing and does not yet support authenticated apps, GitHub integration, or scheduled runs.

Inference: The tool is likely in early prototype phase, with limited real-world application or commercial viability at this stage.

Back to contents

Diligence Questions To Ask The Founders

  1. How was the accuracy of GPT-5.6's interpretation and evaluation validated?
  2. What are the limitations of the current test plan generation process?
  3. Has the system been tested on real-world applications beyond the demo?
  4. Are there any known edge cases or failure modes in browser automation?
  5. What is the expected path to commercialization or product maturity?
  6. How does ProofMode handle complex user flows or multi-step journeys?
  7. Is there a plan for integrating with existing CI/CD pipelines or QA tools?

Back to contents

Investment/Partnership Verdict

At this stage, ProofMode appears to be an early-stage prototype submitted as part of a hackathon project. It demonstrates a clear idea and some technical execution but lacks any evidence of traction, revenue, customers, or commercial viability.

Confidence Level: Low — based entirely on self-reported information with no external validation or data points.

Verdict: Not ready for investment or partnership consideration at this time. The concept shows promise, but the current state is unproven and lacks sufficient evidence of product-market fit or scalability.

Back to contents

Source

Submitted to the OpenAI 2026 hackathon on Devpost. Project home on DevPost.

The analysis above was generated by a language model from the project's own one-line description. It is not independent research and contains no verified traction, revenue or customer data.