OpenAI 2026 hackathon

ProofLine

AI agents write convincing PRs, but the diff hides whether requirements were met or tests are real. Proofline maps requirements to the actual code and tests, and flags the fake ones.

Solo project by Vi O · 0 likes · 0 comments

Archive position — measured, not model output

0 likes on Devpost

2,264 of the 7,856 archived projects have more likes, and 5,592 share exactly 0 — so this project's #6,135 place in the like-ranked listing is a tie-break inside that group, not a ranking.

Projects (log scale)

1
10
100
1k
10k
05,592
11,758
2285
3–4132
5–975
10+14

Likes on Devpost. ▲ marks this project's group.

Show the figures
LikesProjectsShare of archive
05,59271.2%
11,75822.4%
22853.6%
3–41321.7%
5–9751.0%
10+140.2%
Devpost like counts for all 7,856 archived projects, captured when this archive was built.

Executive Summary

What the company appears to be: ProofLine is a browser-based tool that analyzes GitHub pull requests or local code changes to map requirements to actual implementation and test evidence. It claims to flag "fake" or insufficient tests, and to provide deterministic analysis with optional AI skepticism.

What changed: The author describes building a tool that maps requirement IDs (REQ-101) to code changes and test results, distinguishing between strong evidence (exact matches) and weaker suggestions (CLAIM-001). It includes pattern-based detection of shortcuts like TODOs or hardcoded values, and an optional AI "skeptic" that can challenge weak evidence without overstatement.

The single most important open question: Is there any evidence of traction, revenue, or customer adoption beyond the author's own submission? The description states no customers, no revenue, no funding, and no third-party validation — only a self-reported hackathon project with a single developer.

Back to contents

What The Product Actually Is

The description states that ProofLine:

  • Reads public GitHub pull requests, commits, or local bundles of files.
  • Maps stable requirement IDs (e.g., REQ-101) to the exact changed code and test results.
  • Extracts author-declared change bullets as CLAIM-001 if no formal IDs exist.
  • Assigns each requirement one honest state: test evidence found, implementation only, failing test, ambiguous, suggested, or none.
  • Scans added lines for shortcuts like TODO placeholders, empty handlers, orphan fixtures, and canned mock responses.
  • Includes an optional model-interpreted pass that evaluates changed lines for patterns such as hardcoded returns or unused parameters.
  • Offers an optional AI skeptic that challenges weak evidence by returning advisory verdicts (e.g., "hollow stub", "vacuous test").
  • Exports findings in Markdown, JSON, or Mermaid diagrams.

Inference: The tool is designed to be a static analysis and code review assistant, with emphasis on verifying whether requirements are actually met, not just whether tests pass.

Back to contents

Positioning & Claim Evolution

The description states:

  • The author was frustrated by AI-generated code that "looks finished" but fails to meet requirements or has weak tests.
  • ProofLine aims to show the evidence behind a diff before trusting it.
  • It distinguishes between deterministic evidence (exact ID matches) and weaker suggestions (phrase-based).
  • The tool is built with a strong emphasis on honesty: it never claims correctness, only flags what is or isn't supported by evidence.

Inference: ProofLine positions itself as a code review tool that prioritizes truthfulness over superficial appearance. It is not a general-purpose AI code assistant but a verification tool for developers reviewing changes.

Back to contents

Target Customer & ICP

The description states:

  • The tool is built for developers reviewing pull requests or local code changes.
  • It supports both public GitHub repositories and local file bundles.
  • It is designed to be used by reviewers who want to ensure requirements are met, not just tests pass.

Inference: The primary customer is likely a developer or team of developers working in software development environments with Git-based workflows. The tool targets those who value correctness over speed or appearance.

Back to contents

Business Model & Pricing Evidence

The description states:

  • No pricing model is mentioned.
  • No revenue streams are described.
  • The tool runs entirely in the browser for demo and local use, with no account or database.
  • An optional AI skeptic uses a server-side Vercel Function with quota protection.
  • No monetization strategy is outlined.

Inference: There is no evidence of a business model or pricing structure. The tool appears to be a prototype or proof-of-concept, not a commercial product.

Back to contents

Technical & Delivery Signals

The description states:

  • The deterministic core runs entirely in the browser (no account, database, or analytics).
  • A server-side component exists only for the optional AI skeptic.
  • The AI skeptic is a Vercel Function with Hugging Face token protection and schema-constrained outputs.
  • The tool uses Codex for implementation across architecture, domain logic, tests, and GitHub integration.
  • GPT-5.6 was used for part of the build (cited as 5.6 contribution).
  • The model's runtime is a separate hosted model on Hugging Face.
  • It supports export in Markdown, JSON, or Mermaid diagrams.

Inference: The tool is built with a strong focus on privacy and determinism, using browser-based logic where possible and limiting AI use to advisory roles.

Back to contents

Traction & Maturity Signals

The description states:

  • No revenue, customers, or adoption data are provided.
  • It was submitted as a hackathon project (OpenAI 2026).
  • The team size is listed as one (Vi O).
  • No funding rounds or investor information are mentioned.

Inference: There is no evidence of traction, maturity, or commercial viability beyond the author's own description. It is not a product in production or with users.

Back to contents

Competitive Context

The description does not mention any competitors or direct market context.

Inference: No competitive landscape is described. The tool appears to be unique in its approach to mapping requirements to code and tests, but there is no evidence of existing tools in this space or how it compares.

Back to contents

Key Risks & Red Flags

  • No traction or revenue: The tool is a hackathon submission with no commercial adoption.
  • Single developer team: No indication of scalability or ongoing development.
  • Limited scope: Only supports GitHub and local files; no enterprise or integration support.
  • AI skepticism is optional and limited: The AI only adds advisory value, not decision-making capability.
  • No monetization strategy: No business model or pricing structure described.

Back to contents

Diligence Questions To Ask The Founders

  1. What is the intended path to market beyond a hackathon project?
  2. Are there any early adopters or users of ProofLine in real-world development workflows?
  3. How does the tool handle large-scale repositories or complex codebases?
  4. Is there any plan for integrating with CI/CD pipelines or IDEs?
  5. What are the technical limitations of the current browser-based approach, and how might they be overcome?
  6. Has the author considered how to scale beyond a single developer?
  7. Are there plans to monetize the AI skeptic feature or other parts of the tool?

Back to contents

Investment/Partnership Verdict

Not evidenced: There is no evidence of revenue, customers, traction, or funding. The project is described as a hackathon submission with no commercialization strategy.

Inference: At this stage, ProofLine appears to be an experimental prototype with strong design principles around honesty and determinism in code review. It is not ready for investment or partnership unless there is evidence of traction or a clear path to product-market fit. The tool’s focus on AI skepticism and deterministic analysis may appeal to developers who value correctness, but it lacks commercial viability or scalability indicators.

Back to contents

Source

Submitted to the OpenAI 2026 hackathon on Devpost. Project home on DevPost.

The analysis above was generated by a language model from the project's own one-line description. It is not independent research and contains no verified traction, revenue or customer data.