OpenAI 2026 hackathon

LeakLens

A Codex and GPT-5.6 reviewer for ML pull requests. It catches the data leakage, non-reproducible training, and broken-evaluation bugs that linters and type checkers miss.

Solo project by Arun Brahma · 0 likes · 0 comments

Archive position — measured, not model output

0 likes on Devpost

2,264 of the 7,856 archived projects have more likes, and 5,592 share exactly 0 — so this project's #4,911 place in the like-ranked listing is a tie-break inside that group, not a ranking.

Projects (log scale)

1
10
100
1k
10k
05,592
11,758
2285
3–4132
5–975
10+14

Likes on Devpost. ▲ marks this project's group.

Show the figures
LikesProjectsShare of archive
05,59271.2%
11,75822.4%
22853.6%
3–41321.7%
5–9751.0%
10+140.2%
Devpost like counts for all 7,856 archived projects, captured when this archive was built.

Executive Summary

What the company appears to be

LeakLens is a tool for reviewing machine-learning pull requests, designed to catch bugs that standard linters and type checkers miss — such as data leakage, non-reproducible training, and broken evaluation. It combines a deterministic rule engine with an LLM (GPT-5.6) to flag issues, score reproducibility risk, and generate written reviews.

What changed

The project was submitted to the OpenAI 2026 hackathon by a single founder, Arun Brahma. The description indicates it was built entirely using Codex and GPT-5.6, with no external funding or traction evidence. It is not yet deployed in production environments.

Single most important open question

Is there sufficient evidence of real-world utility or adoption to justify further diligence or investment? The description does not indicate any customers, revenue, or usage beyond a hackathon submission and demo fixtures.

Back to contents

What The Product Actually Is

The description states that LeakLens:

  • Reviews machine-learning pull requests.
  • Identifies bugs like data leakage, non-reproducible training, and broken evaluation.
  • Uses a deterministic engine with eight rules to scan added lines in diffs.
  • Returns structured findings, a reproducibility risk score, and a merge verdict.
  • Incorporates GPT-5.6 to convert structured findings into written reviews.
  • Operates as both an MCP server (for integration with Codex) and a standalone CLI.

Inference The tool is built for ML engineers working in code review workflows, especially those using Python and ML frameworks like scikit-learn. It is not a general-purpose code review tool but a specialized one for ML-specific issues.

Back to contents

Positioning & Claim Evolution

The description states:

  • LeakLens aims to make ML correctness as rigorous as code style and type checking.
  • It positions itself as a guardrail against bugs that are invisible to standard tools.
  • The author claims it "puts that class of bug on the same footing as a failing lint check."

Inference This is a self-stated positioning claim. The tool does not yet have any market validation or competitive differentiation beyond its own description.

Back to contents

Target Customer & ICP

The description states:

  • LeakLens targets ML engineers reviewing pull requests.
  • It is built for use in code review workflows, especially those involving Python and ML frameworks like scikit-learn.

Inference The target customer appears to be developers or teams working on ML projects using Python and standard ML tooling. The ICP is not explicitly defined beyond this.

Back to contents

Business Model & Pricing Evidence

Not evidenced.

Back to contents

Technical & Delivery Signals

The description states:

  • Built entirely with Codex and GPT-5.6.
  • Uses a deterministic rule engine (eight rules) and an LLM layer (GPT-5.6).
  • Architecture includes a unified-diff parser, checks.py, Markdown reporter, MCP server, CLI, and test suite.
  • Runs as an MCP server or standalone CLI with optional --explain mode.

Inference The tool is built for integration into existing ML development workflows, particularly those using Codex or similar LLM tools. It shows a clear architecture but no evidence of production deployment or scalability.

Back to contents

Traction & Maturity Signals

Not evidenced.

Back to contents

Competitive Context

Not evidenced.

Back to contents

Key Risks & Red Flags

  • The tool is described as a hackathon submission with no evidence of traction, customers, or revenue.
  • No external validation or adoption beyond the author’s own account.
  • The use of GPT-5.6 (not yet publicly released) raises questions about feasibility and scalability.
  • The deterministic engine only scans added lines, which may miss broader issues in the codebase.
  • No mention of integration with CI/CD pipelines or GitHub Actions beyond a stated "next step."

Back to contents

Diligence Questions To Ask The Founders

  1. What specific ML frameworks or libraries does LeakLens support?
  2. How does it handle edge cases or false positives from its deterministic rules?
  3. Has the tool been tested in real-world ML teams or workflows?
  4. What is the current status of GitHub Action integration, and when will it be available?
  5. Are there any plans to expand beyond Python or scikit-learn?

Back to contents

Investment/Partnership Verdict

Not evidenced.

Back to contents

Source

Submitted to the OpenAI 2026 hackathon on Devpost. Project home on DevPost.

The analysis above was generated by a language model from the project's own one-line description. It is not independent research and contains no verified traction, revenue or customer data.