OpenAI 2026 hackathon

SPC Watchdog

An autonomous quality engineer that detects process violations with deterministic statistics, investigates root causes with row-level evidence, and improves its playbook only after human approval.

Solo project by jaehee shin · 0 likes · 0 comments

Archive position — measured, not model output

0 likes on Devpost

2,264 of the 7,856 archived projects have more likes, and 5,592 share exactly 0 — so this project's #6,891 place in the like-ranked listing is a tie-break inside that group, not a ranking.

Projects (log scale)

1
10
100
1k
10k
05,592
11,758
2285
3–4132
5–975
10+14

Likes on Devpost. ▲ marks this project's group.

Show the figures
LikesProjectsShare of archive
05,59271.2%
11,75822.4%
22853.6%
3–41321.7%
5–9751.0%
10+140.2%
Devpost like counts for all 7,856 archived projects, captured when this archive was built.

Executive Summary

What the company appears to be: SPC Watchdog is a self-reported autonomous quality engineering tool designed for manufacturing environments. It claims to detect process violations using deterministic statistics, investigate root causes with row-level evidence via an LLM agent, and improve its playbook only after human approval.

What changed: The project description shows a deliberate technical architecture built around three layers: WATCH (deterministic detection), INVESTIGATE (LLM-powered root cause analysis), and LEARN (human-in-the-loop learning). It uses a thin three-layer system with fixed-seed simulations, deterministic verification, and sandboxed agent execution.

The single most important open question: Does SPC Watchdog actually function as described in its self-reported architecture, or is this a conceptual prototype that has not yet been validated in real-world manufacturing settings?

Note: This analysis is based entirely on the self-reported project description provided by the author. No external verification, traction data, revenue figures, customer names, or third-party corroboration are available.

Back to contents

What The Product Actually Is

The description states that SPC Watchdog is a system composed of three distinct layers:

  • WATCH: Uses Python and NumPy for deterministic statistical process control (SPC) detection. It emits AR(1) measurements over WebSocket using a fixed-seed SQLite factory.
  • INVESTIGATE: Launches a headless codex exec run configured for GPT-5.6 Sol, operating in a sandboxed environment with no shell or file access. The agent retrieves evidence only through a registered MCP broker and returns structured reports with stable row citations.
  • LEARN: Implements a transactional human-in-the-loop state machine where proposals are reviewed and approved by humans before becoming part of the playbook.

The system includes:

  • A live chart that flips from green to red when an SPC signal is triggered.
  • An activity feed showing investigator actions.
  • Structured reports with citation verification counts.
  • A replay mechanism labeled as deterministic.
  • Scenario-based testing including two complete flows (Scenario 1 and Scenario 2).

Inference: The product appears to be a proof-of-concept or prototype built for a hackathon, not yet validated in production environments.

Back to contents

Positioning & Claim Evolution

The description states that SPC Watchdog targets "manufacturing quality engineers responding to an out-of-control SPC signal." It positions itself as solving the gap between commodity SPC detection and autonomous, cited investigation that can learn from process failures without granting unilateral control to the agent.

Key claims:

  • Detection uses deterministic statistics.
  • Investigation is powered by an LLM but constrained with sandboxed access and citation verification.
  • Playbook improvements require human approval.
  • The system preserves quality engineer authority where consequences are highest.

Inference: The positioning emphasizes trust, auditability, and speed over automation. It does not claim to replace engineers but rather enhance their workflow.

Back to contents

Target Customer & ICP

The description states that the intended users are "manufacturing quality engineers responding to an out-of-control SPC signal."

It also mentions:

  • A 2024 industry analysis estimating unproductive automotive downtime at $2.3 million per hour.
  • The canonical scenario runs in under 41.7 seconds of investigator runtime.

Inference: The target customer is likely a specific subset of manufacturing environments where SPC signals are common and the cost of delay is high. However, no explicit segmentation or customer validation is provided.

Back to contents

Business Model & Pricing Evidence

No evidence of pricing, monetization strategy, or business model is present in the description.

Finding: Not evidenced.

Back to contents

Technical & Delivery Signals

The system uses:

  • A three-layer architecture: WATCH (Python/NumPy), INVESTIGATE (GPT-5.6 Sol with MCP broker), LEARN (human-in-the-loop).
  • Fixed-seed SQLite for deterministic simulations.
  • WebSocket communication for real-time chart updates.
  • Structured JSON event streams from the agent.
  • Deterministic verification of citations via a host gate re-reading tables and rows.
  • Transactional state machine for playbook updates.
  • 64 pytest tests, exact replay sequences, CI pipelines, and schema-versioned fixtures.

Inference: The technical implementation suggests a strong focus on determinism, sandboxing, and auditability. It is not clear whether this is a working prototype or a conceptual design.

Back to contents

Traction & Maturity Signals

The description includes:

  • Scenario-based testing with two complete product flows.
  • A repository with 64 pytest tests, exact replay-sequence regressions, frontend type-check/build, clean-clone Ubuntu CI, and schema-versioned sanitized fixtures.
  • The project was submitted to the OpenAI 2026 hackathon.

Finding: No evidence of revenue, customers, or adoption beyond the author’s own testing and submission to a hackathon. The maturity level appears to be early-stage prototype.

Back to contents

Competitive Context

No mention of competitors or competitive landscape is present in the description.

Finding: Not evidenced.

Back to contents

Key Risks & Red Flags

  • Unverified claims: All technical and functional claims are self-reported and unverified.
  • Prototype vs. Product: The system appears to be a hackathon prototype, not yet validated in real-world manufacturing settings.
  • No traction or revenue: No evidence of actual use cases, customers, or monetization.
  • Limited scope: The description focuses only on two scenarios; no indication of broader applicability or scalability.
  • Dependency on GPT-5.6 Sol: The system relies heavily on a specific LLM version that may not be available in production environments.

Inference: There is significant risk that the described functionality has not been tested outside of controlled conditions.

Back to contents

Diligence Questions To Ask The Founders

  1. Has SPC Watchdog been tested in actual manufacturing environments?
  2. What is the current status of the system beyond the hackathon prototype?
  3. Are there any plans to integrate with existing SPC tools or ERP systems?
  4. How does the system handle edge cases not covered in the two scenarios?
  5. Is there a roadmap for scaling beyond the current sandboxed architecture?
  6. What are the limitations of the deterministic verification process?

Back to contents

Investment/Partnership Verdict

The description presents SPC Watchdog as an early-stage prototype built for a hackathon, with no evidence of traction, revenue, or customer validation.

Verdict: Not ready for investment or partnership at this stage. The system is technically interesting and conceptually aligned with current trends in AI-assisted manufacturing, but lacks real-world testing and commercial viability indicators.

Back to contents

Source

Submitted to the OpenAI 2026 hackathon on Devpost. Project home on DevPost.

The analysis above was generated by a language model from the project's own one-line description. It is not independent research and contains no verified traction, revenue or customer data.