OpenAI 2026 hackathon

Spatial Synth

Turn your face and hand gestures into music with the iPhone TrueDepth camera.

Solo project by Tadahiro Kawamura · 0 likes · 0 comments

View the project on Devpost

Archive position — measured, not model output

0 likes on Devpost

2,263 of the 7,850 archived projects have more likes, and 5,587 share exactly 0 — so this project's #6,883 place in the like-ranked listing is a tie-break inside that group, not a ranking.

Projects (log scale)

1
10
100
1k
10k
05,587
11,758
2284
3–4132
5–975
10+14

Likes on Devpost. ▲ marks this project's group.

Show the figures
LikesProjectsShare of archive
05,58771.2%
11,75822.4%
22843.6%
3–41321.7%
5–9751.0%
10+140.2%
Devpost like counts for all 7,850 archived projects, captured when this archive was built.

User Stories BotA demo video on every pull request

Get a demo video on every new feature

GitHub App that watches your pull requests and records a narrated, captioned demo.
Save time on demo prep and make informed decisions faster with a video walkthrough of every new feature.

Executive Summary

What the company appears to be

Spatial Synth is a self-reported iPhone app that uses the TrueDepth camera to translate hand and facial gestures into musical sound. The author describes it as an experimental musical instrument built during a hackathon, with no evidence of revenue, customers or commercial traction.

What changed

The project was submitted to the OpenAI 2026 hackathon and is described as a v0.2 baseline extended over a Build Week period. No prior version or development history beyond this submission is evidenced.

Single most important open question

Is there any evidence of user testing, feedback loops, or commercial viability beyond the author’s own hands-on tuning and personal use?

Back to contents

What The Product Actually Is

The description states that Spatial Synth is an app for iPhone that uses the TrueDepth camera to allow users to play music through gestures. It includes two modes: AIR mode (hand tracking) and MASK mode (face tracking). It supports performance features such as arpeggiator patterns, scales, keys, BPM sync, and gesture-triggered sound effects.

The app is built using Swift, SwiftUI, ARKit, AVFoundation, and integrates with Codex and GPT-5.6 for code assistance during development.

Evidence

  • The author describes the app’s functionality in detail.
  • It uses specific technologies: ARKit, AVFoundation, SwiftUI, Swift, Codex, GPT-5.6.
  • The app supports two gesture-based performance modes (AIR and MASK).
  • It includes features like arpeggiator patterns, scales, keys, BPM sync, and motion-triggered effects.

Inference The app is a prototype or experimental tool built for personal use or demonstration purposes, not a commercial product.

Back to contents

Positioning & Claim Evolution

The author positions Spatial Synth as an “instrument” that allows users to make electronic music feel physical without using traditional controllers. It emphasizes the idea of turning empty space into a musical interface and highlights privacy by stating no camera data is saved or sent.

Evidence

  • The tagline: “Turn your face and hand gestures into music with the iPhone TrueDepth camera.”
  • The write-up states: “I wanted to make electronic music feel physical without adding a controller.”
  • Privacy is emphasized: “Only normalized face calibration values selected by the user stay on the device.”

Inference The positioning reflects a niche, experimental approach to musical interaction. It does not suggest a broader commercial or consumer-facing strategy.

Back to contents

Target Customer & ICP

Not evidenced.

Explanation

There is no mention of target users, personas, or customer segments in the description. The author only describes their own use case and development process.

Back to contents

Business Model & Pricing Evidence

Not evidenced.

Explanation

No information is provided about pricing, monetization, or business model. The app is described as a personal project built during a hackathon.

Back to contents

Technical & Delivery Signals

The app was built using Swift, SwiftUI, ARKit, AVFoundation, and integrated with Codex and GPT-5.6 for development assistance. It includes features like gesture-triggered sound effects, BPM sync, and performance modes (FLOW and PULSE). The author notes that the app was tested on an iPhone 13 and underwent basic interaction checks.

Evidence

  • Built with: Swift, SwiftUI, ARKit, AVFoundation, Codex, GPT-5.6.
  • Features include: FLOW/PULSE modes, arpeggiator patterns, scales, keys, BPM sync, gesture-triggered effects.
  • Tested on iPhone 13; basic interaction checks performed.

Inference The technical implementation is minimal and experimental. It does not suggest a scalable or production-ready architecture.

Back to contents

Traction & Maturity Signals

Not evidenced.

Explanation

There is no evidence of users, customers, adoption, revenue, or product maturity beyond the author’s own development and testing.

Back to contents

Competitive Context

Not evidenced.

Explanation

No mention of competitors or market context. The description does not reference similar tools or platforms in the musical instrument or gesture-based interaction space.

Back to contents

Open Questions & Risks

  • No commercial traction or user feedback: The app is described as a personal project, with no evidence of users or adoption.
  • Unproven business model: No pricing, monetization, or revenue model is presented.
  • Limited scope and maturity: The app appears to be an experimental prototype, not a finished product.
  • Self-reported development only: All evidence comes from the author’s own account; no third-party validation.

Back to contents

Questions the description leaves open

  1. What was the intended user experience beyond personal use?
  2. Have you tested the app with others? If so, what feedback did you receive?
  3. Are there plans to expand beyond gesture-based music creation into other domains (e.g., accessibility, education)?
  4. How do you plan to monetize or scale this idea if it were to evolve?
  5. What are the technical limitations of the current implementation that would need to be addressed for a production version?

Back to contents

Overall Assessment

Not evidenced.

Explanation

There is no evidence of commercial viability, traction, or strategic value beyond the author’s own development effort. The project is described as an experimental prototype with no indication of future growth potential or market demand.

Back to contents

User Stories BotA demo video on every pull request

Get a demo video on every new feature

GitHub App that watches your pull requests and records a narrated, captioned demo.
Save time on demo prep and make informed decisions faster with a video walkthrough of every new feature.

Source

Submitted to the OpenAI 2026 hackathon on Devpost. Project home on Devpost. Back to the full gallery on Devpost.

This competitive analysis was produced by top-founders.com (opens in a new tab)

Generated by a language model from this project's public Devpost page — its tagline, the author's own write-up and any built-with tags listed there — as captured in August 2026. Short quotations are the author's words. It is an opinion on the idea as a business, not on the people behind it, and it reflects the description as published then. If the project has moved on, request a correction below. The analysis is not independent research and contains no verified traction, revenue or customer data.

An independent guide by KFG International LLC — not affiliated with, endorsed by, or connected to Devpost or OpenAI.

Are you the author of this project? Request removal or a correction (support@kfginternational.com). Requests from authors are acted on within 48 hours, and in any case within seven days. Privacy notice.