AirTouch

AirTouch is a self-reported proof-of-concept project that enables users to interact with a laptop screen using hand gestures tracked by Snap Spectacles, without modifying the device or adding physical touch sensors. The author, Krunal MB Gediya, built it as a personal experiment and hackathon submission for the OpenAI 2026 hackathon.

The project claims to turn any laptop into a spatial touchscreen through four-corner calibration, gesture recognition, and translation of finger movements into mouse events via a desktop companion app. It uses Snap Spectacles' hand-tracking capabilities, WebSocket communication, and native OS APIs (Quartz on macOS, User32 on Windows) to simulate cursor control, clicking, dragging, scrolling, and other interactions.

There is no evidence of commercial traction, revenue, customers, or adoption beyond the author’s own account. The project is described as a prototype with no external validation or third-party data. It does not appear to have moved past the experimental phase.

The description states that AirTouch allows users to interact with a laptop screen using hand gestures tracked by Snap Spectacles. It uses:

• Snap Spectacles for tracking finger positions in 3D space
• A four-corner calibration process to map the virtual screen surface
• WebSocket communication between Spectacles and a desktop companion app
• Translation of normalized coordinates into mouse events using native OS APIs (macOS Quartz / Windows User32)
• Support for basic gestures like cursor movement, clicking, dragging, scrolling

The system does not require any physical modifications to the laptop or addition of touch overlays.

It is described as an end-to-end implementation built with Codex and GPT-5.6 for code inspection and improvement.

Inference The product is a spatial interaction interface prototype designed to simulate touchscreen-like behavior using wearable computing.

The author positions AirTouch as a way to "turn any laptop into a spatial touchscreen" by leveraging existing hardware (Snap Spectacles) rather than requiring new physical input mechanisms.

It began as a personal frustration with not being able to touch a MacBook screen and evolved into an exploration of how wearable computing can enhance existing devices without replacing them.

The project's claim is that touch does not have to be a physical feature of a display, but instead a relationship between finger, screen, and spatial coordinate system.

Inference The positioning reflects a shift from a simple hack to a conceptual framework for rethinking human-computer interaction through wearable devices.

The description does not identify specific target customers or personas. However, it implies an audience interested in:

• Wearable computing
• Spatial interaction interfaces
• Accessibility solutions
• Innovative input methods for laptops

There is no evidence of market segmentation or customer interviews.

Inference The likely early adopters would be developers, tech enthusiasts, and users experimenting with new forms of interaction. No formal ICP was defined.

No business model or pricing information is provided in the description.

The project is presented as a personal experiment and hackathon submission.

Not evidenced

Key technical components include:

• Use of Snap Spectacles Interaction Kit
• Hand tracking in world space
• Four-corner calibration
• Bilinear quadrilateral projection
• WebSocket communication
• Native OS API integration (Quartz on macOS, User32 on Windows)
• Support for both macOS and Windows

The author mentions using Codex with GPT-5.6 to improve code quality.

Inference The project demonstrates a working prototype with cross-platform support and some advanced technical features like adaptive smoothing and gesture handling.

There is no evidence of revenue, customers, or adoption beyond the author’s own account.

The description indicates this was submitted as a hackathon project, suggesting it has not progressed beyond the prototype stage.

Not evidenced

No mention of competitors or existing solutions in the description.

It appears to be a novel approach within the space of spatial interaction and wearable computing, though no comparison with other tools or platforms is made.

Not evidenced

• Prototype only: No evidence of real-world usage or productization
• Hardware dependency: Relies entirely on Snap Spectacles, limiting accessibility
• Limited scope: Focuses on basic mouse gestures; lacks advanced features like double-clicks or pinch-to-zoom
• No commercial viability: No indication of monetization strategy or market demand
• Unverified claims: All descriptions are self-reported and unvalidated

Inference The project is a creative experiment with no clear path to commercialization or scalability.

1. What real-world use cases have you identified for this technology?
2. Have you tested AirTouch with non-technical users or in different environments?
3. How do you plan to address latency and accuracy issues at scale?
4. Are there any partnerships or integrations planned with hardware vendors (e.g., Snap Spectacles)?
5. What is the roadmap for expanding beyond macOS and Windows?
6. Have you considered accessibility implications or built-in support for users with disabilities?