Hello Apple Developer Community,
I’m Yashwanth Pentakota, the independent developer behind EyeFlow, a prototype exploring hands-free screen navigation using a standard device camera.
EyeFlow focuses on gaze-based scrolling and dwell-based selection. The goal is to support people who have difficulty using a mouse or touchscreen. My current work includes improving calibration, reducing gaze jitter, and preventing unintended actions.
I’m exploring bringing this interaction model to Apple platforms and would appreciate guidance on one architectural question:
For gaze-controlled scrolling and selection within my own app, which supported Apple frameworks or APIs should I evaluate first, and what platform limitations should I account for?
My current pipeline is: Camera capture → face/eye detection → gaze estimation → calibration and smoothing → scrolling or selection.
This is an experimental prototype; I’m still evaluating its accuracy and usability.
Prototype/source: https://github.com/Yashwanth6121/Eye-Flow-v3.
Suggestions on relevant documentation or sample projects would be helpful.
Thank you, Yashwanth Pentakota