Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The Lazy Eye #63

Open
D337z opened this issue Jan 29, 2024 · 1 comment
Open

The Lazy Eye #63

D337z opened this issue Jan 29, 2024 · 1 comment

Comments

@D337z
Copy link

D337z commented Jan 29, 2024

When using wink-optimized model, if a person winks, it causes the open eye to veer off to the side in gaze tracking. This results in a lazy eye effect.
This is in using version 1.20.4 under Ubuntu 23.10 in conjunction with VSeeFace. I verified that I was not squinting my open eye at the time and that it occurs with only my left eye open. It also appears to forward as having both eyes closed with my right eye is open regardless of tracking as winking in the terminal output. I have verified that VSeeFace can track my face properly via webcam, but that also brings about a separate issue that was to be resolved via external tracking. This is really one of the only options that I have for my system at the moment, otherwise I would be using other methods. But gaming is and has been shifting to the Linux platform for a little bit now and with good reason, so I'm hoping that I can it along.

Screenshot from 2024-01-28 22-41-58

@emilianavt
Copy link
Owner

It makes sense that this can happen. The gaze position is calculated in VSeeFace is computed from both eyes, and when an eye is closing it sometimes veers off to the side. When I have time to work on VSeeFace more, I should be able to fix this by making it use only the open eye while winking.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants