How accurate is current eye-tracking tecknology?

Can commodity products detect which pixel you’re looking at on a screen?

For a number of years, I’ve wanted a system that eliminates mouse pointer devices. In my imaginary system, there are hotkeys bound to left & right mouse clicks, and what gets clicked is whatever you’re looking at.

When I’ve looked at this before, the tech field tends to suffer in granularity and/or physical limitations, like needing to limit gross head movements. Most products talk about what they can do, but avoid talking about their limitations. It can be hard to find out what devices are capable of - accuracy, working with corrective eyewear, speed, head movement, software (OS) support, etc. Many products are geared at research, leading me to believe the tech isn’t there yet.

Anyone have, or used a device that would be able to replace a mouse?

Tathas,

My brother had a Tobii eye tracker for a couple years. I think it was the 3 model? It worked well enough. He gave it away cause he got a large ultrawide monitor that it couldn’t work right with.

He used it in a couple games that supported it that we were playing at the time (Division 2, Vermintide) and also used it when screen sharing doing training activities as it would display a small halo to show where he was looking.

sxan,
@sxan@midwest.social avatar

It even looks like there’s software thay lets it run on Linux. Was it accurate enough for, like, desktop use? Did he have to hold his head still?

It wouldn’t take much to make it impractical: being fussy enough that you have to think about using it while you are would defeat the purpose. Any inaccuracy, or not being granular enough, or requiring you to hold your head still, not working with glasses, or lag… those would all kill it.

Tathas,

No he didn’t really have to keep his head perfectly still and they’re supposed to work fine with glasses. Back when he had a very old 4-core machine, he’d get some lag when he turned on the halo effect, cause it did CPU post processing. But that stopped when he got a current machine.

He never really complained about it being finicky or anything.

sxan,
@sxan@midwest.social avatar

That’s awesome, thanks!

Num10ck,

apples vision pro reportedly has it nailed down. meta occulus has been hacked where its reasonably good. in a controlled lab setting with substantial training i’ve read of desktop computers doing ok at it with dedicated hardware etc.

what hardware/software/settings/training are you hoping for?

sxan,
@sxan@midwest.social avatar

Daily desktop use; I’d like to eliminate the repetitive stress and time it takes to move my hands off the home row, use a pointing device, and re-acquire the home row.

Also, I think Factorio would be fantastic if I could use both hands for hotkeys.

Headsets are probably not going top work for what I’d like to accomplish; a remote bar-style (some look little more than web cams, although I can’t imagine how they track without wide-set binocular cameras) that doesn’t require wearing a device would be optimal.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • asklemmy@lemmy.world
  • localhost
  • All magazines
    •
    200 @ entry_single
    HTTP status 200 OK
    Controller EntrySingleController
    Route name entry_single
    Has session yes
    Stateless Check no
    Time 790 ms
    Total time 790 ms
    Initialization time 69 ms
    Memory 12.0 MiB
    Peak memory usage 12.0 MiB
    PHP memory limit 128 MiB
    Cache 1
    Number of forms 1
    Number of errors 0
    Logger 86
    Errors 0
    Warnings 0
    Deprecations 86
    Cache 47 in 336.90 ms
    Cache Calls 47
    Total time 336.90 ms
    Cache hits 41 / 56 (73.21%)
    Cache writes 12
    640
    Default locale en
    Missing messages 640
    Fallback messages 0
    Defined messages 148
    Security n/a
    Authenticated No
    Firewall name main
    Twig 419 ms
    Entry View entry/single.html.twig
    Render Time 419 ms
    Template Calls 131
    Block Calls 82
    Macro Calls 6
    90 in 332 ms
    settings_row_switch 15
    date 9
    user_inline 8
    date_edited 7
    vote 7
    boost 7
    entry_comment 6
    user_avatar 6
    entry_comments_nested 6
    user_settings_row_switch 4
    settings_row_enum 2
    entry 1
    entries_cross 1
    editor_toolbar 1
    user_actions 1
    magazine_box 1
    magazine_sub 1
    related_magazines 1
    active_users 1
    related_categories 1
    related_posts 1
    related_entries 1
    support_us_block 1
    featured_magazines 1
    14 in 127.98 ms
    Database Queries 14
    Different statements 10
    Query time 127.98 ms
    Invalid entities 0
    Cache hits 25
    Cache misses 0
    Cache puts 0
    6.4.0
    Profiler token d1ff60
    Environment dev
    Debug enabled
    PHP version 8.2.26   View phpinfo()
    PHP Extensions Xdebug ✗ APCu ✓ OPcache ✓
    PHP SAPI apache2handler
    Resources Read Symfony 6.4.0 Docs
    Help Symfony Support Channels