home.social

#headtracking — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #headtracking, aggregated by home.social.

  1. So I was approached via DM because I mentioned #headTracking support for #freespace on Linux PC a while ago. I threw what I have here - and it is rather crude. If anyone wants to give it a try be my guest: github.com/bekopharm/fs2open.g

    I do not have the capacity to make this nice e.g. as an option. If someone wants to cherry pick the changes and make something of it I'd be more than happy. There's really not much to it.

    Would still like to hear if this works for someone else than MyMachine.

    #gaming

  2. I got back to playing #FlightOfNova lately, because it's dark and calm and meticulous. A great game to play in the winter. Dawdling around in the settings I noticed it had #headtracking support for looking around the cockpit. I quickly considered getting one of those silly devices, before I remembered that #Opentrack supports any old webcam. *sounds of rummaging around* So that works great. Just use "neuralnet tracker" as input in Opentrack.
    store.steampowered.com/app/106
    github.com/opentrack/opentrack

  3. Oh my, would you look at that. #Breezy Desktop is getting UDP support for head tracking solutions like #OpenTrack - demo of the ALPHA with #X4Foundations that features OpenTrack UDP support as well.

    This is ✨ awesome ✨

    This means that a bunch of supported #XR glasses will gain #HeadTracking support via Opentrack without #XR specific adapters/plugins, like my own `xr_to_opentrack` proof of concept.

    github.com/wheaney/breezy-desk

    #Gaming #LinuxGaming #GamingOnLinux #BreezyDesktop

  4. # Hospiz-Projekt geht endlich weiter

    Wir haben endlich den technischen Dienstleister des Hospizes ranbekommen, um uns ans Personalrufsystem anzuschließen. Er meinte, das wird nicht ganz so einfach sein. Ist wohl kein einfaches DECT-System. (Vielleicht doch mit Servos den Knopf drücken?)

    # Tutorial für Optikey

    Wir bereiten gerade das erste große Tutorial vor: Eine Optikey-Einführung, in Video- und Textform.

    #eyetracking #headtracking #disabilities #inklusion

  5. # Hospiz-Projekt geht endlich weiter

    Wir haben endlich den technischen Dienstleister des Hospizes ranbekommen, um uns ans Personalrufsystem anzuschließen. Er meinte, das wird nicht ganz so einfach sein. Ist wohl kein einfaches DECT-System. (Vielleicht doch mit Servos den Knopf drücken?)

    # Tutorial für Optikey

    Wir bereiten gerade das erste große Tutorial vor: Eine Optikey-Einführung, in Video- und Textform.

    #eyetracking #headtracking #disabilities #inklusion

  6. # Hospiz-Projekt geht endlich weiter

    Wir haben endlich den technischen Dienstleister des Hospizes ranbekommen, um uns ans Personalrufsystem anzuschließen. Er meinte, das wird nicht ganz so einfach sein. Ist wohl kein einfaches DECT-System. (Vielleicht doch mit Servos den Knopf drücken?)

    # Tutorial für Optikey

    Wir bereiten gerade das erste große Tutorial vor: Eine Optikey-Einführung, in Video- und Textform.

    #eyetracking #headtracking #disabilities #inklusion

  7. # Hospiz-Projekt geht endlich weiter

    Wir haben endlich den technischen Dienstleister des Hospizes ranbekommen, um uns ans Personalrufsystem anzuschließen. Er meinte, das wird nicht ganz so einfach sein. Ist wohl kein einfaches DECT-System. (Vielleicht doch mit Servos den Knopf drücken?)

    # Tutorial für Optikey

    Wir bereiten gerade das erste große Tutorial vor: Eine Optikey-Einführung, in Video- und Textform.

    #eyetracking #headtracking #disabilities #inklusion

  8. # Hospiz-Projekt geht endlich weiter

    Wir haben endlich den technischen Dienstleister des Hospizes ranbekommen, um uns ans Personalrufsystem anzuschließen. Er meinte, das wird nicht ganz so einfach sein. Ist wohl kein einfaches DECT-System. (Vielleicht doch mit Servos den Knopf drücken?)

    # Tutorial für Optikey

    Wir bereiten gerade das erste große Tutorial vor: Eine Optikey-Einführung, in Video- und Textform.

    #eyetracking #headtracking #disabilities #inklusion

  9. Eben die Leute von Pupil-Labs getroffen bei der ECVP2025 - Eine Konferenz für visuelle Wahrnehmung.

    Gelernt:
    - In Pupil Core kann man wohl die Kamera feineinstellen für besseres Tracking, muss aber die Einstellungen gezielt aktivieren. (Camera Intrinsics)
    - Die Neon-Brillen haben kaum noch was mit dem "Core"-Projekt auf GitHub zutun. Viel besseres Tracking. Leider Closed-Source.

    ecvp2025.uni-mainz.de/
    github.com/pupil-labs

    #eyetracking #headtracking #disabilities #inklusion

  10. Heute haben wir unser erstes Hospiz besucht und die Idee vorgestellt: Mit simplen Augengesten einen Personalruf auslösen.

    Wir werden uns die Woche mit dem Technikdienstleister außeinandersetzen, damit wir verstehen, wie die Knöpfe an den Betten mit dem Personalrufsystem angebunden sind.

    (Bild zeigt ein Symbolbild.)
    Bildquelle: Tony Webster, (commons.wikimedia.org/wiki/Fil), „Nurse Call Button at Hospital (17238701230)“, CC-BY-2.0

    #eyetracking #headtracking #disabilities #inklusion

  11. Die GPN war klasse! Danke euch allen! 💜

    Hier unser Vortrag:
    FOSS-Eye-Tracking für Menschen mit ALS

    media.ccc.de/v/gpn23-163-foss-

    Außerdem, wer mitmachen will, gerne melden: eyes-on-disabilities.org/de/06

    Was zum Beispiel gebraucht wird:
    - Texte schreiben​
    - Setups ausprobieren​
    - Software einfacher machen
    - Weitere Soft- und Hardware finden​
    - Kopfbewegung lösen​
    - 3D-Modellierung und –Druck​
    - Mobile-Dev​

    #eyetracking #headtracking #disabilities #inklusion #gpn23

  12. Dunno if you heard of #BeamEyeTracker before. It's positioning itself next to #Tobii but uses just a webcam and #Opentrack, so probably just #Neuralnet tracker on steroids - but I'd still appreciate if you could chime in for a #Linux build at steamcommunity.com/app/2375780 too as it seems to be read by the dev|s.

    #LinuxGaming #GamingOnLinux #HeadTracker #HeadTracking #TrackIR

  13. TOLLE NEUIGKEITEN:
    Wir gehen bald regelmäßig in die Alltags- und Pflegeassistent. Wir möchten das Leben von Betroffenen von ALS und MS besser verstehen, und mit ihnen zusammen unsere Eye-Tracking-Lösungen weiterentwickeln. Wir freuen uns riesig auf die Menschen, die wir kennenlernen werden und hoffen, ihnen helfen zu können.

    Den Kontakt ermöglicht uns die IFB-Stiftung. Danke für das Vertrauen: ifb-stiftung.de/

    #EyesOnDisabilities #eyetracking #headtracking #disabilities #inklusion

  14. Another XR connector for OpenTrack

    Remember my proof concept to read IMU data of my #XR glasses to #OpenTrack?

    hodasemi wrote a #Rust connector based on the idea that works without #Breezy: https://github.com/hodasemi/xr_to_opentrack_rs – comes with a systemd service file so it can run in the background.

    Once installed the only step left to do is fire up OpenTrack 🤘😄🤘

    https://beko.famkos.net/2025/02/04/another-xr-connector-for-opentrack/

    #AR #Breezy #gamingonlinux #headtracker #Headtracking #linuxgaming #opentrack #Rust #Viture #ViturePro #XR

  15. Random trivia; #VR is so 90s 🤪 - this is a photo of an offer for a en.wikipedia.org/wiki/VFX1_Hea for ~500USD in 1997. Apparently it was compatible with games like #MechWarrior 2 and did already feature stuff like #headtracking for compatible #VRgame|s.

  16. Star Citizen with head tracking from XR glasses in SBS mode on Linux PC – Yes it works!

    So I was asked if my head tracking approach of reading the IMU data from my Viture Pro to OpenTrack and SBS (side-by-side) mode with ReShade would also work with StarCitizen.

    Guess it does 🤷

    Pick your poison to watch the video: https://www.youtube.com/watch?v=rWUC2Y3TRh4 / https://makertube.net/w/8L7gVN8NnLvjhQCPGNmd6W

    I start Star Citizen via Lutris (and not with Steam), which requires slightly different settings once ReShade is installed:

    Enable Gamescope: ONOutput Resolution: "3840x1080"Game Resolution: "3840x2160" (set this also ingame!)Custom Settings: "--scaler stretch"

    Can this get you banned? Who knows 🤷 Jury is still out on this. Do I care? Nope. I won’t miss my puny starter pack.

    YMMV.

    The proof of concept code to read the IMU data can be found at https://github.com/bekopharm/xr_to_opentrack (pending changes).

    It works with the Breezy GNOME xr_driver: https://github.com/wheaney/breezy-desktop (but the Vulkan one works probably too but that’s untested). It should also be compatible with other glasses that have IMU for Breezy available.

    There is an unlisted SBS version of this video linked in the description. You will need XR glasses that do FULL SBS though to watch it!

    https://beko.famkos.net/2025/02/01/star-citizen-with-head-tracking-from-xr-glasses-in-sbs-mode-on-linux-pc-yes-it-works/

    #AR #Breezy #gaming #gamingonlinux #headtracker #Headtracking #linuxgaming #opentrack #Reshade #SBS #StarCitizen #Viture #ViturePro #VR #XR

  17. Demo: FreeSpace 2 Open with head tracking from Viture Pro XR glasses IMU data – on Linux PC

    Until now I used OpenTrack with my DIY IR tracker or the Neuralnet tracker. I knew that my XR glasses feature IMU data though and the xr_driver of the Breezy Desktop project allows to access the data via IPC on Linux PC. So I did what Linux user do: I wrote a script to access the IMU data and forwarded it via UDP to OpenTrack:

    Pick your poison to watch the video: https://www.youtube.com/watch?v=njuumLUvqrM / https://makertube.net/w/2bNyxJhdyydTeFq17onikv

    This reminded me that I also wrote a proof of concept to implement the FaceTrackNoIR (or OpenTrack) protocol into FreeSpace 2 Open on Linux PC ( https://makertube.net/w/7VtfAjW7EiAUS5aiPwG7if ) so I gave it a spin to test the data bridge. That was smooth sailing!

    The mod is Diaspora: Shattered Armistice, still awesome today: http://diaspora.hard-light.net/ (Warning: This may fuel a desire to re-watch the BSG series again 😀).

    The bridge code can be found at https://github.com/bekopharm/xr_to_opentrack (pending changes).

    It works with the Breezy GNOME xr_driver: https://github.com/wheaney/breezy-desktop (but the Vulkan one works probably too but that’s untested). It should also be compatible with other glasses that have IMU for Breezy available.

    Update: hodasemi wrote a Rust connector based on the idea that works without Breezy: https://github.com/hodasemi/xr_to_opentrack_rs – comes with a systemd service file so it can run in the background. Once installed the only step left to do is fire up OpenTrack 🤘

    https://beko.famkos.net/2025/01/31/demo-freespace-2-open-with-head-tracking-from-viture-pro-xr-glasses-imu-data-on-linux-pc/

    #AR #BattleStarGalactica #Breezy #BSG #diaspora #FreeSpace #FreeSpace2 #gaming #gamingonlinux #headtracker #Headtracking #linux #linuxgaming #opentrack #Viture #ViturePro #VR #XR

  18. It has been a while that I tried #StarCitizen. With the new #Neuralnet Tracker plugin (AI haha) for #OpenTrack we get head tracking without annoying IR LEDs or reflecting stripes just by reading the webcam video feed. This is apparently fast enough to try #headTracking without a dedicated #headTracker nowadays. And all that on a #Linux PC. Took some fiddling but the concept still works. What a time to be alive.

    Demo: https://makertube.net/w/groS1wpAhP8XYE75vJwX32

    HowTo: https://simpit.dev/systems/opentrack/

    #Gaming

    https://beko.famkos.net/2024/09/02/15629325/

    #gaming #headtracker #Headtracking #linux #Neuralnet #opentrack #StarCitizen

  19. #EyesOnDisabilities diese Woche:

    Wir waren auf dem Chaos Communication Congress und konnten unsere bisherigen Ergebnisse demonstrieren. Danke an alle Interessierten.

    #eyetracking #headtracking #disabilities #inklusion #38c3

  20. 🔥 Hell Yes! #X4Foundations added #OpenTrack UDP support for native #HeadTracking under #Linux and I can finally talk about it 🤓 Yes! Yes! 🚀

    🎥 I was to happy about it that I even did a recording while I had a bad cold and was hoarse just to show it off: https://makertube.net/w/wo4zAJiTFLeg8t2o93MLpL or https://www.youtube.com/watch?v=rgOkGwMShT0

    ✍ Took a while but it’s now in the open beta for 7.50 https://steamcommunity.com/games/392160/announcements/detail/4485117301459255318

    It’s great to see another company embracing open standards and care for their niche gamers too ❤️

    #GamingOnLinux #LinuxGaming

    https://beko.famkos.net/2024/12/03/15629396/

    #gamingonlinux #Headtracking #linux #linuxgaming #opentrack #x4foundations

  21. 🔥 Hell Yes! #X4Foundations added #OpenTrack UDP support for native #HeadTracking under #Linux and I can finally talk about it 🤓 Yes! Yes! 🚀

    🎥 I was to happy about it that I even did a recording while I had a bad cold and was hoarse just to show it off: makertube.net/w/wo4zAJiTFLeg8t or youtube.com/watch?v=rgOkGwMShT

    ✍ Took a while but it's now in the open beta for 7.50 steamcommunity.com/games/39216

    It's great to see another company embracing open standards and care for their niche gamers too ❤️

    #GamingOnLinux

  22. This one flew under my radar so far (haha, sorry):

    Rescue the civilians, race the clock, and raze the enemy in MH-Zombie, the world’s only helicopter arcade simulator! Three flight physics modes, three difficulty modes, and a tutorial mode provide a stepped learning curve and wider accessibility to realistic helicopter flight.

    https://store.steampowered.com/app/1429350/MHZombie

    The reason this came to my attention is because it’s one of the few games that [just] implemented #headTracking via UDP e.g. available by #OpenTrack (and various others). This is great because it doesn’t force people to jump the hoops of #TrackIR, which is only supported for Windows and officially limited to their proprietary devices. See this in action at https://www.youtube.com/watch?v=jMGFdO7VXiY

    Apparently it’s written for mobile games but runs on PC as well – that seems to include Linux PC which even makes this a #LinuxGaming title! 🤓

    I don’t know about you but for 3 bucks I’ll totally get this for the occasional pew pew fun. Game seems to be a labour of love so sharing is highly appreciated.

    https://beko.famkos.net/2024/11/12/mh-zombie/

    #flightsim #gaming #gamingonlinux #Headtracking #helicopter #indiegame #linuxgaming #mhzombie #opentrack #TrackIR

  23. So I bought the delanclip as a replacement for Smoothtrack. The device is much more precise, which is properly cause my mobile phone front camera is really bad with an bad refresh rate.
    It alow does allow me to play in the dark, which is nice and the jitter stopped which I experienced with Smoothtrack.

    The only downside I forgot about import taxes from UK to Germany and needed to pay more that the price on the website.

    #Delanclip #Smoothtrack #Headtracking #PCGaming

  24. I’m flabbergasted how good this tracker-neuralnet plugin for #OpenTrack works. It does the #headTracking with just a webcam without any clips, reflectors or LED stripes. I kinda expected this to not work really well in a dark room, that I prefer for gaming, but I was wrong. Even with a tiny light in one corner of the room only it kept tracking flawless.

    …can even scratch my nose and it keeps tracking.

    To get this neuralnet tracker input in the first place I had to download the ONNX runtime package onnxruntime-linux-x64-1.18.1.tgz from https://github.com/microsoft/onnxruntime/releases/tag/v1.18.1 (My Fedora offered 1.15.1 from it’s repo but this was at the time of writing not sufficient and having it installed resulted in failure due to an API mismatch). I didn’t even install it somewhere, just unpacked it in my Downloads folder.

    Back in my OpenTracks folder I run cmake the way I’ve done it before several times but this time I added the unpacked onnxruntime folder to the config.

    Configure did it’s magic (note how it picked up module tracker-neuralnet once the ONNXRuntime_DIR was set) and here we are one make later. This is rather impressive 🤓

    YMMV

    This content is licensed under a Creative Commons Attribution 4.0 International license.

    https://beko.famkos.net/2024/08/01/compiled-opentrack-with-tracker-neuralnet/

    #gamingonlinux #Headtracking #linuxgaming #opentrack

  25. 7A5244b: Neue AirPods Pro 2 Beta Firmware
    Apple hat kürzlich eine neue Beta-Firmware für die AirPods Pro 2 veröffentlicht. Sie hört auf die Buildnummer: 7A5244b. Diese Entwicklung folgt auf Ankündigungen von der WWDC 2024, bei der spezifische iOS 18 Funktionen für die AirPods Pro 2 vorgestellt
    apfeltalk.de/magazin/news/7a52
    #Music #News #3DAudio #AirPodsPro2 #BetaFirmware #Gaming #H2Chip #Headtracking #IOS18 #Siri #Stimmisolation #WWDC2024

  26. Hmmm, I wonder when we will see Linux support for the Tobii Eye Tracker 5. I really loved the product and have been using it for for a number of games: MSFS, DCS, Elite Dangerous, Euro Truck Sim, American Truck Sim and Star Citizen. Unfortunately, after switching to Linux the Tobii Eye Tracker does not work and to be frank, the Eye Tracker will go way before my Linux operating system #tobii #tobiieyetracker #linuxgaming #headtracking #linux #ubuntu

  27. I had the chance to play Flight Of Nova (https://flight-of-nova.com/) for the first time today. This was on my wishlist for quite some time now. Dived in blind and had no idea what to expect. 3 tutorial missions later: Oh boy… this is hard. I can see myself sinking many hours in this.

    Anyway, as usual, my focus is on interfacing with my home cockpit (or simpit) and while there is no ship telemetry [yet?] I was able to get it running just fine via Proton and with my DIY headtracker using OpenTrack. Hats off, seldom that I see a game that detects my joystick just fine, has great ingame calibration, offers me a windowed mode and a bunch of ultra width resolutions without having to resort to hacking config files or use gamescope to resize it ❤️

    Head tracking is, as usually, TrackIR only so far (I guess the native Linux PC version does not have UDP in place here but I couldn’t check due Steam refusing to download another version today). Anyway, you can see me fooling around with the buttons and do an A+ crash landing in the end – sunny side up 😆 Not too shabby considering that this was my 3rd landing at all.

    Pick your poison: https://www.youtube.com/watch?v=r2A_uVbUKWU / https://tube.tchncs.de/w/iV21V6EZxNCTsC8bvsCQDt

    https://beko.famkos.net/2024/06/14/demo-flight-of-nova-with-headtracker-and-hotas-on-linux-pc-crash-landing-my-spaceship-again/

    #FlightOfNova #gaming #gamingonlinux #headtracker #Headtracking #homeCockpit #linuxgaming #opentrack #simpit #SimulatedCockpit #Space #TrackIR