#opentrack — Public Fediverse posts

Flight Sim Tracking from Spatial Audio

https://fed.brid.gy/r/https://hackaday.com/2026/07/06/flight-sim-tracking-from-spatial-audio/

Testing #BeamEyeTracker (native #Linux build). Mixed results so far, as expected from a BETA.

Games I could successful use it are #ProjectWingman, #FlyDangerous and #FlightOfNova.

👀 This is rather big for #LinuxGaming / #GamingOnLinux because there is to this day no "user friendly" app that does _eye_ tracking using your average #V4L2 _webcam_ and just works™ with #Proton games 😎

Yes I know about #OpenTrack - I wrote guides on that 👴

Have a sneak peek video of me testing this out. No audio.

Hey masto (again),

Du coup #OpenTrack + OSM Dashboard c'est très bien ! En plus il y a la vocalisation des distances/allures (mais ~ problématique en course).

Du coup je cherche une #montre #running (j'y connais rien ) avec ces critères :
- la plus simple/KISS possible (voir #foss 🙏 )
- tarif abordable (< 150€)
- capteur de fréquence cardiaque compatible opentrack
- capable d'afficher l'allure <> avec OpenTrack ?
- GPS en bonus mais pas prérequis (je sors systématiquement avec mon tel)

🙏

Geting 6DOF with older 3DOF XR glasses

Breezy can now turn a 3DOF (degree of freedom) device into a 6DOF device by augmenting the missing positional data from a webcam. Spoiler! It is not the cam strapped to my face – this is just for the demo you can watch here, on PeerTube or YouTube.

The cam, that I used for this task, is sitting on my monitor. How this works? Well not with magic! This requires a somewhat decent webcam – really anything from the last decade should suffice – and OpenTrack, of course.

OpenTrack is a head-tracking application with multiple tracker plugins. One of it’s plugins is the Neuralnet Tracker, an AI powered extension that comes with a bunch of different head pose models to choose from. With a webcam connected this can now locally run the detection model with very low latency – so it’s usually blazing fast on most systems!

This alone is already 6DOF and is used a lot for gaming already – so what does Breezy do with this? Simple! It reads the forwarded data via an UDP listener, a very quick way to transmit data on a local network or system [and complements it’s own rotational data with the missing positional data].

With this a Breezy user still gets the rotational data from the XR’s very sensitive IMU, that is short for Inertial Measurement Unit btw, and the not so important positional data sent from OpenTrack.

This works of course only while the webcam can still see the user. So sadly no walking around while using this.

And the best thing? It can also send the data back! This means that the very same combined values can be forwarded – e.g. to a computer game – benefiting from the best available data sources for rotation and position.

That’s not the main use case, of course, and only of importance for some nerds like myself. This is mostly relevant for the productivity features of Breezy, because sometimes a text may be too small to read with the glasses on. We do no longer have to increase the font size – we can now simply lean in! That is a feature that is usually only available with glasses, that come with little cameras of their own, so they can have native 6DOF support. And when I say native I mean that such glasses usually also outsource exactly this calculation to the connected computer. It’s my understanding that this seems to require a lot of computation power, which is something many XR users with the more modern devices complain about.

Well not so much with OpenTrack and the Neuralnet tracker, that utilizes the ONNX runtime under the hood. That’s a high-performance, cross-platform engine to power exactly such models locally. The runtime automatically makes use of the best available hardware acceleration, if there is any.

Overall I’m rather hyped about this feature – especially because I’m using the OpenTrack output option of Breezy for quite some time now, to get a VR like experience with stereoscopic 3D rendering in Side-By-Side mode. I can now keep using my older XR glasses and still enjoy this more modern 6DOF feature. This is rather expensive hardware after all.

And all that on Linux PC!

Breezy xr_driver: https://github.com/wheaney/breezy-desktop by https://www.youtube.com/@WayneHeaney

Official Announcement XR desktop with 6DoF + multiple displays: https://www.youtube.com/watch?v=eFLmjpjF-rA

Music “Life’s Worth Dying For” CC BY-SA 3.0 “LostDrone”. Licensed to the public under https://creativecommons.org/licenses/by-sa/3.0/ Verify at https://soundcloud.com/lostdrone/rock-lostdrone-lifes-worth-dying-for-free-download-and-creative-commons-license

This content is licensed under a Creative Commons Attribution 4.0 International license.

https://beko.famkos.net/2026/02/06/geting-6dof-with-older-3dof-xr-glasses/

#3DOF #6DoF #AR #Breezy #gaming #Neuralnet #opentrack #Viture #ViturePro #VR #XR

Thinking of dipping my toes into the #xr world and picking up some #rayneo 3S glasses since they are cheap-ish. Have a flight to London in Feb that I kinda want to use them for for watching movies.

Trying to discern if they would work as #TrackIR / #opentrack on the PC as well, but seems to be a mess software wise.

#Debian13 OS upgrade update: Finally got my #OpenTrack head tracking working for #EliteDangerous ! I'm still unsure what the actual resolution was, but I'll take it. And in a surprising twist, VMWare Workstation installed and ran with zero issues!

I got back to playing #FlightOfNova lately, because it's dark and calm and meticulous. A great game to play in the winter. Dawdling around in the settings I noticed it had #headtracking support for looking around the cockpit. I quickly considered getting one of those silly devices, before I remembered that #Opentrack supports any old webcam. *sounds of rummaging around* So that works great. Just use "neuralnet tracker" as input in Opentrack.
https://store.steampowered.com/app/1069190/Flight_Of_Nova/
https://github.com/opentrack/opentrack

@reallylazybear it does. It's a pain in the neck to compile it with. I've some scribbles on this here: http://simpit.dev/systems/opentrack/

And this is #ProjectWingman played with #OpenTrack on #Linux PC with #XR glasses in #SBS mode: https://youtu.be/4pjutsjz5_8

Oh my, would you look at that. #Breezy Desktop is getting UDP support for head tracking solutions like #OpenTrack - demo of the ALPHA with #X4Foundations that features OpenTrack UDP support as well.

This is ✨ awesome ✨

This means that a bunch of supported #XR glasses will gain #HeadTracking support via Opentrack without #XR specific adapters/plugins, like my own `xr_to_opentrack` proof of concept.

https://github.com/wheaney/breezy-desktop

#Gaming #LinuxGaming #GamingOnLinux #BreezyDesktop

Mission 01: Black Flag – Trying Project Wingman with my ViperPit

This is Project Wingman mission 01 Black Flag played on a Linux PC with Proton Experimental, OpenTrack with the Neuralnet Tracker plugin and my DIY HOTAS / rudder system based on Arduino Pro Micros replacing the original electronics in my Thrustmaster FLCS/Cougar gear:

Pick your poison: https://makertube.net/w/8MyoVSzDfwMuQR6bCqtbie / https://www.youtube.com/watch?v=dq0sihlgW_Y

I got Project Wingman on a sale months ago and I finally gave it a try. As an Ace Combat player I felt right at home. My initial experiment was with the XR glasses and woah that feels good in 3D and all but today I remembered that old Plasma TV in the basement. Got it second hand a year ago for dead cheap. Today I brought it upstairs to try it with the ViperPit and now I’m not sure what’s more awesome.

Well, that is if I feel like burning ~470W on top for that thing but hey this is for very specific gaming sessions only anyway 🤷

Guess I’ll spend more time in the ViperPit again 😀

https://beko.famkos.net/2025/08/30/mission-01-black-flag-trying-project-wingman-with-my-viperpit/

#gaming #gamingonlinux #homeCockpit #hotas #linuxgaming #opentrack #ProjectWingman #ViperPit

Oh boy oh boy here we go :D #ProjectWingman with #ReShade in #SBS mode (poor man's #VR) with #OpenTrack on Linux PC :D

…and how I LOVE it that the controls menu directly mentioned "Showing only DirectInput, ignoring XINPUT" and rattled off all my HOTAS / rudder devices ootb ❤️

@designerbradley hello? I want to report an issue. This feature is way too exciting!

I mean wow: #Opentrack support is already rad but adding a lefty feature on top? How awesome is that?

> https://www.moddb.com/mods/xwvm/news/xwvm-release-announcement

Hell yes. #xwvm announces public alpha.

I'm playing this for a while now having an absolute blast. This also works on #Linux including #HOTAS / #HOSAS and #HeadTracking with #Opentrack

#XWing #StarWars #Gaming #LinuxGaming #GamingOnLinux #Space #PewPew

Another game that implemented #Opentrack / UDP support after me bugging the devs: https://bitbucket.org/xwvmteam/xwvm-lfs/issues/954/linux-opentrack-camera-not-raising-udp

Love it when open standards are embraced ❤️

Think that's now the 4th game I managed to ask for this 🤓 That's a rather good track record, ain't it? Haha, sorry, I'll show myself out.

XWVM project: https://www.moddb.com/mods/xwvm

#Gaming #LinuxGaming #GamingOnLinux #XWVM

Dunno if you heard of #BeamEyeTracker before. It's positioning itself next to #Tobii but uses just a webcam and #Opentrack, so probably just #Neuralnet tracker on steroids - but I'd still appreciate if you could chime in for a #Linux build at https://steamcommunity.com/app/2375780/discussions/0/4757578278664103829/ too as it seems to be read by the dev|s.

#LinuxGaming #GamingOnLinux #HeadTracker #HeadTracking #TrackIR

Another XR connector for OpenTrack

Remember my proof concept to read IMU data of my #XR glasses to #OpenTrack?

hodasemi wrote a #Rust connector based on the idea that works without #Breezy: https://github.com/hodasemi/xr_to_opentrack_rs – comes with a systemd service file so it can run in the background.

Once installed the only step left to do is fire up OpenTrack 🤘😄🤘

https://beko.famkos.net/2025/02/04/another-xr-connector-for-opentrack/

#AR #Breezy #gamingonlinux #headtracker #Headtracking #linuxgaming #opentrack #Rust #Viture #ViturePro #XR

Star Citizen with head tracking from XR glasses in SBS mode on Linux PC – Yes it works!

So I was asked if my head tracking approach of reading the IMU data from my Viture Pro to OpenTrack and SBS (side-by-side) mode with ReShade would also work with StarCitizen.

Guess it does 🤷

Pick your poison to watch the video: https://www.youtube.com/watch?v=rWUC2Y3TRh4 / https://makertube.net/w/8L7gVN8NnLvjhQCPGNmd6W

I start Star Citizen via Lutris (and not with Steam), which requires slightly different settings once ReShade is installed:

Enable Gamescope: ONOutput Resolution: "3840x1080"Game Resolution: "3840x2160" (set this also ingame!)Custom Settings: "--scaler stretch"

Can this get you banned? Who knows 🤷 Jury is still out on this. Do I care? Nope. I won’t miss my puny starter pack.

YMMV.

The proof of concept code to read the IMU data can be found at https://github.com/bekopharm/xr_to_opentrack (pending changes).

It works with the Breezy GNOME xr_driver: https://github.com/wheaney/breezy-desktop (but the Vulkan one works probably too but that’s untested). It should also be compatible with other glasses that have IMU for Breezy available.

There is an unlisted SBS version of this video linked in the description. You will need XR glasses that do FULL SBS though to watch it!

https://beko.famkos.net/2025/02/01/star-citizen-with-head-tracking-from-xr-glasses-in-sbs-mode-on-linux-pc-yes-it-works/

#AR #Breezy #gaming #gamingonlinux #headtracker #Headtracking #linuxgaming #opentrack #Reshade #SBS #StarCitizen #Viture #ViturePro #VR #XR

Demo: FreeSpace 2 Open with head tracking from Viture Pro XR glasses IMU data – on Linux PC

Until now I used OpenTrack with my DIY IR tracker or the Neuralnet tracker. I knew that my XR glasses feature IMU data though and the xr_driver of the Breezy Desktop project allows to access the data via IPC on Linux PC. So I did what Linux user do: I wrote a script to access the IMU data and forwarded it via UDP to OpenTrack:

Pick your poison to watch the video: https://www.youtube.com/watch?v=njuumLUvqrM / https://makertube.net/w/2bNyxJhdyydTeFq17onikv

This reminded me that I also wrote a proof of concept to implement the FaceTrackNoIR (or OpenTrack) protocol into FreeSpace 2 Open on Linux PC ( https://makertube.net/w/7VtfAjW7EiAUS5aiPwG7if ) so I gave it a spin to test the data bridge. That was smooth sailing!

The mod is Diaspora: Shattered Armistice, still awesome today: http://diaspora.hard-light.net/ (Warning: This may fuel a desire to re-watch the BSG series again 😀).

The bridge code can be found at https://github.com/bekopharm/xr_to_opentrack (pending changes).

It works with the Breezy GNOME xr_driver: https://github.com/wheaney/breezy-desktop (but the Vulkan one works probably too but that’s untested). It should also be compatible with other glasses that have IMU for Breezy available.

Update: hodasemi wrote a Rust connector based on the idea that works without Breezy: https://github.com/hodasemi/xr_to_opentrack_rs – comes with a systemd service file so it can run in the background. Once installed the only step left to do is fire up OpenTrack 🤘

https://beko.famkos.net/2025/01/31/demo-freespace-2-open-with-head-tracking-from-viture-pro-xr-glasses-imu-data-on-linux-pc/

#AR #BattleStarGalactica #Breezy #BSG #diaspora #FreeSpace #FreeSpace2 #gaming #gamingonlinux #headtracker #Headtracking #linux #linuxgaming #opentrack #Viture #ViturePro #VR #XR

Oh my… what's that? A proof of concept to read head tracking data from the #Viture #XR glasses by the xr_driver from the #Breezy Desktop project via #IPC? 🤓

Next step: Cram that into #OpenTrack 😁

Edith says: There have it https://github.com/bekopharm/xr_to_opentrack - YMMV 🤷

#ViturePro

🔥 Hell Yes! #X4Foundations added #OpenTrack UDP support for native #HeadTracking under #Linux and I can finally talk about it 🤓 Yes! Yes! 🚀

🎥 I was to happy about it that I even did a recording while I had a bad cold and was hoarse just to show it off: https://makertube.net/w/wo4zAJiTFLeg8t2o93MLpL or https://www.youtube.com/watch?v=rgOkGwMShT0

✍ Took a while but it’s now in the open beta for 7.50 https://steamcommunity.com/games/392160/announcements/detail/4485117301459255318

It’s great to see another company embracing open standards and care for their niche gamers too ❤️

#GamingOnLinux #LinuxGaming

https://beko.famkos.net/2024/12/03/15629396/

#gamingonlinux #Headtracking #linux #linuxgaming #opentrack #x4foundations

🔥 Hell Yes! #X4Foundations added #OpenTrack UDP support for native #HeadTracking under #Linux and I can finally talk about it 🤓 Yes! Yes! 🚀

🎥 I was to happy about it that I even did a recording while I had a bad cold and was hoarse just to show it off: https://makertube.net/w/wo4zAJiTFLeg8t2o93MLpL or https://www.youtube.com/watch?v=rgOkGwMShT0

✍ Took a while but it's now in the open beta for 7.50 https://steamcommunity.com/games/392160/announcements/detail/4485117301459255318

It's great to see another company embracing open standards and care for their niche gamers too ❤️

#GamingOnLinux

This one flew under my radar so far (haha, sorry):

Rescue the civilians, race the clock, and raze the enemy in MH-Zombie, the world’s only helicopter arcade simulator! Three flight physics modes, three difficulty modes, and a tutorial mode provide a stepped learning curve and wider accessibility to realistic helicopter flight.

https://store.steampowered.com/app/1429350/MHZombie

The reason this came to my attention is because it’s one of the few games that [just] implemented #headTracking via UDP e.g. available by #OpenTrack (and various others). This is great because it doesn’t force people to jump the hoops of #TrackIR, which is only supported for Windows and officially limited to their proprietary devices. See this in action at https://www.youtube.com/watch?v=jMGFdO7VXiY

Apparently it’s written for mobile games but runs on PC as well – that seems to include Linux PC which even makes this a #LinuxGaming title! 🤓

I don’t know about you but for 3 bucks I’ll totally get this for the occasional pew pew fun. Game seems to be a labour of love so sharing is highly appreciated.

https://beko.famkos.net/2024/11/12/mh-zombie/

#flightsim #gaming #gamingonlinux #Headtracking #helicopter #indiegame #linuxgaming #mhzombie #opentrack #TrackIR

It has been a while that I tried #StarCitizen. With the new #Neuralnet Tracker plugin (AI haha) for #OpenTrack we get head tracking without annoying IR LEDs or reflecting stripes just by reading the webcam video feed. This is apparently fast enough to try #headTracking without a dedicated #headTracker nowadays. And all that on a #Linux PC. Took some fiddling but the concept still works. What a time to be alive.

Demo: https://makertube.net/w/groS1wpAhP8XYE75vJwX32

HowTo: https://simpit.dev/systems/opentrack/

#Gaming

https://beko.famkos.net/2024/09/02/15629325/

#gaming #headtracker #Headtracking #linux #Neuralnet #opentrack #StarCitizen

Updated https://simpit.dev/ - home of the Space Pew Pew #SimPit inspired by a VF-1 Valkyrie cockpit (#Macross)

That's a glorified #DIY joystick controller with an LCD ('MFD') and plenty of RGB for my #Linux PC

Newest additions are my videos for #X4Foundations, #EliteDangerous and #FlightOfNova (all also on https://makertube.net/a/bekopharm) and instructions how to compile #OpenTrack with the #neuralnet tracker using #ONNX runtime.

Best viewed WITH an ad-blocker and patience (slow).

#HomeCockpit

I’m flabbergasted how good this tracker-neuralnet plugin for #OpenTrack works. It does the #headTracking with just a webcam without any clips, reflectors or LED stripes. I kinda expected this to not work really well in a dark room, that I prefer for gaming, but I was wrong. Even with a tiny light in one corner of the room only it kept tracking flawless.

…can even scratch my nose and it keeps tracking.

To get this neuralnet tracker input in the first place I had to download the ONNX runtime package onnxruntime-linux-x64-1.18.1.tgz from https://github.com/microsoft/onnxruntime/releases/tag/v1.18.1 (My Fedora offered 1.15.1 from it’s repo but this was at the time of writing not sufficient and having it installed resulted in failure due to an API mismatch). I didn’t even install it somewhere, just unpacked it in my Downloads folder.

Back in my OpenTracks folder I run cmake the way I’ve done it before several times but this time I added the unpacked onnxruntime folder to the config.

Configure did it’s magic (note how it picked up module tracker-neuralnet once the ONNXRuntime_DIR was set) and here we are one make later. This is rather impressive 🤓

YMMV

This content is licensed under a Creative Commons Attribution 4.0 International license.

https://beko.famkos.net/2024/08/01/compiled-opentrack-with-tracker-neuralnet/

#gamingonlinux #Headtracking #linuxgaming #opentrack