home.social

#opticalflow — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #opticalflow, aggregated by home.social.

  1. There's a whole bunch of recent #ThingUmbrella updates which I still have to write about, but one of the things is the reworked, improved and more customizable optical flow (aka thi.ng/pixel-flow package). The visualization in this test video is showing it in action via color-coded overlaid flow field vectors (once again worst-case scenario for video compression, let's see how it comes out [or not...])

    #OpticalFlow #DataViz #Visualization #TypeScript #Video

  2. There's a whole bunch of recent #ThingUmbrella updates which I still have to write about, but one of the things is the reworked, improved and more customizable optical flow (aka thi.ng/pixel-flow package). The visualization in this test video is showing it in action via color-coded overlaid flow field vectors (once again worst-case scenario for video compression, let's see how it comes out [or not...])

    #OpticalFlow #DataViz #Visualization #TypeScript #Video

  3. There's a whole bunch of recent #ThingUmbrella updates which I still have to write about, but one of the things is the reworked, improved and more customizable optical flow (aka thi.ng/pixel-flow package). The visualization in this test video is showing it in action via color-coded overlaid flow field vectors (once again worst-case scenario for video compression, let's see how it comes out [or not...])

    #OpticalFlow #DataViz #Visualization #TypeScript #Video

  4. There's a whole bunch of recent #ThingUmbrella updates which I still have to write about, but one of the things is the reworked, improved and more customizable optical flow (aka thi.ng/pixel-flow package). The visualization in this test video is showing it in action via color-coded overlaid flow field vectors (once again worst-case scenario for video compression, let's see how it comes out [or not...])

    #OpticalFlow #DataViz #Visualization #TypeScript #Video

  5. There's a whole bunch of recent #ThingUmbrella updates which I still have to write about, but one of the things is the reworked, improved and more customizable optical flow (aka thi.ng/pixel-flow package). The visualization in this test video is showing it in action via color-coded overlaid flow field vectors (once again worst-case scenario for video compression, let's see how it comes out [or not...])

    #OpticalFlow #DataViz #Visualization #TypeScript #Video

  6. An optical flow composite of episode 1 of "#Adolesecence" (2025, Netflix). The plot summary, from Wikipedia, follows the composite image.
    Optical flow estimates the movement of the viewer, or of the subject (in the opposite direction), plotting the narrative imagery along this narrative flow line. The bubble-like flow imagines the embodied sense of movement of engaging with the drama.

    #OpticalFlow #photography

  7. An optical flow composite of episode 1 of "#Adolesecence" (2025, Netflix). The plot summary, from Wikipedia, follows the composite image.
    Optical flow estimates the movement of the viewer, or of the subject (in the opposite direction), plotting the narrative imagery along this narrative flow line. The bubble-like flow imagines the embodied sense of movement of engaging with the drama.

    #OpticalFlow #photography

  8. An optical flow composite of episode 1 of "#Adolesecence" (2025, Netflix). The plot summary, from Wikipedia, follows the composite image.
    Optical flow estimates the movement of the viewer, or of the subject (in the opposite direction), plotting the narrative imagery along this narrative flow line. The bubble-like flow imagines the embodied sense of movement of engaging with the drama.

    #OpticalFlow #photography

  9. An optical flow composite of episode 1 of "#Adolesecence" (2025, Netflix). The plot summary, from Wikipedia, follows the composite image.
    Optical flow estimates the movement of the viewer, or of the subject (in the opposite direction), plotting the narrative imagery along this narrative flow line. The bubble-like flow imagines the embodied sense of movement of engaging with the drama.

    #OpticalFlow #photography

  10. An optical flow composite of episode 1 of "#Adolesecence" (2025, Netflix). The plot summary, from Wikipedia, follows the composite image.
    Optical flow estimates the movement of the viewer, or of the subject (in the opposite direction), plotting the narrative imagery along this narrative flow line. The bubble-like flow imagines the embodied sense of movement of engaging with the drama.

    #OpticalFlow #photography

  11. To avoid a massive OpenCV dependency for a current project I'm involved in, I ended up porting my own homemade, naive optical flow code from 2008 and just released it as a new package. Originally this was written for a gestural UI system for Nokia retail stores (prior to the Microsoft takeover), the package readme contains another short video showing the flow field being utilized to rotate a 3D cube:

    thi.ng/pixel-flow

    I've also created a small new example project for testing with either webcam or videos:

    demo.thi.ng/umbrella/optical-f

    #ThingUmbrella #OpticalFlow #ImageAnalysis #ComputerVision #TypeScript #JavaScript

  12. To avoid a massive OpenCV dependency for a current project I'm involved in, I ended up porting my own homemade, naive optical flow code from 2008 and just released it as a new package. Originally this was written for a gestural UI system for Nokia retail stores (prior to the Microsoft takeover), the package readme contains another short video showing the flow field being utilized to rotate a 3D cube:

    thi.ng/pixel-flow

    I've also created a small new example project for testing with either webcam or videos:

    demo.thi.ng/umbrella/optical-f

    #ThingUmbrella #OpticalFlow #ImageAnalysis #ComputerVision #TypeScript #JavaScript

  13. To avoid a massive OpenCV dependency for a current project I'm involved in, I ended up porting my own homemade, naive optical flow code from 2008 and just released it as a new package. Originally this was written for a gestural UI system for Nokia retail stores (prior to the Microsoft takeover), the package readme contains another short video showing the flow field being utilized to rotate a 3D cube:

    thi.ng/pixel-flow

    I've also created a small new example project for testing with either webcam or videos:

    demo.thi.ng/umbrella/optical-f

    #ThingUmbrella #OpticalFlow #ImageAnalysis #ComputerVision #TypeScript #JavaScript

  14. To avoid a massive OpenCV dependency for a current project I'm involved in, I ended up porting my own homemade, naive optical flow code from 2008 and just released it as a new package. Originally this was written for a gestural UI system for Nokia retail stores (prior to the Microsoft takeover), the package readme contains another short video showing the flow field being utilized to rotate a 3D cube:

    thi.ng/pixel-flow

    I've also created a small new example project for testing with either webcam or videos:

    demo.thi.ng/umbrella/optical-f

    #ThingUmbrella #OpticalFlow #ImageAnalysis #ComputerVision #TypeScript #JavaScript

  15. To avoid a massive OpenCV dependency for a current project I'm involved in, I ended up porting my own homemade, naive optical flow code from 2008 and just released it as a new package. Originally this was written for a gestural UI system for Nokia retail stores (prior to the Microsoft takeover), the package readme contains another short video showing the flow field being utilized to rotate a 3D cube:

    thi.ng/pixel-flow

    I've also created a small new example project for testing with either webcam or videos:

    demo.thi.ng/umbrella/optical-f

    #ThingUmbrella #OpticalFlow #ImageAnalysis #ComputerVision #TypeScript #JavaScript

  16. From my old Vimeo archive (2008): #OpticalFlow #3D #InteractionDesign prototype for Nokia retail stores. No OpenCV, just vanilla pixel buffer analysis (in Java):

    "Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.

    The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter."

  17. From my old Vimeo archive (2008): #OpticalFlow #3D #InteractionDesign prototype for Nokia retail stores. No OpenCV, just vanilla pixel buffer analysis (in Java):

    "Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.

    The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter."

  18. From my old Vimeo archive (2008): #OpticalFlow #3D #InteractionDesign prototype for Nokia retail stores. No OpenCV, just vanilla pixel buffer analysis (in Java):

    "Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.

    The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter."

  19. From my old Vimeo archive (2008): #OpticalFlow #3D #InteractionDesign prototype for Nokia retail stores. No OpenCV, just vanilla pixel buffer analysis (in Java):

    "Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.

    The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter."

  20. From my old Vimeo archive (2008): #OpticalFlow #3D #InteractionDesign prototype for Nokia retail stores. No OpenCV, just vanilla pixel buffer analysis (in Java):

    "Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.

    The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter."

  21. A #sensory re-interpretation of the Copacabana entrance scene from Goodfellas (1990) youtube.com/watch?v=_rX_vDVdmY

    Using #OpticalFlow estimation, I composited every frame in relation to camera movement from the previous frame, generating an escape map through the subterranean entrance and kitchens. The scene starts (with the car wheel) at bottom centre, and ends with Henry and Karen seated at top right.

    Goodfellas continuous tracking shot: bbc.com/culture/article/202009

    #photography #slitscan

  22. A #sensory re-interpretation of the Copacabana entrance scene from Goodfellas (1990) youtube.com/watch?v=_rX_vDVdmY

    Using #OpticalFlow estimation, I composited every frame in relation to camera movement from the previous frame, generating an escape map through the subterranean entrance and kitchens. The scene starts (with the car wheel) at bottom centre, and ends with Henry and Karen seated at top right.

    Goodfellas continuous tracking shot: bbc.com/culture/article/202009

    #photography #slitscan

  23. A #sensory re-interpretation of the Copacabana entrance scene from Goodfellas (1990) youtube.com/watch?v=_rX_vDVdmY

    Using #OpticalFlow estimation, I composited every frame in relation to camera movement from the previous frame, generating an escape map through the subterranean entrance and kitchens. The scene starts (with the car wheel) at bottom centre, and ends with Henry and Karen seated at top right.

    Goodfellas continuous tracking shot: bbc.com/culture/article/202009

    #photography #slitscan

  24. A #sensory re-interpretation of the Copacabana entrance scene from Goodfellas (1990) youtube.com/watch?v=_rX_vDVdmY

    Using #OpticalFlow estimation, I composited every frame in relation to camera movement from the previous frame, generating an escape map through the subterranean entrance and kitchens. The scene starts (with the car wheel) at bottom centre, and ends with Henry and Karen seated at top right.

    Goodfellas continuous tracking shot: bbc.com/culture/article/202009

    #photography #slitscan

  25. A #sensory re-interpretation of the Copacabana entrance scene from Goodfellas (1990) youtube.com/watch?v=_rX_vDVdmY

    Using #OpticalFlow estimation, I composited every frame in relation to camera movement from the previous frame, generating an escape map through the subterranean entrance and kitchens. The scene starts (with the car wheel) at bottom centre, and ends with Henry and Karen seated at top right.

    Goodfellas continuous tracking shot: bbc.com/culture/article/202009

    #photography #slitscan

  26. Also in the box were, 5 optical flow sensors.... ok, was toying with an idea for a robot to track it's movement with the flow sensor. Never got it too work right. So I may have bought a few of these at one time for that project... but Now I don't know what I'd do with them.

    #Arduino #OpticalFlow #Sensor #Robot

  27. Also in the box were, 5 optical flow sensors.... ok, was toying with an idea for a robot to track it's movement with the flow sensor. Never got it too work right. So I may have bought a few of these at one time for that project... but Now I don't know what I'd do with them.

    #Arduino #OpticalFlow #Sensor #Robot

  28. Also in the box were, 5 optical flow sensors.... ok, was toying with an idea for a robot to track it's movement with the flow sensor. Never got it too work right. So I may have bought a few of these at one time for that project... but Now I don't know what I'd do with them.

    #Arduino #OpticalFlow #Sensor #Robot

  29. Also in the box were, 5 optical flow sensors.... ok, was toying with an idea for a robot to track it's movement with the flow sensor. Never got it too work right. So I may have bought a few of these at one time for that project... but Now I don't know what I'd do with them.

    #Arduino #OpticalFlow #Sensor #Robot

  30. Also in the box were, 5 optical flow sensors.... ok, was toying with an idea for a robot to track it's movement with the flow sensor. Never got it too work right. So I may have bought a few of these at one time for that project... but Now I don't know what I'd do with them.

    #Arduino #OpticalFlow #Sensor #Robot

  31. Bicopter Phone Case Might Be Hard to Pocket, but Delivers Autonomous Selfies - Remember that “PhoneDrone” scam from a while back? With two tiny motors and props ... - hackaday.com/2023/02/10/bicopt #drehmflight #opticalflow #dronehacks #autonomous #bicopter #drone #lidar #phone #pitch #scam #yaw

  32. Bicopter Phone Case Might Be Hard to Pocket, but Delivers Autonomous Selfies - Remember that “PhoneDrone” scam from a while back? With two tiny motors and props ... - hackaday.com/2023/02/10/bicopt #drehmflight #opticalflow #dronehacks #autonomous #bicopter #drone #lidar #phone #pitch #scam #yaw

  33. Bicopter Phone Case Might Be Hard to Pocket, but Delivers Autonomous Selfies - Remember that “PhoneDrone” scam from a while back? With two tiny motors and props ... - hackaday.com/2023/02/10/bicopt #drehmflight #opticalflow #dronehacks #autonomous #bicopter #drone #lidar #phone #pitch #scam #yaw

  34. Bicopter Phone Case Might Be Hard to Pocket, but Delivers Autonomous Selfies - Remember that “PhoneDrone” scam from a while back? With two tiny motors and props ... - hackaday.com/2023/02/10/bicopt #drehmflight #opticalflow #dronehacks #autonomous #bicopter #drone #lidar #phone #pitch #scam #yaw

  35. I figured - we should be able to do motion amplification with ffmpeg, since it has optical flow capabilities and tools. I can't find anything about that though. I'm looking for a FOSS way to do this.

    Motion amplification as explained by Steve Mould: youtu.be/rEoc0YoALt0

    #ffmpeg #VideoProcessing #FreeSoftware #FOSSvideo #MotionAmplification #OpticalFlow #MotionInterpolation

  36. I figured - we should be able to do motion amplification with ffmpeg, since it has optical flow capabilities and tools. I can't find anything about that though. I'm looking for a FOSS way to do this.

    Motion amplification as explained by Steve Mould: youtu.be/rEoc0YoALt0

    #ffmpeg #VideoProcessing #FreeSoftware #FOSSvideo #MotionAmplification #OpticalFlow #MotionInterpolation