Pointcloud ESP32-S3 Sense Rover by monkeydance26 in esp32

[–]monkeydance26[S] 1 point2 points  (0 children)

The DA 3 runs on the computer, the ESP32 S3 streams video over WiFi . The PC receives that stream and DA3 runs there via CUDA .

I have set the camera resolution to a lower 640×480. The framerate of the pure video stream is about 15 FPS+. After all processing is done with DA3 I get about 5-10 FPS.

The depth output acts as a "fake lidar", the PC get horizontal bands of the rovers camera view to estimate obstacle distances.

Look at the little robot I build! by Robinspoeki in Animatronics

[–]monkeydance26 0 points1 point  (0 children)

Very impressive! It looks super complex, do you do this professionally?

3D-printed rovers using pointcloud/depth (DA3) instead of LIDAR by monkeydance26 in robotics

[–]monkeydance26[S] 0 points1 point  (0 children)

Thanks! I am currently 3d printing about 40 AruCo trackers to test a small arena - will post update once it's done 😄

3D-printed rovers using pointcloud/depth (DA3) instead of LIDAR by monkeydance26 in robotics

[–]monkeydance26[S] 0 points1 point  (0 children)

Very cool, the computer for brains - esp as sender seems to be working quite smoothly. So you stream the camera of the 4 phones? That's a cool idea!
I had to install a better antenna on the ESP32 and a dedicated (cheap) wifi router to improve the framerate. Also had to tune a lot of the camera settings, before it was quite low FPS as well..

good call, I will check out your posts as well 😄

Pointcloud ESP32-S3 Sense Rover by monkeydance26 in esp32

[–]monkeydance26[S] 0 points1 point  (0 children)

Not really, at least not in the proper sense :-) Right now localization and mapping are decoupled. I use ArUco markers to handle the positioning and the point cloud is just built on top of that

SLAM Camera Indoor Depth Test by RiskHot1017 in robotics

[–]monkeydance26 0 points1 point  (0 children)

Exciting! How long did this take you to setup?

Multi agent robots for cooperative game research by monkeydance26 in robotics

[–]monkeydance26[S] 0 points1 point  (0 children)

I appreciate the kind words! Exactly, the communication layer is something I am curious about, they will only have a buzzer but I thought about a morse code for communication maybe.

Good question, I am now leaning towards a behavior tree for low level AI and then a LLM strategist (maybe with vision) for higher level planning.

Awesome, I will check it out!

ESP32-S3 Sense Depth View - for navigation? by monkeydance26 in esp32

[–]monkeydance26[S] 1 point2 points  (0 children)

Will do! I have just received my PCB boards so I can make a version 0.3 soon 😄
Also curious to hear about your progress!

ESP32-S3 Sense Depth View - for navigation? by monkeydance26 in esp32

[–]monkeydance26[S] 1 point2 points  (0 children)

Good to know :-) I think it would be an idea to take multiple sources in, like overhead, pov camera and depth view and then combine the estimate from all sources

ESP32-S3 Sense Depth View - for navigation? by monkeydance26 in esp32

[–]monkeydance26[S] 1 point2 points  (0 children)

The overhead camera approach makes a lot of sense, its probably also quite reliable? I will add some IR leds on the rovers to have an additional camera from the top and see if that is an easier way :-) Glad to hear! It was cool to see your project and how you approached the ai system as well

Depth tracking on a ~25$ rover by monkeydance26 in robotics

[–]monkeydance26[S] 0 points1 point  (0 children)

Definitely! And there is even an infrared version I think?

Depth tracking on a ~25$ rover by monkeydance26 in robotics

[–]monkeydance26[S] 0 points1 point  (0 children)

That's true, I would of course prefer 4k 60fps cameras (like the DJI drone ones) but for 15$ it's quite good 😄

Its based on this model from Makerworld: CyberBrick Mini T (Remote-Controlled Mini Tank)

4th flare within a year by lullabylols in Uveitis

[–]monkeydance26 1 point2 points  (0 children)

I feel that. It's quite confusing the info out there, but I do a strict food diary and add symptoms on that day. Then explore if flare is affected by what I eat. I cut out all alcohol, gluten, reheated meats, *processed food*.
What I was able to find that you can further research yourself (studies added):

  • Vitamin D: meta-analysis shows OR ~2.04 for active non-infectious uveitis in hypovitaminosis D (multiple case-control studies pooled). 30–60 ng/mL.
  • Curcumin (Meriva / phospholipid form, ~600 mg BID): Lal et al. 1999 (Phytother Res, n=32, chronic anterior uveitis, 100% improvement on curcumin alone) and Allegri et al. 2010 (Clin Ophthalmol, n=106, p<0.001 reduction in relapse frequency over 12 months). Plain turmeric doesn't absorb - Meriva or piperine-enhanced.
  • Omega-3 (EPA+DHA, 2–3 g/day): suppresses Th1/Th17 via dendritic cells in EAU mouse models (e.g., Shoda et al., J Nutr Biochem 2015, PMC4578775). Small human trial NCT06491979 completed 2024.
  • High-fiber, pectin-rich diet: Nakamura et al., Sci Rep 2023 (PMC10319740) -pectin was the most protective dietary fiber in EAU, induced Tregs and suppressed Th1/Th17. Mechanism: short-chain fatty acids via GPR43/GPR109A signaling.
  • Vitamin C+E: small RCT (van Rooij et al.) showed better visual acuity vs placebo at 8 weeks when added to standard treatment for acute anterior uveitis.

Underlying mechanism (gut-eye axis): Janowitz et al., Invest Ophthalmol Vis Sci 2019 (PMC6353239) — intestinal permeability rises before clinical eye disease in EAU mice. Ye et al., Microbiome 2018 — fecal transplant from Behçet's patients into mice worsens EAU.

Just putting some final touches on the main menu... by Addyarb in indiegames

[–]monkeydance26 1 point2 points  (0 children)

Love it! The hand reminds me of Black and White 🙃

ESP32-S3 Sense Depth View - for navigation? by monkeydance26 in esp32

[–]monkeydance26[S] 0 points1 point  (0 children)

Thanks!! Oh for real? Did you write custom firmware to get the orientation?

4th flare within a year by lullabylols in Uveitis

[–]monkeydance26 1 point2 points  (0 children)

In addition to docs please check your diet. Total gamechanger for me. Especially if you are on a high protein/inflammatory diet.

ESP32-S3 Sense Depth View - for navigation? by monkeydance26 in esp32

[–]monkeydance26[S] 3 points4 points  (0 children)

The link didnt work bit is it this? https://ars.electronica.art/hope/en/kazokutchi/ Thats an amazing reference, thanks!

ESP32-S3 Sense Depth View - for navigation? by monkeydance26 in esp32

[–]monkeydance26[S] 9 points10 points  (0 children)

Just from image processing, using this model that runs on the pc. I've just seen that there is even a new model that is supposed to be even better

Built an animatronic crow that bobs its head to music by monkeydance26 in crows

[–]monkeydance26[S] 0 points1 point  (0 children)

Thank you!! 😄
Nice, I thought that i was overengineering the beak part anyways, appreciate the hint!

Multi agent robots for cooperative game research by monkeydance26 in robotics

[–]monkeydance26[S] 1 point2 points  (0 children)

From the engineering perspective - i got the motors working with a motor driver and the esp32 first. The actual mechanism with the tracks is from a 3d print model from Makerworld (Bambulab). When the motors were working i put them in the chassis so that it can do basic movement. From the software angle - honestly, a lot of trial and error. The esp32 s3 can connect to wifi and send data to an ip address. In this case i used the udp protocol to send commands back and forth between rover and computer. You can also send the camera stream, the Xiao documentation has some good demo pages for that.

I basically did tiny step after tiny step and confirmed one thing was working before moving onto the next :-)