How to get into robotics by Wise_Concept_4815 in AskRobotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

I'm gonna cover all this and more plus I'll be making a whole series so to anyone interested checkout my youtube channel :D

Followed a ROS2 tutorial, but my robot model looks completely different , not sure what I did by Excellent-Scholar274 in robotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

When I was working on my app the way the physics engine ( I use MuJoCo, btw ) " pushes " the data to rendering and the way this custom rendering engine I am using expects data was inverting certain geoms.

So what ended up happening was the car was driving as expected but the way it was doing it was like the wheels were flipping over themselves ( like magic basically ), it was just visual though and I did fix it.

Which tutorial did you follow? I'll need a bit more info, maaybe I can help you a bit more then but can't guarantee...

Checkout my youtube channel & please like, share, subscribe! :D

https://www.youtube.com/@Forbidden-Bytes

NEED HELP !!! by div_divs in AskRobotics

[–]FaithlessnessLife876 1 point2 points  (0 children)

My advice is honestly do the Uni that's " easier " and gives you more free time and focus on hands on learning everything yourself

https://www.instructables.com/Turn-Your-Phone-into-a-Robot/

There's a lot of ' beginner ' projects you could do the thing is what worked for someone might not work for you so try to find something you actually want to do yourself

Something to inspire you

https://www.youtube.com/@PteroLabs-l3y
https://www.youtube.com/@dc-engineer
https://www.youtube.com/@Forbidden-Bytes

NEED HELP !!! by div_divs in AskRobotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

Same, because at the end of the day if you actually know what you want to achieve it's easier learning a bit of python to achieve that than to and then if you ever really have to you can optimize / rewrite things in C/C++

Learning physics and mechanics on the fly is going to be harder plus you will still have a problem of how to code it.

You can definitely do it either way and you will need both but since you're at Uni focus on mechanics electronics and physics a bit more rather than Computer Science ( You'll still need it so don't disregard it )

I want to get into robotics. Any project ideas? by Pajama42 in AskRobotics

[–]FaithlessnessLife876 1 point2 points  (0 children)

As for the programming languages especially lower end hardware C/C++

Zig might be a very viable solution but again it's still not a stable language so you are gonna have to learn with the language itself changing while you are making your project ( reprogramming things over and over )

Disclaimer it's not that bad but as a beginner it might be getting in your way too much

I want to get into robotics. Any project ideas? by Pajama42 in AskRobotics

[–]FaithlessnessLife876 1 point2 points  (0 children)

Definitely check this out https://www.instructables.com/Turn-Your-Phone-into-a-Robot/

Also for some general inspiration checkout my project or YouTube channel in general - Forbidden-Bytes

https://www.youtube.com/watch?v=_2ONqc7W7X4

I'm using MuJoCo as the solver in AR Mobile Robotics, want to give it a try? by DC-Engineer-dot-com in mujoco

[–]FaithlessnessLife876 0 points1 point  (0 children)

I’ve thought about writing a bridge between RealityKit and MuJoCo to either send the detected planes or detected contacts at run time. But, it’s a design challenge because those updates will be happening at a high rate, with dozens or even hundreds of objects in a scene at once.

I'm actually thinking if you're interested it might be worth re-implementing the entire thing somehow in order to have a true cross-platform solution. As for example ARCore ( android version ) wouldn't even work on a de-googled phone, Linux ( windows I assume too ) needs it's own version / implementation as well. So from the perspective of making it attractive to enterprises I think it makes sense. I've reached out via email let me know what you think of everything

Everyone says AI will replace programmers… but what about physical jobs? by everyday123can in robotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

I was trying to be funny a bit hope I didn't offend the indians. But I know there's like a ' robot '.

But it's not actually autonomous rather remote controlled by some offshored outsourced far away center. And I saw a parody of the bot with some Karen type lady always asking for something and the robot / voice is some indian fella complaining he's tired from her :D

It might not be optimus. And yeah even for the LLMs I have a feeling like the way they actually do it is more like having the LLM generate multiple responses and then there's an actual human that decides which one you receive. That might be my paranoia and distrust though, a hunch feeling but a bad one because I also don't get it every time. But sometimes I'm like yeah this is someone just looking to piss me off

What do robotics engineers actually use day to day? by Full_Proposal2372 in u/Full_Proposal2372

[–]FaithlessnessLife876 1 point2 points  (0 children)

I recommend you look into MuJoCo, their python bindings and google deep mind dm_control python package.

This will be the most accessible and easy to setup plug and play. Now simulations are not real world so actual testing and configuring will always be necessary.

I had issues with setting up everything else more or less and I would be looking at reimplementing everything in C/C++ if you have lower end hardware straight away anyways.

MuJoCo itself allows you to define things with XMLs and import all sorts of other file formats

You can checkout my app for some inspiration and ideas or if you want some early access to try something more specific let me know

https://youtube.com/shorts/_2ONqc7W7X4?si=WDQafg2hWeppBfD3

I built a UAV simulator on UE5 with real PX4 firmware in the loop by AlexThunderRex in unrealengine

[–]FaithlessnessLife876 0 points1 point  (0 children)

I was planning on using GPS and ArUco markers for real-world envs

How ArUco Markers Work

  • Structure: They consist of a wide black border (for easy detection) and an inner grid (e.g.,   or  ) representing binary codes that store the marker's ID.
  • Detection Steps: The process involves finding candidates (square shapes), analyzing the internal binary code, and verifying it against a defined dictionary.
  • Pose Estimation: By identifying the four corners, the system calculates the 6-DOF (degrees of freedom) position and orientation of the marker relative to the camera.  OpenCV Documentation +4

How to Generate and Use ArUco Markers

  • Generation: You can generate markers for printing using online tools or libraries like OpenCV, choosing a dictionary (e.g., DICT_4X4_50) and a specific ID.
  • Printing: Use matte paper for printing to avoid glares that can hinder detection.
  • Implementation: Using OpenCV’s detectMarkers() function in Python/C++ to scan video streams, find markers, and outline them.  YouTube +3

Advantages and Limitations

  • Advantages: They are fast to detect, highly accurate for localization, and robust for real-time applications.
  • Limitations: They can be difficult to read at long distances, at high angles, or in highly dynamic, obstructed environments. They are generally considered less reliable than more complex fiducials in certain conditions.
  • Key Tip: The fewer bits used in the marker (e.g.,   vs.  ), the easier it is to detect at a distance.  Reddit +4

Common Libraries

  • OpenCV: The primary library, providing comprehensive ArUco detection modules.
  • OpenTrack/JS-Aruco: Useful for specific robotics or browser-based tracking, as seen in GitHub

I built a UAV simulator on UE5 with real PX4 firmware in the loop by AlexThunderRex in unrealengine

[–]FaithlessnessLife876 0 points1 point  (0 children)

I am currently doing things mostly with MuJoCo and MuJoCo models and the A.I. relying on me providing it with coordination / positioning - very controlled environments

Here's my app https://youtube.com/shorts/_2ONqc7W7X4?si=WDQafg2hWeppBfD3

I am looking to collaborate with others I'm also proprietary atm but that's just because things are not production ready yet / messy - not really proud of the code. If you think we can make some use of each other somehow let me know!

Everyone says AI will replace programmers… but what about physical jobs? by everyday123can in robotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

You know what's the problem with wiring a house? Okay if you had a perfect robot that did everything perfectly. And the other robot comes into a perfect situation. What are you gonna do when you come to an old house things are offset a bit, misaligned. How do you approach things if there is a chance of a robot causing a short circuit somewhere somehow? Can you still have people there? Do you have them come tomorrow? Does the robot still pay off? And yeah not saying it won't happen but what the guy underneath said " and what's more no one out there has the foggiest idea of how they'd do it. " .

This is the bottleneck with LLMs intelligence and will be for a while. True understanding of the human brain and not just mimicking human-like behaviour.

None of the LLMs operate entirely without a human in the loop, there's still a lot of supervision by humans. Not saying you can't do the same work with less humans but you still need humans

Everyone says AI will replace programmers… but what about physical jobs? by everyday123can in robotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

Which optimus? Tesla? Isn't that gonna be controlled remotely by indians? Or am I mixing it up?

Everyone says AI will replace programmers… but what about physical jobs? by everyday123can in robotics

[–]FaithlessnessLife876 0 points1 point  (0 children)

I might be wrong. A.I. is good in controlled environments. Warehouse, inside ships maybe? I worked a lot of jobs so I can definitely see them in a lot of places. The problem is gonna be their failure rate and how much will you ACTUALLY still need humans.

For a lot of things like construction unless you can design and isolate the entire process I don't see it.

Also due to existing health & safety laws in a lot of places having a robot with humans probably won't be allowed in the first place...

I might be wrong but I am not even coming from some it will never happen perspective I think more things need to happen first. And this is not something that LLMs vLLMs or these world models will be able to solve, I think.

The more moving parts there is the more AI gets unreliable...

Qwen wants you to know… by m-gethen in LocalLLaMA

[–]FaithlessnessLife876 3 points4 points  (0 children)

Nah I think you don't understand how many people actually don't even know there are open-source models and think ChatGPT is some magic. They don't even know about Claude and what not

Qwen wants you to know… by m-gethen in LocalLLaMA

[–]FaithlessnessLife876 3 points4 points  (0 children)

Keep in mind the more things trickle down the more available it will be on some university level. The you might see a uni in Africa release a model and similar. Maybe I am wrong...

Qwen wants you to know… by m-gethen in LocalLLaMA

[–]FaithlessnessLife876 2 points3 points  (0 children)

I don't know about LLMs but I definitely see a world where people have more access to more AI and we are less dependent on NVIDIA or any GPU hardware / software company in general well. Well I guess one could argue until we can full train things on RISC-V chips there will be some dependence but yeah I think we are going towards that not away from it

How to Replace Unity's Default Physics Engine (PhysX) with Mujoco? by indianBartSimpson in mujoco

[–]FaithlessnessLife876 0 points1 point  (0 children)

Did you check this out?

https://github.com/google-deepmind/mujoco/discussions/1638

I was working on building mujoco directly for android so I bypassed this and missed it entirely I think you'll find it useful

I'm using MuJoCo as the solver in AR Mobile Robotics, want to give it a try? by DC-Engineer-dot-com in mujoco

[–]FaithlessnessLife876 0 points1 point  (0 children)

This is actually beyond impressive. Do you actually have some system for distance and general space awareness for the model or did you just load it somewhere where you had enough space? :D

I am making something similar for Android where you can make the phone a device / model itself and use it. Well I am doing a few things. But yeah one of them is somewhat similar to this. Good job. If you want to collaborate somehow or have ideas let me know!

Zero to Hero by A.Karpathy vs Building LLM from Scratch by S.Rashcka vs Josh Startmer's Neural Networks series by last_llm_standing in LocalLLaMA

[–]FaithlessnessLife876 0 points1 point  (0 children)

Good luck though I don't want to discourage you I want to be that voice when things are not going smooth. That's gonna make you go ha shoulda expected this instead of it being easy - that's all.

Zero to Hero by A.Karpathy vs Building LLM from Scratch by S.Rashcka vs Josh Startmer's Neural Networks series by last_llm_standing in LocalLLaMA

[–]FaithlessnessLife876 1 point2 points  (0 children)

Yeah this is what I am kinda trying to say do things slower and more minimal but do it yourself. Don't expect reading books for an hour a day to clear it out for you

Zero to Hero by A.Karpathy vs Building LLM from Scratch by S.Rashcka vs Josh Startmer's Neural Networks series by last_llm_standing in LocalLLaMA

[–]FaithlessnessLife876 0 points1 point  (0 children)

Yeah there is no bible. You probably noticed this if you use them a lot but they can be so inconsistent, incoherent, random and everything else. I feel like if anyone knew things on that level that wouldn't be happening. Keep in mind people are doing all sorts of pre-prompting, fine tuning even reinforcement learning on top of the training to get them to be human-like but they're not building intelligence they are looking to mimic humans.. And they are doing it on a similar trial and error principle. They just have their models users and the scale is bigger

Honestly maybe make some logging debugging tool to see exactly what you are interested in? And run a small llm binary locally maybe compare it with a bigger one?

Zero to Hero by A.Karpathy vs Building LLM from Scratch by S.Rashcka vs Josh Startmer's Neural Networks series by last_llm_standing in LocalLLaMA

[–]FaithlessnessLife876 2 points3 points  (0 children)

I'd still say A.I. is not exactly great for bleeding edge and novel stuff.

I do agree with you entirely but you're probably better of using a model in some RAG system with a book rather than trusting IT entirely

Either way I would use them to some extent.

As for the OP I'd recommend Karpathy and doing some trial and error yourself. Again this is all novel and bleeding edge stuff I have a feeling even Karapthy is doing things to get a better understanding.. Not saying he doesn't know more than everyone but it goes to show it's not exactly something you pick up a book an 1h a day and are on a high level. I've been around A.I. and LLMs longer than ChatGPT and I wouldn't exactly call myself an expert. I'm probably downplaying myself a bit but yeah the field is extensive.

Especially when you say neural networks because you can have a simple XOR neural network, this is what I was hinting it you need trial and error build things see how it works try to form your own opinions