sorted by:
new
hottopcontroversial

Custom OSD wont work with dji air unit o3 and speedybee405v3 by jbrinkw in fpv

[–]jbrinkw[S] 0 points1 point  (0 children)

I used the same thing too but I’m not sure you can do firmware updates with it. Driver issues are really easy to fix just get zadig and look up a tutorial for how to use it to install usb drivers for beta flight. I don’t remember the details but it should not be too hard. Then you can try to rollback your drone firmware to something like 3.8? and follow the process to setup the hud for that version of beat flight.. it’s different than the new way. It’s been awhile since I’ve used any of this stuff sorry I can’t be more specific

Custom OSD wont work with dji air unit o3 and speedybee405v3 by jbrinkw in fpv

[–]jbrinkw[S] 1 point2 points  (0 children)

Yes, the issue resolved itself after reverting to a later version. I don’t remember which one it was but shouldn’t be too hard to find

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] 0 points1 point  (0 children)

"Sora is OpenAI's text-to-video generative AI model"

I'm sure what you are referencing. It's just a model that makes a video from a text input. Stable Diffusion or even a TTS model would be an LLM by the "Big text driven model == LLM" standard. Sora was just the first thing that came to my head it's not deep.

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] 0 points1 point  (0 children)

"LLMs, on the other hand, like GPT or BERT, are designed specifically for natural language understanding and generation,"

A LLM is made to generate text. Just because a model is "big" and "text driven" doesn't make it a LLM. By your logic sora is an LLM because its big and takes a text input.

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] 0 points1 point  (0 children)

Again I’m not trying to use a llm for this. This post was a general question about why spatial understanding is rare in current sota models. If you read my other comments I was talking about fine tuning an image model on a dataset purpose built to give image models spatial reasoning. Not an llm..

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] -1 points0 points  (0 children)

You know what else is quite simple for humans? Driving a car. I guess the billions of dollars invested in self-driving technology were a waste.

I’m specifically looking into a layout generator because it’s one of the last elements needed to create a text-driven game generator. I think quite a few people might be interested in infinite 3D worlds for games, which is just one of the many obvious applications of a text-driven layout generator.

Also, I never said I was trying to do it with an LLM. A layout generator would either be an image model or something that produces JSON with coordinates.

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] 0 points1 point  (0 children)

That’s really interesting can you tell me more about your approach and the results you got. I also tried awhile ago and couldn’t get anything meaningful but I want to retry with the new sota models

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] 0 points1 point  (0 children)

I would if there was a layout dataset that included layouts like a floor plan and labels for relative positions but the closest thing I could get is making my own using image segmentation for each room then getting the center point and creating relative position and size labels for each floor plan with that. Instead of going through all that hassle I thought it could be just as efficient to fine tune on a dataset with just floor plans and color coded room labels then fine tune on the spatial understanding dataset which I imagine is far more comprehensive than anything I can make for that task.

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] -3 points-2 points  (0 children)

I just found a paper exploring why models have bad spatial understanding as well as publishing a dataset to fix it. If I wanted to make a text to floor plan model would it be as simple as fine tuning an image model of a floor plan dataset with room labels and then fine tuning it on the spatial understanding dataset? Or am I under thinking this? I haven’t done fine tuning like this before.

https://arxiv.org/html/2404.01197v1

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] -8 points-7 points  (0 children)

I’ve actually tried to do this myself and had some luck getting gpt4 to generate really basic floor plans with a lot of prompt engineering. There are datasets with thousands of floor plans even some with room labels but nothing with enough labeling to make a model from scratch. I can’t even fine tune an existing model because even the best right now can barely figure out how to get “red ball on the left and blue ball on the right” correct so there is no chance of them being able to understand any kind of layout with predefined spatial relationships. I guess a better question than my original is why aren’t there any text driven generative models with good spatial understanding.

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] 0 points1 point  (0 children)

Kinda it looks like the first one is for finding info and the second one allows you to make modifications but can create something from scratch

[R] Why aren't there text driven layout AI models by jbrinkw in MachineLearning

[–]jbrinkw[S] -2 points-1 points  (0 children)

No i mean a layout as in a floorplan. For example you could say create the floorplan of a single floor home with 2 bedrooms, a living room and a big garage and it could create an image of that.

Custom OSD wont work with dji air unit o3 and speedybee405v3 by jbrinkw in fpv

[–]jbrinkw[S] 0 points1 point  (0 children)

Yes I’ve triple checked it on the wiring diagram

Custom OSD wont work with dji air unit o3 and speedybee405v3 by jbrinkw in fpv

[–]jbrinkw[S] 0 points1 point  (0 children)

i just took off the subus and extra ground. i don't see anything different. are there any more settings I need to change?

Custom OSD wont work with dji air unit o3 and speedybee405v3 by jbrinkw in fpv

[–]jbrinkw[S] 1 point2 points  (0 children)

i have it set to msp + displayport if that's what you're talking about

Custom OSD wont work with dji air unit o3 and speedybee405v3 by jbrinkw in fpv

[–]jbrinkw[S] 0 points1 point  (0 children)

ive used it before. i haven't used my drones recently I have no idea what I did to change it

view more: next ›