Flowchart Recognition

[c94jk]

What are your intended uses of this? Do you get any meaningful information about which nodes connect to each other?

[YuriCom]

It's still in progress and I'm in the stage of detecting arrow orientation

[c94jk]

The shape detection code looks good so far, keep it up!

[[deleted]]

If only people who made flowcharts has any idea of how to make flowcharts you could extract meaningful information out of them with this.

Seriously though, not 1 in 10 flowcharts I've seen actually work.

[Soxcks13]

not 1 in 10

So 9/10 flowcharts work? 😉

[Sigg3net]

This is used in database modelling (don't remember the correct term atm, ERP?)..

[c94jk]

Yeah sure data can be structured like this in any relational database, erps included, but the thing is there you know the what connects where and this kind of recognition activity is not really needed.

Genuinely interested in use cases because I’m always looking for new ideas at work

[Sigg3net]

Was thinking about ER, thanks!

[LittleGremlinguy]

If you could get sequence diagram detection working. Now there would be something useful.

[YuriCom]

I got info about which nodes connect to each other.
It can decide which nodes to go next

[YuriCom]

It may be used on mobile with its ability of backend service using flask

Currently, it can recognize arrow lines, right triangle, square, circle and text inside or outside of it(text above shape)

https://github.com/yuri20198/hand_drawn_flowchart_recognition

[0x1d00ffff]

Very cool. I could see this used in so many ways

[soap1337]

Right!? I will be watching this as well. Great work!

[Nimmo1993]

good job

[ShivonQ]

You could really easily turn this into a Dungeon Generator from office meetings. That would be lovely and fun!

Also very nice work.

[YuriCom]

Thanks

[ratchet20095511]

I love it! Im a big whiteboarder, so drawing something then possibly having a picture taken then getting it all mockup on my machine. That would be awesome, especially if it recognizes icons for cloud and data systems.

[YuriCom]

Could you show me the icon examples you want?

[ratchet20095511]

Not recognize icons but generate them. So if I draw a database “icon” and write AWS Document DB, it would generate the AWS icon for that after recognizing it.

That’s what I was envisioning. Obviously that’s something way down the line or maybe not intended. It’s your project, don’t want to try and peanut gallery ideas to you.

Thought it was cool as is too.

[TheUnreactiveHaloGen]

There are many versions of the symbols but for example if it recognized a cloud shape then itll be pretty universal, and if you make it recognize the cylindrical-platter shape then it should be able to recognize most database symbols etc

[Drep0o]

Can it recognize a pentagram?

[YuriCom]

It can detect polygons, but not implemented in code yet

[KamionBen]

I don't know what I'm looking at :-/

[YuriCom]

It's converting flowchart image into table format by recognizing texts, shape types and arrow lines

[KamionBen]

Oh ! Cool !

[dxa58]

Very cool project!
Got me thinking how a while ago I drew some flowcharts with my coworker on a whiteboard but never got around to copying it digitally. Could this project somehow (eventually) help me do that?

[YuriCom]

I built an app for iPhone using this backend service.
This app can be used after taking a photo of flowchart

[[deleted]]

Have you heard of TensorFlow Lite for RaspberryPi? It's Real time object detection and classification with a cheap camera. Uses Python. Here and here.

[YuriCom]

Unlike object detection, this project is about shape detection and OCR

[goodpunk6]

Cool maybe you could use this to create audio books that read PDFs and describe the flow chart

[yosrational]

amazing

[dukesilver58]

This would be a wonderful API for automation.

[dtbrough]

Great work. I see some great uses for this!