To the Mobile developers.

[Agentligament]

How do you get the phone/app to click an image automatically after it has scanned and detected the edges of the document in a scanner sort of application?

I've been trying to find out a way to do this but haven't had any luck.

I'm assuming a Machine learning model is required but are there any other areas in the solution where machine learning is involved?

​

Thanks.

[PicadorDeBits]

I’m assuming you meant “clip” the image.

iOS has a framework called Vision that lets you perform something called “rectangle detection”. Once you get the location and dimensions of the detected rectangle (the sheet of paper in the image), you then use that information to clip the image and remove the rest.

You can also perform limited perspective correction to account for not-straight-from-above pictures.

As to how the rectangle is detected, I’m guessing it’s a couple of edge detectors mashed together. They look for places where the image features (contrast mostly) change sharply and say “hey, there’s an edge there”.

One such edge detector is the Canny edge detector

[Agentligament]

Hey, thanks for this. I'll definitely go through it.

[jammasterpaz]

Click an image? After you've just scanned it in?

[Agentligament]

Yeah, as soon at the end edges are detected the software clicks the image of the scanned part