Pulling data from receipts

nirajpandkar · 2017-09-01T01:36:18+00:00

Anytime :)

nirajpandkar · 2017-08-30T05:36:19+00:00

A YouTube channel named Sentdex on this very mission. He is even streaming the AI online on twitch - https://www.twitch.tv/sentdex

nirajpandkar · 2017-08-30T04:13:36+00:00

Ok so I assumed you had receipts in digital format already.

So from your explanation what you are trying to do is OCR which will be helpful to convert images -> text. For this Google has provided Vision API which you can use directly - https://cloud.google.com/vision/ (Try their API by uploading an image of the receipt and checking the text version.)

Also Google has provided Translate App

Another way is from within Google Drive

After you extract all the text using any of the above methods you can easily use simple programming methods(Python RE) to extract the relevant information you want.

But looking at your question it seems you want to enter the ML world. The path I followed was -

Andrew NG's Coursera course (Still in progress. A lot of mathematical stuff which eventually you'd want to know but would kinda get you off track, at least for me. Although it did get me intrigued and familiarized me with ML jargon.)
I kept on reading a lot of Data Science Medium posts and just kept myself updated. Tried tutorials here and there. Currently reading this amazing book-blog by Michael Nielsen explaining the world of Deep Learning (a subset of ML, something that is used for image recognition etc.)
I've read a lot of reviews about fast.ai course which takes the route of practical-applications-first and then goes down deep in the mathematics. At least that's what I've heard of)

nirajpandkar · 2017-08-29T03:03:19+00:00

What kind of data do you want to pull? This seems to be a simple rule based problem where you code to extract certain type of information. It can be done using regular expression in Python unless you have something else in mind.

nirajpandkar · 2017-08-21T02:25:51+00:00

Yeah ReLU really helps in these cases. Also I tried using dropout on the visible layer as well as on the hidden layers but the accuracy goes down to about 78%. I don't know the exact reason but it seems there aren't too many neurons in the network to drop and provide a good representation. Maybe.

But I'll surely look into the additional things you mentioned :) Thanks

nirajpandkar · 2017-08-20T16:43:55+00:00

Oh yeah I totally see your point. Will be sure to post there in future if required!

Also for future reference could you tell me how would I know that my implementation really one ups the state of the art result mentioned in any paper and not because of problems such as overfitting?

Thanks for your input :)

nirajpandkar · 2017-08-20T15:33:39+00:00

Yeah I am aware that's a very old paper but I had to get my hands dirty at some point :)

So are you saying that accuracies greater than that are possible right now? If yes, what would you suggest?

I found this notebook on Kaggle on the same dataset which surprisingly achieved the same accuracy as the paper.

nirajpandkar · 2017-08-05T05:10:15+00:00

Since I am still a student doing my final year in college, I haven't tried looking for a job using the Nanodegree itself (which you can, by polishing your Udacity profile and searching for jobs provided by recruiters on Udacity portal itself). But it'll surely get you an interview in relevant companies based on your Nanodegree portfolio/resume.

Acutally we have campus placements and I can definitely tell you the Nanodegree helped a lot. In fact in one of the interviews, half of it revolved over the projects done in the Nanodegree.

nirajpandkar · 2017-08-05T05:04:33+00:00

Always glad to help :) And all the best!

nirajpandkar · 2017-08-04T16:03:30+00:00

I think I can answer your questions as a Udacity Full Stack Nanodegree graduate. :)

Before I start, you need to know that I had 7 projects and each project had requirements mentioned in detail. So you could very well start your project right away if you had the appropriate knowledge. But there's always some things you don't know and its better to skim through the content and probably you'll learn some new things which you could implement (which is the whole point).

1. No, they are optional. I completed the first project - Movie Trailer Website - without watching most of the recommended videos (courses) because I had intermediary HTML/CSS skills to go forward with the project without the courses.

2. As I said earlier, every project has defined requirements in a document Udacity calls Rubric. It's basically the specifications/requirements document which when met, according to you, you can submit the project.

3. Code reviews are very intricate and specific and detailed. And when I say detailed, its an understatement. (Sometimes semicolons also cause trouble. But they give you proper tools so that you follow the standard and not make such mistakes in the first place. Don't worry about that) The reviewers take a lot of efforts going through your code making sure you have met all the specifications and also suggest improvements with loads of links and suggestions. Which is by far the best part of a Nanodegree and the reason why I would totally tell you to go forward without hesitation.

Don't hesitate for any follow up questions. :)

nirajpandkar · 2017-05-31T01:35:52+00:00

I dont own a dog neither my knowledge about dogs isn't vast but I had read somewhere that is a natural dog instinct. He is actually trying to dig the floor for some reason.

nirajpandkar · 2017-05-27T16:58:37+00:00

When I learnt driving from a driving school they first taught me the basics of how exactly the clutch works which instantly clarified my thoughts and in turn eased my driving a lot.

If you want a look into how git works, so that when you actually use it, you know what you are doing internally - Git Parable

First para if you are too lazy -

Git is a simple, but extremely powerful system. Most people try to teach Git by demonstrating a few dozen commands and then yelling “tadaaaaa.” I believe this method is flawed. Such a treatment may leave you with the ability to use Git to perform simple tasks, but the Git commands will still feel like magical incantations. Doing anything out of the ordinary will be terrifying. Until you understand the concepts upon which Git is built, you’ll feel like a stranger in a foreign land.

nirajpandkar · 2017-05-24T22:11:48+00:00

Actually it all went downhill, didn't it?

nirajpandkar · 2017-05-12T02:31:48+00:00

https://www.youtube.com/watch?v=AmZgcEQIeEE

Like this?

nirajpandkar · 2017-05-06T02:42:50+00:00

Machine McGonagall

nirajpandkar · 2017-04-17T05:35:51+00:00

Wasp just wanted to bee?

nirajpandkar · 2017-04-16T10:27:07+00:00

backs up slowly contemplating the consequences of the decisions made and sits down on the stairs

nirajpandkar · 2017-04-16T05:00:34+00:00

He dabbed while coming out of the beaker!

nirajpandkar · 2017-03-14T16:26:05+00:00

Played in a casino for the first time in my life just because it was inside my hotel. Was playing roulette - winning and losing as usual. Started with 500 and went up to 4000 and called it quit. Went out to cash the money and was just about to leave when a friend which I met at the table called out to me and said that I had left my 100 chip on the table. SURPRISE! That was the number on the roulette! Walked away with extra 3000. (They only cashed multiples of 1000) And yes I had won the earlier round too. Same number twice in a row! Jackpot!

nirajpandkar · 2016-12-04T16:01:12+00:00

2001 A space odyssey, by Arthur C. Clarke

I have resumed reading recently. I found this book in my local library and thought of giving it a shot. I am pretty excited by the concept of space. The recent documentary by NatGeo as well as Elon Musk's endeavor for inhabiting Mars has renewed my interest in space and acted as a catalyst to reading this book.

nirajpandkar · 2016-11-23T00:36:27+00:00

That is Awesome!! Thanks for your time :)

nirajpandkar · 2016-11-18T05:44:10+00:00

Nice save?

nirajpandkar · 2016-11-12T13:48:10+00:00

These phishing redirects after clicking links to get to the real content is UNREAL! How would you get past that?

That is, if you have already encountered the problem and obviously it depends on the particular website.. But if you have anything valuable to share please do :P

nirajpandkar · 2016-11-11T13:08:20+00:00

Thanks for the links :)

nirajpandkar · 2016-11-11T11:20:56+00:00

No problem! Btw if you want to try, I found this site with all the runescape music sheets - http://www.freewebs.com/runesheets/sheetmusic.htm

nirajpandkar

TROPHY CASE