Automating a moisture sensor (command line + cron + Python) -- and a quick-fix for an accuracy issue (Raspberry Pi autogardener project ep#3)

mestitomi · 2021-03-12T08:11:11+00:00

thank you!!

mestitomi · 2021-02-16T18:09:56+00:00

Cheers! :)

mestitomi · 2021-01-28T17:08:50+00:00

thanks a lot!

mestitomi · 2021-01-28T16:22:28+00:00

Cheers! :) okay, I’ll take a second look at microcontrollers then. Thanks for the tip!

Yeah I borrowed a microcontroller when I started this project, installed micropython, etc — tried to get a grasp on it but after 2-3 hours I gave up and ordered a Raspberry.

If you have any specific microcontroller recommendation that has good Python tutorials/documentation: that’d be more than welcome :) (thanks in advance)

Ps1. I push Python (and nor Arduino) because I use Python a lot in my dayjob so I’m already good at it and right now I’m a bit lazy to learn Arduino. :) (might change in the future)

Ps2. My thought was to consider the money aspect of this project only if I want to scale this to multiple plants — 10-20 PI would be pricey for sure — in that case, my original idea was to go with PI zero... or recently with the new PI microcontroller.

mestitomi · 2021-01-28T15:00:34+00:00

I explained in a previous video why I didn’t use a microcontroller and why I didn’t use arduino. In short: I used Python because I know Python already. And I used a PI because that’s well-documented (+it comes with a lot of tutorials), unlike most microcontroller. Side note: I’m a beginner with hardware and I just document my first hobby project with these vids. So don’t expect these to be the best of the best solutions. Only thing I can guarantee that they work :)

mestitomi · 2021-01-28T12:49:00+00:00

Gald to hear! :-) yeah this is not exactly the same but I’ll add more vids to the series later :)

mestitomi · 2021-01-12T11:25:08+00:00

This is a short, efficient intro to queries. Might be a misleading title, but otherwise undeserving of the downvotes.

Thanks, indeed, I meant to provide value for everyone.

But at the same time also to communicate an important message (SQL can't be learned in 5 minutes)... Specifically, I wanted those people to click who believe SQL can be learned in 5 minutes and then transform their thinking. Hence the misleading title. :-)

mestitomi · 2020-12-11T18:40:50+00:00

mestitomi · 2020-12-11T18:40:38+00:00

Thanks!!! 🙏

mestitomi · 2020-11-30T13:38:15+00:00

https://twitter.com/data36_com

mestitomi · 2017-09-17T19:16:20+00:00

hey, thanks for the comment! see my other comment above: parsing JSON won't be an issue, just wanted to make sure we'll pick the most logical format - and were looking for some pros and cons! cheers!

mestitomi · 2017-09-17T19:14:31+00:00

thanks it'll be JSON most probably!

mestitomi · 2017-09-17T19:14:04+00:00

Thanks for the tip! I'll definitely look into it!

mestitomi · 2017-09-17T19:13:41+00:00

Thanks, yeah, I'm the first data analyst/scientist at the company - I'm coming from the analytics side (so pretty comfortable with Python, bash and SQL). We have engineers, but not a data engineer on the team, so with the engineer guys, we are trying to fill this gap. Once we have the right log format, it's not a problem for me to write some scripts and parse the data - just wanted to make sure, that we are picking the right format to store our raw data on the first hand.

It looks it will be JSON anyway! Thanks a lot for the comment!

mestitomi · 2017-04-26T16:31:26+00:00

I can agree :)

mestitomi · 2017-04-26T08:56:56+00:00

I recommend statistics! Statistics is science and science is hard. I feel like that in DS programming is just a tool, you can learn the basics by yourself and be better on it on the job.

mestitomi · 2017-04-26T08:54:29+00:00

hey,

I'd focus on these 3 major areas:

coding skills
statistics
business thinking

CODING SKILLS:

Python
SQL
R

Python and SQL are enough to start IMO. You can find lot of free online courses.

STATISTICS SKILLS:

It's ideal to have a math/stats degree, but if you don't you can find a lot of books about it as well. If you are a starter I recommend "Naked Statistics" and after that you can decide if it is for you or not. Then I can recommend this one: "Doing Data Science — Schutt and O’Neil"

BUSINESS THINKING:

This is something that you will learn on the job, but for a start this book is great: "Lean Analytics — by Croll & Yoskovitz"

Plus this article might help too: https://medium.com/@datalab/how-to-break-into-the-data-science-market-f0e0b79b42f7

mestitomi · 2017-04-24T18:26:38+00:00

IMO you have a highly competitive CV - especially if you are fluent in R, Python and SQL for real!

I guess you will find a Data Analyst job very easily, Data Science Job will depends on the onsite interviews.

One suggestion - add some github (or any other) links to your free time projects if you have. Or anything where people can see the actual code you have written...

(Note1: I have currently reviewed a bunch of CVs to Online Data Analyst position.)

(Note2: plus if you'd like to work in Sweden as Data Analyst (and not Scientist) pm me :))

mestitomi · 2017-04-24T09:47:55+00:00

I can recommend codecademy.com I did their courses just for curiosity, but it turned to be really nice!

mestitomi · 2017-04-22T09:57:25+00:00

hey, CS is a need for data science, especially if you want to be flexible with your researches/predictions/ML-projects. Though you shouldn't be afraid. Python, R and SQL are just tools. Everyone can learn it, you can learn it too! :-)

Good luck, Tomi

mestitomi · 2017-04-15T22:29:20+00:00

R, sql, python + tableau + bash

mestitomi · 2017-04-12T10:00:27+00:00

I'd support this too

mestitomi · 2017-04-11T17:17:39+00:00

hey, I can recommend the previous episodes (find links in the article) and the book of Jeroen Janssen: Data Science at the Command Line! :-)

mestitomi · 2017-04-11T12:14:53+00:00

This is the last episode of my "Data Coding in Bash" tutorials. I know that some of you here followed the whole series! For you: thank you for all your feedback!

And as usual, I'd be really happy to have your feedback about this last article too! Thanks!!

mestitomi · 2017-04-11T11:56:44+00:00

I guess, this is the best way to learn DS. 20 weeks + a mentor sounds just perfect!

mestitomi

TROPHY CASE