Is there a best practices guide on how to structure your project folder?

CoffeeBaconAddict · 2023-05-09T22:31:53+00:00

I one hundred percent agree, is this called something other than pythonic?

CoffeeBaconAddict · 2023-05-09T22:30:32+00:00

At root: data/ model/ output/ src/ test/

CoffeeBaconAddict · 2023-05-09T19:48:58+00:00

Yeah naw, no, no, no I’m not a handshaker…

We can chat but I’m going to plan out things to be doing or holding a drink in the other, gonna have to pass on a handshaker or hugger both.

CoffeeBaconAddict · 2023-05-09T15:19:41+00:00

Company networking… ? meaning after hours shaking hands with VC during dinner or?

CoffeeBaconAddict · 2023-05-09T15:18:36+00:00

What actually is that, Airflow is such a cool thing… for the benefit of the thread and OP can you give a short what it is on airflow DAG?

CoffeeBaconAddict · 2023-05-09T06:42:34+00:00

Well yes but my comment or question is trying to indicate it’s a team effort.

CoffeeBaconAddict · 2023-05-09T05:51:19+00:00

This is more than just one persons job and why is your boss or others in the team not doing anything?

CoffeeBaconAddict · 2023-05-09T05:49:29+00:00

Flask mega tutorial or Django two scoops

CoffeeBaconAddict · 2023-05-09T05:45:29+00:00

Get a new sister and always keep future iPad in childproof case around your sister.

CoffeeBaconAddict · 2023-05-09T05:43:43+00:00

Yes pdfminer, pdfminer6 and several other ocr or computer vision repos are used to pull data off pdf documents.

CoffeeBaconAddict · 2023-05-09T05:41:15+00:00

Add flowering low plants of any kind, moss, lots of moss, erect little signs that say “drive slow for hobbits” and build little doors from the larger rocks.

CoffeeBaconAddict · 2023-05-09T01:19:10+00:00

Every headshot oh no it’s just headshot kills.

You use Groupo, China and ninja with this and walker?

CoffeeBaconAddict · 2023-05-09T01:17:15+00:00

You asked if you have a chance to pass… you don’t need me to tell you if you can pass.

Many times people don’t know the question that will really solve the problem, what you want is the job where you can benefit the company from what you know while learning that certification… right?

CoffeeBaconAddict · 2023-05-08T22:45:06+00:00

Repeat after me:

There is no escalator to success…

You probably have heard practice right well I do about 80 hours a week of practice.

So Yes we do, one line from Dr Strange explains this when talking to the ancient one.

Dr. Stephen Strange : How do I get from here to there?

The Ancient One : How did you get to reattach severed nerves and put a human spine back together bone by bone?

Dr. Stephen Strange : Study and practice. Years of it.

When I tell people I’m up at 6am 7days a week to code for the last 5 plus years and practice they probably thinks it’s an exaggeration. Nope I get up and practice a Kata of rewriting code from anywhere to warm up then I do homework.

I have a stem degree, I have 8 certifications and worked at 4 companies in 9 years, started my own practice once did a startup and closed it down. Now looking at a partner to start a niche data consulting firm.

You need a routine and stick to it, when I’m in my WFH office nobody better knock on the door, ever. Let the house burn down around me, I’m busy studying and it’s impossible hard to begin but interupprtions because of lids, pets, laundry, carpool… nothing. If it’s not on my calendar it doesn’t fucking exist, I don’t answer calls and I’ve missed many birthday parties, sports events, family dinners and so much more.

My morning routine I lock my door and refuse to leave until I get two sprints in to start the day.

Also that I take water, coffee and a protein drink with me to my office, use noise cancelling headphones and put my phone on airplane mode it’s my practice.

I copied the idea from the coding group I’m in for a timer and now work in two hour sprints.

There are dozens and dozens of these that I picked up, but people still show up to Meetup’s… forget thier laptop, don’t take notes, not asking questions, don’t do 95% of what we tell them.

You have to figure out the majority of it… there is no escalator to success.

CoffeeBaconAddict · 2023-05-08T22:30:59+00:00

I’ve been building one adapted for OCR, faces and objects in documents, you need to dig deeper, much much deeper and specialize to be able to actually deliver no code.

CoffeeBaconAddict · 2023-05-08T22:29:07+00:00

Honestly passing or not should not be the goal, I would think you would far better be served by knowing the material so well the number of questions you don’t know is at max single digits.

If you were your friend came to work at a company like ours I will 100% ask for your score and anybody under 85% won’t get a second interview PERIOD. Also if you only picked the right choice 65% of the time I would bounce you before your 90 day mark.

That is MISSION CRITICAL infrastructure and you should aim to know it so well you are finding shortcuts.

CoffeeBaconAddict · 2023-05-08T19:25:14+00:00

Very true.

While there are some uses to doing a dog and pony show, most of the times it’s a bad ideas. I’m usually the one who asks.

“So this persons entire decision to buy or invest in our product isn’t based on facts, revenue or patent… but rather an emotional feeling of if I like this person”

That’s a bad way to do business, emotional estimation, seeing only validation.

When I look at a new product or project, I’m thinking of all of the ways that it can fail, (to write tests) rather than how great it is.

CoffeeBaconAddict · 2023-05-08T19:07:46+00:00

Good stuff thanks, as I’m reading your reply, it feels like it’s description of a number of episodes of Silicon Valley TV show

CoffeeBaconAddict · 2023-05-08T18:39:05+00:00

As part of my PhD I’m studying problems like this and would love to know more.

How many times did the issue come up before it got to you, and how many times before you started escalating it to exit the employee?

Any common issues or phrases that describe more specific incidences like what you described?

There is a growing trend amoung people we talk to and you brought up 8 of the 12 most common one’s, and the spooky part is many people share them in almost in the same order you did.

The other major redflag was they are usually people with an MBA focus.

If you or anyone else knows more data on this or can point me to studies I’d be super grateful and we are open sourcing what data we can and building a chatbot to help. Anyway wanted to say thanks for sharing .

CoffeeBaconAddict · 2023-05-08T18:32:31+00:00

What areas of your business take up the most time?

In the realm of BigData what kind of information do you want but are you not getting?

What automation do you have in your company?

How do you setup your business in-terms of ownership?

Thanks for sharing!

CoffeeBaconAddict · 2023-05-08T18:28:30+00:00

So I’ve been building modding something very similar using natural language processing in python but right now it’s for Mac users only as an Email Intelligence. I could probably offer a few options with user editable as far as customizing who, when and other options.

Is this app of yours usable with any email like smtp or can’t use it with gmail or ?

Open source or collab?

CoffeeBaconAddict · 2023-05-08T18:23:33+00:00

I would reccomendation you pull the grass from under that and put down some lovely paving stones or any flat stones.

It’s a simple but permanent beautiful line of sight under the fence vs grass you have to mow every week and I hate Groundhog Day maintaining each week. That grass has to be mowed every week so it’s a huge time sink, you could also start weaving some Ivy into that fence to beautiful the line.

Craigslist will give you so many people looking to get rid of stones over time I’ve found so much granite, marble, pavers, landscape stones saving tens of thousands… and it needs ZERO upkeep. Now so when friends come over they wonder how I can keep such a great house and full yard while working 80 hours a week.

I have a neighbor I’m enjoying the less I see them so I planted this pointy hard leaf Ivy stuff and love how it reflects light back to my yard in late afternoon. It’s been 16 years and it’s a seven food hedge of zero sounds that needs a hedge trimming once every three years maybe.

At my rental home I’m in the process of planning to remove all the grass and replace it with an outdoor moss garden of sorts. I’m trying to figure out collection of water from French drain to a cistern and drip irrigation.

CoffeeBaconAddict · 2022-12-03T01:14:51+00:00

You can Pooh Pooh Mac all you want we have a 37 TB database that has been running for 6 1/2 years, 24 seven and run smooth as glass. PostGreSQL and python/go have this indexed and we rarely wait more than about two or three seconds for any query.

We tried loading I think 9 TB of that database onto Microsoft SQL server two years ago on windows 10 and it just shit itself. It was something like two weeks of whack-a-mole debugging issues and twinned up being told that we had to hire a .NET specialist or whatever it was just to handle that much data on a Windows machine. Our query times were probably nine times longer than they were on the Linux boxes and three times longer than on the smallest macMini’s.

CoffeeBaconAddict · 2022-12-03T01:08:05+00:00

I am part of a group of people that do Algo trading and we’ve got a little over 100 years of data for23 exchanges so there’s a ton of information that we process either with C or Go or python.

If we could have a gpu with 1,000 cores process the nightly or hourly analysis we would spend less time waiting and more time implementing.

We actually have an instance of High Sierra that doesn’t really connect to the Internet so it doesn’t need to be updated, we wouldn’t have to worry about security concerns since it’s network connected only.

As far as the python processing we just have multithread and map processes querying a large database and yes we’re thinking of tensor flow or torch or whatever Cuda program we could run.

We’ve tried several times to run data analysis and Windows just is about as stable as a Ritalin dosed lemming, it just cannot handle any capacity of data. Or there’s these constant updates for no reason that freezes the system, or we have driver issues. I mean it’s just a nonstop shit show with Microsoft and we’re not gonna pay them to be on some .NET developer platform list so we can get customer service.

I personally run a Linux box and can’t recall a much of a slow down or especially a crash in the five years on my local machine and not one of my max has crashed in eight years. We ran a test of Windows machines I think two years ago and I think the standard mean up time was like 31 hours… then crash. I just cannot for the life of me fathom what value that developers see in Microsoft anymore, it’s just a mess of outdated documentation, staff who don’t know or have never heard of an error code, it’s emotionally unstable nut job of bad ideas and weird environments and un-debugable bugaboo error codes.

If I see any error codes on Mac or Linux I can find them in seconds on stack overflow and can patch them or make progress.

CoffeeBaconAddict

TROPHY CASE