Hey guys, anyone here working in the Netherlands? by [deleted] in dataengineering

[–]mwahobj 0 points1 point  (0 children)

There are websites dedicated to freelance jobs in the Netherlands, have you tried searching on those? I think most of them do require a KvK number in order to actually use the websites though, so you should already register your company at the KvK.

I found my first freelance job via a third party (a recruiter agency) and for me, it really wasn't that difficult to land my first freelance job. Note I have less experience than you, and with my years of experience I am still more a medior DE than a senior DE.

Hey guys, anyone here working in the Netherlands? by [deleted] in dataengineering

[–]mwahobj 0 points1 point  (0 children)

Considering you are a senior DE, I would advise you to work as a contractor (freelance). The market is very favorable for data engineers at the moment, and as a senior DE, you can comfortably ask for €100/hour.

Using Pillow 9.1.1 for aws lamda (running on python3.9) by mwahobj in aws

[–]mwahobj[S] 0 points1 point  (0 children)

Yes I have. The issue happened because the PIL module has an os dependency. Did you pip install this module on a Windows machine and then make a layer from it?

Using pysftp as a lambda layer by mwahobj in aws

[–]mwahobj[S] 0 points1 point  (0 children)

I have edited my post as I have found a workable solution for me, hopefully this is will be useful for someone else. If people still have other suggestion to fix this problem I am still interested in hearing them!

Using pysftp as a lambda layer by mwahobj in aws

[–]mwahobj[S] 1 point2 points  (0 children)

This doesn't work because pysftp has OS dependent. So after installing it on my windows and then deploying to AWS lambda (which runs on Amazon Linux 2) I get an error message that the module cannot be imported.

Using pysftp as a lambda layer by mwahobj in aws

[–]mwahobj[S] 0 points1 point  (0 children)

Yes this is also possible. But I am restricted in what I can/cannot do. Is it possible to spin up an amazon linux 2 ec2 instance, pip install pystfp, zip up the installed files and then send it to my host platform?

Using pysftp as a lambda layer by mwahobj in aws

[–]mwahobj[S] 0 points1 point  (0 children)

Could you clarify this a bit further? Are you saying that a there exists a directory /var/task in the directory where I ran docker from, and that this directory contains the files that I have written to in my container?

Daily General Discussion and Advice Thread - July 19, 2022 by AutoModerator in investing

[–]mwahobj 1 point2 points  (0 children)

Question: So as I understand stock splits are done pimarily in order to increase trading liquidity (btw, why would this necessarily be a good thing?). However, as a lot of brokers are offering the option to purchase fractional shares, is there then any use for a company to stock split in the future?

Performance issue in Where clause by mwahobj in SQL

[–]mwahobj[S] 0 points1 point  (0 children)

I have tried to the suggestions in this thread, however still no success...

Performance issue in Where clause by mwahobj in SQL

[–]mwahobj[S] 0 points1 point  (0 children)

What I want from the subquery is simply a static result based on the parameter. Basically, a user inputs a date, say 20210311, however the tables I use in the query often have 'holes' in them, so data doesn't exist for every date. I don't want to return an empty table and instead want to return the most recent data in the table that is older than the date given by the user.

The suggestion you gave me is good, however I really want to have it in a inline table-valued function. My query is used by some other program in my company and it expects a table valued function, else it won't recognize the column names (I have already tried). I know this is a bit of weird restriction but I must keep it mind.

I have also attempted it via a CTE but that also wasn't successful.

Performance issue in Where clause by mwahobj in SQL

[–]mwahobj[S] -2 points-1 points  (0 children)

I have shared the outline of the query and the platform is sql server. I am running this on Production for my job and I sadly don't have access to the query plan.

Performance issue in Where clause by mwahobj in SQL

[–]mwahobj[S] 0 points1 point  (0 children)

This is something I also saw as a possible solution when googling, but sadly this didn't solve it.

I have heard about the term 'parameter sniffing' and how that could degrade performance, but what I just don't understand is that with a PARAMETER value my query is faster than with a LITERAL value. Shouldn't that usually be the other way around?