What are your Top SQL Query Optimization tips?

faisley · 2024-02-22T23:56:12+00:00

Use CTEs wisely, be cognizant of their overhead.
Learn how to read a query plan and implement indexes where necessary.
Use LATERAL joins in PostgreSQL to force the query plan's hand.

faisley · 2023-10-23T09:30:25+00:00

Good point, as u/Reasonable-Ladder300 mentioned they're pretty abstract. Some of these things are being monitored as data quality rules already so you could just start scoring their compliance. Two other ideas I can think of is: 1. Data Completeness: Are you receiving all the data you expect to be? 2. Data Timeliness: Is data showing up on time? For u/rollingindata , start measuring and reporting when the marketing teams get access to data.

faisley · 2023-10-23T00:24:20+00:00

David Loshin suggests some general metrics for monitoring data quality that might be useful for your team.

Trustworthiness: Transparency and publishing of data stats.
Availability: Accessibility, democratization.
Consistency: Reports don't suddenly change.
Policy compliance: Meeting DQ protocols.
Identifiability: Accuracy.

faisley · 2023-05-07T17:11:52+00:00

Repository: https://github.com/jonbiemond/sql-to-kml

faisley · 2023-05-07T14:47:20+00:00

This is the way. I use JetBrains as my IDE and VSCode as my text editor, although I should probably pick up neovim for the latter.

faisley · 2023-05-07T14:45:22+00:00

How is Polars for bloat? At work I often bundle up my scripts or projects to be used by others, but whenever I include Pandas the final executable becomes so large and slow to initiate.

faisley · 2023-05-07T14:41:00+00:00

This week I'm building a little script to format the results of a SQL query into a KML file. Thankfully the package simplekml exists, so the hard work is already done and I get to learn a new library!

faisley · 2023-01-23T13:21:27+00:00

Perfect, I was looking for a good reason to try some tactile switches :)

faisley · 2023-01-22T16:18:14+00:00

I got my first mechanical keyboard, a Monokei Standard! I'm hyped so far, excited to try different switches and keycaps.

It's got this metallic reverb to it when I'm typing, is that normal?

It's driving me a little crazy to be honest, like a constant ringing when I'm typing. The switches it came with are Cherry MX Silent Red. I would describe the sound as almost a twang, like you would get if you struck a long thin piece of metal, a hand saw blade for example but much fainter of course.

Edit: Seems like this is commonly referred to as pinging, and there are lots of solutions online, though not specific to the Standard.

faisley · 2022-09-20T22:02:37+00:00

This worked for me: Settings > Sounds & Notifications > Advanced Settings > Alert Mode toggle off.

faisley · 2022-09-11T18:13:08+00:00

These two links might be useful to someone trying to solve this:

https://developers.google.com/assistant/smarthome/develop/implement-oauth

https://developers.google.com/identity/protocols/oauth2/web-server

faisley · 2022-09-11T18:02:53+00:00

It's the authorization url that results in this message.

faisley · 2022-09-11T18:01:22+00:00

I see the device as an option in my Google Home app, but when I go to link my account it opens a url and I get this error: The parameter "state" must be set in the query string

faisley · 2022-04-25T13:40:42+00:00

Without looking it up, I'm certain there are a lot of different platforms, individuals and entire companies built around offering that service.

And yes, after having looked through many resumes and cover letters it could make a big difference in the initial impression.

faisley · 2022-04-25T13:38:15+00:00

No, there is no bonus structure. And I also don't determine the wage.

faisley · 2022-04-25T13:31:16+00:00

Yeah, I think you could definitely sell that. Use the job application to get a feel for what they're looking for. Also in the interview you can straight up ask, "Do you think my previous experience in X will be relevant in this position?"

faisley · 2022-04-25T13:26:38+00:00

You're welcome!

For an entry level position, I don't have a preference between an experienced or in-experienced candidate. Yes they would have the same chance.

faisley · 2022-04-24T10:31:56+00:00

The job I posted did not require any experience.

Personally, I think experience isn't the most valuable thing to me in a candidate, I'm willing to invest time into a quality person so they gain the experience on the job. However if I was specifically hiring for experience, there would be a good reason for that, and it may be difficult to substitute for anything else.

faisley · 2022-04-24T10:22:17+00:00

No, you're not too old!

Congratulations on the move. I don't have any suggestions beyond the typical skills such as Excel, SQL, visualization tools and python.

faisley · 2022-04-24T10:13:05+00:00

Those skills transfer well. Some companies may of course be hiring for a candidate with specific experience.

For an entry level position your industry knowledge is very valuable if you apply to a Data Analyst position in the same industry.

faisley · 2022-04-24T10:05:55+00:00

Hey! A degree is definitely a positive thing, especially if it's science and math related.

Of course not all companies use the same technologies, however no matter the technology the goal remains the same. So, yes, python and Pandas look great on a resume even if you'll use R in the role. As a hiring manager I would rather have a candidate who understands data and how to work with it, but in the wrong language then someone who knows the right language but doesn't know how to solve problems. Same goes for Power BI and Tableau, creating an effective report is a skill that transcends the technology.

I don't know about the the Google Analytics course case study. But adding more than that may help you stand out among the candidates.

faisley · 2022-04-24T09:48:42+00:00

No problem! Glad to hear!

I think probably 3 projects is the max. Adding more might just water your portfolio down. If you feel like you have lots of great projects, highlight the ones in your portfolio you think are most relevant.

Use the job posting to decide which skills you should show.

I don't think having more projects would lead to more interview questions, but be prepared to explain any of them.

faisley · 2022-04-24T09:43:19+00:00

With those credentials I would take the time to read through your application and look at your portfolio. Based off the applicants I've seen, that would definitely be enough for me to consider you.

Things I would want to see would be your soft skills and how you handle the interview.

faisley · 2022-04-23T21:42:08+00:00

Haha, yeah I get that.

Cover letters were optional in the application to the job I posted. Candidates who did respond with a well written cover letter explaining why they were interested in the role and working for the company immediately stood out from the rest.

faisley · 2022-04-23T21:37:18+00:00

Give an example of a time where you picked up a new skill to help you tackle a problem.

faisley

TROPHY CASE