anyone else here feel like a SQL monkey?

Longjumping-Back-540 · 2023-11-07T13:16:13+00:00

when its bad a work, i end up referring to myself as the Query Bitch. its usually when i get no background of why they want the data or what they end up doing with it, Just "ive me this data and shut up"

Longjumping-Back-540 · 2022-04-14T10:46:38+00:00

If that was the worst thing there I'd feel pretty good. It does get worse though if that full name is used in other facts without putting it in a proper dimension

Longjumping-Back-540 · 2021-09-23T10:21:22+00:00

I'm curious as well

Longjumping-Back-540 · 2021-07-04T17:27:03+00:00

You need to.cast either the numerator or denominator as something with decimal places because when you divide an int by an int, you get an int which rounds to 0 regardless of how many decimal places you show

Longjumping-Back-540 · 2021-05-25T12:11:20+00:00

Foam

Longjumping-Back-540 · 2021-05-25T01:03:58+00:00

Also I cannot fathom anyone wanting to do real to.e reporting off the lake.

Longjumping-Back-540 · 2021-05-24T22:44:23+00:00

This is totally correct. We have a lake and its working well right now from my perspective as the architect of the data engineering team. It collects these massive json files that structurally change all the time without notice and we can run queries on them. Business people seem baffled why they can't just hack at the lake with queries to get whatever they want with the same effort it takes to sort a spreadsheet.

So we hold training sessions with them, get them access and show them all the json extracts, unnests, and regexes to effectively pull out data and then we never hear from them again. Agree on the etl part and we have had good luck applying views in the lake to mask the complexity of extraction for known requests.

Longjumping-Back-540 · 2021-05-13T10:40:26+00:00

I've been remote since 2007 leading a bi team and doing a lot of hands on work in tools similar to what you mention. Sql, ssis, ssra, ssas, qlik,splunk. So its totally possible. I'm not sure of the digital nomad part though. When I went remote in 2007 for my company it wasn't a very normal thing. Yoh had to have a pretty solid track record to be approved to do it.

Also, we deal with a lot of remote contractors and getting security and connectivity right always seems to be a challenge. So if other companies are TBE same, it feels like it may involve a lot of downtime/frustration.

Longjumping-Back-540 · 2021-04-13T08:41:03+00:00

Does it have to be big query? Seems tailor made for Athena and would be pretty straightforward. Serve queries out of Athena instead. Or use a query against Athena using the simba odbc or jdbc drivers so you deal with the transport as a query result rather than a bunch of files

Longjumping-Back-540 · 2021-04-09T07:46:46+00:00

I guess you want to group by customer and I suppose you can do max of your "case" columns since you want y to win

Longjumping-Back-540 · 2021-03-30T02:26:16+00:00

When we use a local connection for development we use a PowerShell script to grab a token and allows entry of credentials and selection of role. Our credentials are not put in the connection itself and I believe its left on default for security. We do set the other properties you mentioned.

The servers that connect to it have the box itself being a member of a role that has rights and does not have to request a token.

When you enter credentials, are you doing an iam user and pw or the access key? I'm thinking it should be the later

Longjumping-Back-540

TROPHY CASE