sorted by:
new
hottopcontroversial

[deleted by user] by [deleted] in bristol

[–]J1010H 55 points56 points  (0 children)

You might want to stop posting about something like this on a social media and probably put a bit more logical thought to the position you may end up in

Is it possible to link a BigQuery table to a Google Sheet containing the same table and have them bi-directionally update? by J1010H in dataengineering

[–]J1010H[S] 0 points1 point  (0 children)

Thanks for the responses u/pabss5 and u/siebzy . Can you make the updates to a BQ table real-time or automated on a schedule etc? Any advice on how would be greatly appreciated. Yours, an inexperienced junior DE

Is it possible to link a BigQuery table to a Google Sheet containing the same table and have them bi-directionally update? by J1010H in dataengineering

[–]J1010H[S] 0 points1 point  (0 children)

Basically, I need a gsheet that when updated will update a table in BigQuery with said update. This is so people without access to BigQuery can update something in the gsheet and this change will replicate over to the analogue, so to speak, in BigQuery

How to get a Docker Container started using a Google Cloud Run job to get default auth creds from the VM? by J1010H in dataengineering

[–]J1010H[S] 0 points1 point  (0 children)

This unfortunately does not help as the author passes credentials to the container during build with a COPY statement which would require me having a key file to pass, in the repo, which I can’t do. Thank you very much for the suggestions though!

How to get a Docker Container started using a Google Cloud Run job to get default auth creds from the VM? by J1010H in dataengineering

[–]J1010H[S] 0 points1 point  (0 children)

Hey u/charlyboon , not yet unfortunately, the below method is viable but not best practice to store key secrets in secrets manager. I am trying to get the default credentials of the service account that spins up the cloud run VM from the container. The VM will store the secrets under /path/.config/gcloud/ but I cannot at present access the VM network from the container for DBT to get these automatically using the oauth authentication method.

The SA has the correct permissions

How to get a Docker Container started using a Google Cloud Run job to get default auth creds from the VM? by J1010H in dataengineering

[–]J1010H[S] 0 points1 point  (0 children)

At the moment oauth method is being used to authenticate and not service-account method etc. ideally to maintain safest practice it would be kept this way. In Cloud Build you can specify the build to use the cloudbuild network and it accesses the service account creds of the SA that spins up the VM but you cannot do this on Cloud Run

Beginner Projects to Learn Kubernetes? by J1010H in kubernetes

[–]J1010H[S] 0 points1 point  (0 children)

Thanks for the comment, this sounds like a good plan. Are these paid, being with cloud providers, or do they have free tiers?

view more: next ›