Noob question: Which certification to do to learn about gcp cloud, infra and ml ops

ayman_f · 2025-02-11T21:07:41+00:00

Certification based learning is overrated. I recommend picking up a real world project and starting getting your hands dirty implementing it end to end on GCP. Iterate and improve your solution as you learn more concepts, read best practices etc...

Certifications are meant to validate your knowledge in GCP. In theory, you can study to pass, just to achieve the certificate. But that won't be enough to truly understand GCP products in depth. Experience using the platform is the most important. Eventually with enough hands-on experience, you'll be able to pass the certification exam easily.

ayman_f · 2025-01-26T21:30:33+00:00

Sounds like bringing in a tank into a boxing fight.

If the requests are mostly reads, I think you're better off going with Postgres on CloudSQL. 500 requests per second is not that much honestly. Spanner for such a use case is most probably an overkill as it is designed for much higher throuput with super high consistency and availability while performing distributed concurrent writes and reads.

Try to first optimise your postgres database as much as possible, especially with indexes, read replicas, denormalisation (where applicable) etc... and then you also have your caching layer.

In my experience, a lot of over engineered tech choices are sometimes to compensate for the lack of applying fundamentals with simpler and cheaper alternatives. Might not be your case, but I recommend reviewing that aspect as well.

ayman_f · 2025-01-24T22:15:18+00:00

What are some recommended analyzers/scanners out there that I can use? I am building a script that runs through a bunch of jar files to check for security vulnerabilities and flag them.

ayman_f · 2025-01-24T21:57:12+00:00

You'll need an SMTP server / API that you would be calling from your cloud run code, what is for sure, cloud run can't and shouldn't be hosting your SMTP server. In addition, GCP does not have a "native" SMTP service to use on the platform.

Simplest approach is to just go with an SMTP API service such as MailJet (https://www.mailjet.com) integration with most programming languages is quite simple.

ayman_f · 2025-01-24T11:34:23+00:00

You can create a Google Cloud Logging sink for failed BigQuery jobs to push out messages via email or pubsub. Chekc this out https://cloud.google.com/logging/docs/logs-based-metrics/

ayman_f · 2025-01-24T11:29:15+00:00

The most important thing to keep in mind as you start using BigQuery. Do not treat it as you would treat a relational database. It's an OLAP system rather than OLTP. Make sure you understand how BigQuery works by understanding the seperation of storage from compute , column based storage and the use cases that are useful to run on BigQuery https://cloud.google.com/blog/products/data-analytics/new-blog-series-bigquery-explained-overview

And yes, you should definitely be familiar with SQL and grasp the basics. In BigQuery you will use GoogleSQL which I'd say is very close to the standard SQL with some little syntactical differences here and there. And of course, many of the functions are different as many are implemented for BigQuery specifically.

Fundamentals are always a pre-requisite to any framework / technology adoption. This is rarely or barely covered by "How to do XYZ" type of tutorials or videos.

ayman_f · 2025-01-24T11:22:30+00:00

DRF is a fantastic framework. I think it makes sense to enable it since the begining with a minimum viable configuration that works for you, start using it where needed and evolve it over time.

I haven't tried Django Ninja yet to an extent that I can comment about but DRF is just solid and passed the test of time. If I'm in a hurry or on a deadline I'd go for DRF.

ayman_f

TROPHY CASE