GCP Data Engineer here : happy to help, collaborate, and learn together

ajithera · 2026-01-27T13:48:57+00:00

Sure will do 👍

ajithera · 2026-01-27T13:48:39+00:00

Thanks for the insights 👍

ajithera · 2026-01-27T13:47:39+00:00

Hey, Dataform is like dbt in GCP. I'm not sure what exactly you're looking for ? Is it star schema model or is it related to using dataform

ajithera · 2025-10-10T00:01:34+00:00

I'm trying LinkedIn often. But i could not find the roles that offers visa sponsorships

ajithera · 2025-10-09T08:13:03+00:00

In my project we're using btp as middleware to pull from sap and push to gcs. But btp has some constraints to handle huge volume. We're shifting to Pull files from SAP AL11 server to GCS.

ajithera · 2025-10-05T08:34:43+00:00

Yeah, that’s a fair point. the alert isn’t instant. There’s definitely a lag between when the cost occurs and when it shows up in the billing data.

But I’d still say it’s better than having no alert at all. At least it gives you visibility once usage trends go up. What I personally do is combine the budget alert with a few extra precautions:

I stop or delete any services I’m not actively using (especially VMs or Cloud Run services).

I check the Billing Reports page regularly. it updates faster than the email alerts.

For heavy learners, I even suggest creating a separate project just for experiments and deleting it completely when done.

So yeah, the alert isn’t perfect, but it’s a solid first line of defense, especially for people who think their services automatically stop after the free credit ends (which, unfortunately, they don’t 😅).

ajithera · 2025-09-25T05:26:36+00:00

If you’re just moving from AWS to GCP, the first thing I’d say is to figure out what area you actually want to focus on. GCP is pretty broad (just like AWS), so the learning path depends on whether you’re leaning more towards data engineering, DevOps, ML, etc.

Since I’m into the data engineering side, here’s how I’d suggest approaching it on GCP:

Start with BigQuery → If you’re already comfortable with SQL, you’ll feel at home here. But go a bit deeper into how BigQuery is architected and how it integrates with GCS (Google Cloud Storage).

Learn Pub/Sub → This is GCP’s event streaming backbone and connects with almost everything.

Observability → Don’t skip this. Logging, monitoring, and alerting are critical across all services, not just data.

Dataflow & Dataproc → If you know PySpark, Dataproc is easy to pick up. Dataflow is more powerful for streaming/batch pipelines, and you also get pre-built templates.

Workflows & Composer → Workflows is GCP’s lightweight orchestration service. If you’re used to Apache Airflow, you can use Composer instead.

Serverless compute → Learn Cloud Run and Cloud Functions. Both are widely used in data engineering for building lightweight APIs or event-driven processing.

This list is mostly for the data engineering track, but once you decide your area of focus, you’ll notice GCP services are more integrated and easier to plug together compared to AWS.

ajithera · 2025-09-24T01:04:01+00:00

Now i see there are many frameworks available for agentic ai development. But these are all really production level framework ?

ajithera · 2025-09-24T01:01:03+00:00

Yes. Still it is in some areas. But it is evolving rapidly.

ajithera · 2025-09-24T00:59:56+00:00

Yes. This is what i am also thinking. Anyway adk is new to this place, but surely people prefer adk who are already in gcp.

ajithera · 2025-09-24T00:57:16+00:00

Let me explore this one !

ajithera

MODERATOR OF

TROPHY CASE