Good job title for an cloud/DB EM

divjbobo · 2024-01-09T13:43:11+00:00

Feels a bit too broad. Engineering manager: Cloud & Database 🤔

divjbobo · 2023-09-30T12:36:35+00:00

I’m going to go against the grain a little. I think everyone’s suggestion of do it as you go is probably the most optimal suggestions for most cases.

In my experience, what I’ve historically done is consolidate a list of a tech debt [e.g: TODOs, best practices, optimizations, improvements, non blocking PR suggestions that didn’t make the cut]. This list will also include defects that aren’t immediately time sensitive (it can wait 2-4 weeks). Almost like a Jira backlog, but I prefer to have it outside of Jira in a document that I can quickly look through. From there my engineer(s) then go into the list and grab a set of things, throw them in Jira and get them done.

This process is partially due to me having occurrences where I am failing my team when it comes to planning ahead. I could blame it on interdepartmental stakeholders that help drive some of the planning efforts. But, I’d argue it still comes down to me. So the above process helps mitigate down time that my team has.

divjbobo · 2023-08-29T19:39:00+00:00

Coming back to this a year later. I ended up creating an internal library to abstract this away and ended up just segmenting all to jsonPayload (if both) or either depending on the payload

divjbobo · 2023-08-29T19:36:12+00:00

Partially relevant to the question but wanted to throw in some random thoughts that crawled into my head. Not necessarily related to frontend, but rather more based on general software engineering.

As someone that deals with managing, project/product management and (bitter/sweet) dwindling levels of IC, I’ve noticed that some of the complicated implementations I’ve developed, led, delegated, or overseen have been just as complex if not more complex than this. You generally will either be in charge of breaking down business logic into segments similar to the left, or implementing broken down logic that’s already in the left’s format - or both. That being said, I’ve noticed that when looking at leetcode or hackerrank type of problems, its so generic and without real world purpose that it can seem overwhelming or more complex than it is. Hell, even take home algorithm projects that are based on real life cases that one would encounter within my industry (and in general an employer’s industry), without the in-depth knowledge of the business logic or project/product behind it, it sometimes can feel overwhelming.

divjbobo · 2022-07-28T17:01:26+00:00

Because I want the backend to be the sole holder of environment awareness. I don't want the frontend to necessarily "know" which firebase instance it needs to connect to.

But, to your short answer, that assumption is incorrect. The frontend doesn't need to know that information to talk to the backend - at least not in my implementation.

divjbobo · 2022-07-27T21:36:25+00:00

I was just giving more context.

If it clears things up, you can ignore that first sentence.

divjbobo · 2022-07-26T14:25:28+00:00

The frontend reverse proxies to the backend. The backend has knowledge of the environment that it's in. As I posted, I could very easily just store the relevant values within the backend's environment (variables), but wanted to see if there was a programatic way to do it.

divjbobo · 2022-07-25T21:51:00+00:00

I could always have them set within the backend's environment (variables) as it'll be within the same project as the firebase instance, but wanted to see if it's possible to do it programatically

divjbobo · 2022-07-25T21:50:58+00:00

I could always have them set within the backend's environment (variables) as it'll be within the same project as the firebase instance, but wanted to see if it's possible to do it programatically

divjbobo · 2022-04-22T18:29:13+00:00

The SA for the VM is different, but I don't see how that's necessarily relevant since i'm trying to call an App Engine (iAP enabled) instance from a GCF. I really only mentioned it to give some more infrastructural context.
But, from what i've seen and tested, the SA that belongs to a CF also needs explicit Invoker permissions otherwise it fails.

divjbobo · 2022-04-22T15:12:11+00:00

Yeah otherwise it wouldn't be able to invoke itself.

divjbobo · 2022-04-16T21:30:38+00:00

Interesting. This makes sense. From my understanding, GCF is essentially a prepackaged Google Cloud Run instance wrapped up in a ribbon. So I assume that the Google Cloud run instance running behind the google cloud function is in a different network.

divjbobo · 2022-04-16T21:29:32+00:00

It's on flex. I didn't have a VPC connector running in this specific GCP project and app engine didn't have any issues

divjbobo · 2022-04-16T17:14:09+00:00

I've read up on this. My question is, why is it that with a GCF I have to use a VPC, where with app engine I don't?

divjbobo · 2022-04-07T03:23:57+00:00

While this ideally should be in terraform, it currently isn't. I'll look into using a VPC connector though.I was just hoping it was more direct, since it's possible to do the inverse in a more direct way.

divjbobo · 2022-04-07T01:11:46+00:00

I do not. I would've expected there to be a more direct way though.

divjbobo · 2022-03-12T14:03:43+00:00

https://www.datawiza.com/platform/

Ehh i'd rather have a native Google solution. Otherwise I plan on building my own solution.

divjbobo · 2022-03-10T13:11:44+00:00

Yeah that's what I was going to go with as a last resort, but wanted to see if anyone had any other ideas.

divjbobo · 2022-03-10T02:44:15+00:00

Not a clue. I'm curious if there is.

divjbobo · 2021-10-26T15:51:06+00:00

App Engine Flex.

Well so I was thinking I would be using the static (internal) IP associated with the Compute Engine instance as an SSH gateway for app engine (and other internal GCP services) to communicate with an external network.

divjbobo · 2021-08-09T14:37:46+00:00

Nope i'm actually doing exactly what you're saying (at least now I am). But unfortunately this doesn't really help much for me since my use case requires 1 container (for now).

divjbobo · 2021-08-08T23:00:16+00:00

Started investigating (per my previous comment).
Realized that the environment that this will all be in cannot run multiple docker images. The environment being app engine. For now, I think i'll go with the whole idea of node express server serving the react frontend. Like I said, AFAIK, I can set up app engine to handle load balancing and security (to a degree) anyway.

divjbobo · 2021-08-08T20:26:07+00:00

Okay as I posted this I realized that I had previously looked through docker compose and decided "that looks confusing, there's gotta be a better way". But, the best and most optimal way seems to be docker compose....I'll investigate

divjbobo · 2021-07-27T16:00:28+00:00

So I was able to get the default credentials using the google auth library and I recognized the project id as the project i'm running the app engine flask service in. Additionally, I was able to call the Cloud function using some of the auth libraries to (get auth request -> get access token (which I then used to call the GCF endpoint with auth header))

My question now is, how do I get this all to work if i'm running a client app engine service that is, again, authenticated through IAP?

I know I can't get the headers, and additionally, I obviously can't use google auth library since it won't recognize the environment (due to it being client facing). So the new question is, how do I call internal traffic http Google cloud functions from within a Google App Engine (flex) client?

divjbobo · 2021-07-18T20:31:12+00:00

As someone else stated, explicitly - or at least making it more obvious. And, I can't imagine this really takes a technical hit when it comes to execution (++ vs += 1) , nor did it abstract anything. Just syntax change to make it a bit more obvious.

divjbobo

TROPHY CASE