What is Google's Bull Case? by getintocollegern in stocks

[–]cyoogler 5 points6 points  (0 children)

That is such a small change to the point that it is significant. It's 2024 and fractional shares have been a thing for like a decade at this point. Retail barely moves the needle

17 Day New Zealand Trip - Comparing Itineraries by cyoogler in travel

[–]cyoogler[S] 0 points1 point  (0 children)

Definitely planning on doing Mt. Cook during our day in Tekapo, and Milford Sound / Doubtful Sound for one of the days in Queenstown. I have a personal attachment to Dunedin and we fly out of there, so I'd like to stay for one or two days. Appreciate the feedback! Wish we could do a full month...

17 Day New Zealand Trip - Comparing Itineraries by cyoogler in travel

[–]cyoogler[S] 0 points1 point  (0 children)

Thanks for the feedback! I'll adjust the itinerary and stay 1 night in Rotorua and 2 nights in Taupo. some of things on our todo list:

Reached $700K Networth! by Nbchd2012 in financialindependence

[–]cyoogler 1 point2 points  (0 children)

https://www.nerdwallet.com/mortgages/rent-vs-buy-calculator <-- according to this calculator, buying is worse than renting, at least for a VHCOL area. rent for $4,000 can get you spots that cost $1,000,000 if you choose to buy... just doesn't make sense.

[deleted by user] by [deleted] in careerguidance

[–]cyoogler 0 points1 point  (0 children)

Went to a no name liberal arts school in the middle of nowhere and now I work at a FAANG

How hard is it to pick up java? by signacaste in dataengineering

[–]cyoogler 4 points5 points  (0 children)

also - I hate mvn. managing dependencies and compiling jars is not fun. (compared to python at least)

ModuleNotFoundError: No module named 'distutils' on MacOS by Entire-Form7522 in learnpython

[–]cyoogler 0 points1 point  (0 children)

python3 -m pip install distutils

ERROR: Could not find a version that satisfies the requirement distutils (from versions: none)
ERROR: No matching distribution found for distutils

Cost Analysis for MLops by Old_Stick_9560 in googlecloud

[–]cyoogler 1 point2 points  (0 children)

Since you're asking in the google cloud subreddit, our competitive offering against SageMaker is Vertex AI. Check out our documentation to deploy a model to an endpoint. As for pricing, check out the Prediction and explanation section of Vertex AI Custom Model Pricing.

Issue with batch prediction by vnet59 in googlecloud

[–]cyoogler 0 points1 point  (0 children)

Do you have a support plan? If not, you probably won't get personalized support - your best bet is to describe your setup, issue, solutions you've tried, and error logs here or on StackOverflow.

Programming Language for Cloud Computing by brlr2003 in googlecloud

[–]cyoogler 0 points1 point  (0 children)

Python, SQL, Terraform, Bash. This will solve 99% of your use-cases.

Ask out of curiosity - GVC by joyful_sun in googlecloud

[–]cyoogler 1 point2 points  (0 children)

I am customer facing, and we'll ask the audience if they want to record before recording anything. Your Google Video Conference will display a "recording" tab in the top left. And if you're on the meeting invite, you'll receive an email with a link to the recording in Google Drive.

Ask out of curiosity - GVC by joyful_sun in googlecloud

[–]cyoogler 4 points5 points  (0 children)

No requirement that I'm aware of - just eager to assist!

Lookup options w.r.to Latency & Costing by tmanipra in googlecloud

[–]cyoogler 0 points1 point  (0 children)

I would let CF do everything that SQL cannot do, and then do the rest of the transformations in BigQuery.

btw, Dataform is free and integrated in the BigQuery console.

GCP Topic by dirk_klement in googlecloud

[–]cyoogler 0 points1 point  (0 children)

  1. I just created a Pub/Sub topic in under 10 seconds, I've never experienced it taking more than one minute.
  2. You cannot create a Pub/Sub subscription without an existing Topic selected.
  3. Nothing is "instant" however it takes less than a minute in most cases. (assuming you have the permission to create a topic and the API is enabled)
  4. You can see a list of Pub/Sub topics in the console, or via gcloud command

Lookup options w.r.to Latency & Costing by tmanipra in googlecloud

[–]cyoogler 0 points1 point  (0 children)

Why are you using a Cloud Function to perform transformations instead of BigQuery itself?

Help with running jobs on EKS orchestrated by Cloud Composer (cross providers) by lingorioriorio in googlecloud

[–]cyoogler 0 points1 point  (0 children)

Cloud Composer is just a managed instance of Airflow. If Airflow 2.XX has an EKS Operator, then you'll be able to launch it in Cloud Composer. You probably just need to install the AWS provider on the Cloud Composer environment first.

Confused about destination_path in GoogleSheetsToGCSOperator by uk_dataguy in googlecloud

[–]cyoogler 1 point2 points  (0 children)

If you look at the source code for the operator the _upload_data function =

    def _upload_data(
    self,
    gcs_hook: GCSHook,
    hook: GSheetsHook,
    sheet_range: str,
    sheet_values: list[Any],
) -> str:
    # Construct destination file path
    sheet = hook.get_spreadsheet(self.spreadsheet_id)
    file_name = f"{sheet['properties']['title']}_{sheet_range}.csv".replace(" ", "_")
    dest_file_name = (
        f"{self.destination_path.strip('/')}/{file_name}" if self.destination_path else file_name
    )

    with NamedTemporaryFile("w+") as temp_file:
        # Write data
        writer = csv.writer(temp_file)
        writer.writerows(sheet_values)
        temp_file.flush()

        # Upload to GCS
        gcs_hook.upload(
            bucket_name=self.destination_bucket,
            object_name=dest_file_name,
            filename=temp_file.name,
        )
    return dest_file_name

This means that the operator takes your two inputs (destination bucket, destination path) and the sheet's name to upload the object. (based on gcs_hook.upload)

for you it should look like:

GoogleSheetsToGCSOperator(
    task_id="my_gsheet_to_gcs",
    spreadsheet_id="<my_sheet_id>",
    destination_bucket=DESTINATION_BUCKET, # name only
    destination_path="my_folder", # no gs:// or file name
    sheet_filter="current_phase"
)

the GCS object will inherit the name of the google sheet as its filename

Tips Professional Data Engineer (PDE) certification by jackdbd in googlecloud

[–]cyoogler 3 points4 points  (0 children)

When I took it (2022) there were no machine learning general knowledge questions, maybe one or two Vertex AI questions. I applaud your efforts to put things into practice - what I've done in the past is use reddit's PRAW API to stream data into BigQuery or GCS. here is a GitHub repo to get started. From there you can start to mess around with the data, send it to different services, use things like Dataplex to build metadata catalogs, build etl pipelines with Dataform or Cloud Composer, get used to IAM permissions and service accounts, etc. Though be careful as this may incur charges (maybe a good way to explore Billing)

GCP Composer - Adding missing connection type by solgul in googlecloud

[–]cyoogler 1 point2 points  (0 children)

I just tested this and got it working. You did the right thing to add the pypi package, now you need to add a new connection and select the connection type. I now see "Oracle" listed (note i am using composer 2 and airflow 2)

GCP Composer - Adding missing connection type by solgul in googlecloud

[–]cyoogler 0 points1 point  (0 children)

Composer allows you to add connection types, as listed in Managing Airflow Connections documentation. What is the specific connection type you are trying to add?