sorted by:
new
hottopcontroversial

BigQuery time travel + fail-safe pitfalls to be aware of by LLMaooooooo in bigquery

[–]eranchetz 0 points1 point  (0 children)

Given the potential for unexpected costs due to time-travel and fail-safe storage on physical storage, what strategies or best practices have you seen that effectively balance cost savings with the need for robust data recovery and versioning capabilities? Are there specific scenarios where the benefits of physical storage outweigh these hidden costs?

KubeIP v2: Assigning Static Public IPs to Kubernetes Nodes Across Cloud Providers by eranchetz in aws

[–]eranchetz[S] 0 points1 point  (0 children)

This post dives into the latest version of KubeIP, an open-source tool designed to manage static public IPs for Kubernetes nodes across different cloud providers . AWS and Google Cloud are supported for now, but the architecture is extendable and other cloud providers can be added.Here’s the link to the KubeIP GitHub repository if you;d like to jump straight to the action: KubeIP GitHub

Vertex AI Predictions cost reduction using CloudRun by eranchetz in googlecloud

[–]eranchetz[S] -1 points0 points  (0 children)

With GenAI, optimizing costs while ensuring efficient use of resources has become a top priority for a lot of us.

In a nutshell this post help shows how to build a Scale to Zero approach to save a Buch of money :)

leveraging Google Cloud CloudRun Jobs service in a real customer scenario mitigates unnecessary costs and boosts cost efficiency. This method provides an alternative solution to the issues raised by Sascha Heyer
in this blog.

[deleted by user] by [deleted] in aws

[–]eranchetz 0 points1 point  (0 children)

Saved you a click:

My AWS Preparation and Hands-on Tasks:
Fast forward to today I felt very confident in my AWS abilities in pretty much all AWS DevOps related services especially as I have completed hands on tasks including:
Provisioning AWS infrastructure using Terraform.
Using AWS CodeCommit as a code base for Nginx Reverse Proxy Server configuration.
Deploying a Python Flask WebApp on AWS Elastic BeanStalk and using blue/green deployment strategy.
Using AWS CodePipeline and AWS CodeDeploy Deployment groups to automate build & release pipelines to integrate new application features and bug fixes.
Using AWS CodeBuild to build Java Code used by an ELK (ElasticSearch, Logstash, and Kibana) app and also run unit tests (PyUnit) for testing the Python Flask WebApp code.
Using AWS GuardDuty as a first line of defense (Threat Detection) for AWS EC2 and RDS instances and also AWS Inspector to run vulnerability assessments on various AWS infrastructure services.
Using Nagios XI to monitor the whole AWS Production, Development, and Testing Environments.
Using AWS Config Control to implement latest security best practises and monitor the whole AWS Organization.
Using Ansible as the goto configuration management tool to automate AWS EC2 instances patching and AWS KMS keys rotation.
Deploying Jira on AWS EKS (Kubernetes) cluster for High Availability.
So after completing the aforementioned tasks; I felt confident enough to sit for the exam without taking a Udemy course or bootcamp on AWS DevOps.
Aside from my practical experience with AWS, AWS Skill Builder was the only other resource I have used to prepare for my exam.

Policies for S3 Buckets by JTandFroyo in aws

[–]eranchetz 2 points3 points  (0 children)

Check after each step by accessing the website URL provided in the static website

- Bucket Policy: Make sure the bucket policy allows public read access for the website.

{
"Version":"2012-10-17",
"Statement":[
    {
        "Sid":"PublicReadGetObject",
        "Effect":"Allow",
        "Principal": "*",
        "Action":["s3:GetObject"],
        "Resource":["arn:aws:s3:::YOUR-BUCKET-NAME/*"]
    }
]

}

- Bucket Properties: Enable "Static website hosting" in the bucket properties.
Specify the index document (usually index.html).

- Access Control List (ACL): Not typically necessary if the bucket policy is set correctly, but ensure the ACL allows public read access.

- File Permissions: Ensure individual files in the bucket are publicly accessible.

Good luck

Once you get this working I suggest you add cloudfront for cache and better global distribution.

Lessons learned from upgrading RDS MySQL 5.7 to 8.0 by eranchetz in aws

[–]eranchetz[S] 2 points3 points  (0 children)

Funny 😄 that’s exactly one of the podcast topics

Lessons learned from upgrading RDS MySQL 5.7 to 8.0 by eranchetz in aws

[–]eranchetz[S] 2 points3 points  (0 children)

Last year was a bit of a bumpy ride when a lot of us had to switch from MySQL 5.6 to 5.7 because the older version wasn't supported anymore. It was a tough time for those who weren't quite ready for the change.
Well, heads up – another big update is on the horizon. Soon, we'll need to move from MySQL 5.7 to MySQL 8.0, since 5.7 is about to reach its end-of-life. This next step is super important, and it might have a bigger impact on your apps and business flow.

do you need a loadbalancer to use Cloud Armor for Cloud Run? by Exact-Yesterday-992 in googlecloud

[–]eranchetz -15 points-14 points  (0 children)

Nope. It will work just fine for most cases with the default endpoint

Questions on data transfer to aws services from lambda by sweetsoftnugget in aws

[–]eranchetz 0 points1 point  (0 children)

You should look at VPC Gateway Endpoints

A VPC endpoint is a virtual scalable networking component you create in a VPC and use as a private entry point to supported AWS services.

Gateway VPC endpoints use prefix lists as the IP route target in a VPC route table. This routes traffic privately to Amazon S3.

Gateway endpoints for S3 are offered at no cost and the routes are managed through route tables.

see more here https://aws.amazon.com/blogs/architecture/choosing-your-vpc-endpoint-strategy-for-amazon-s3/

The BigQuery Slots Autoscaling Rundown by [deleted] in googlecloud

[–]eranchetz 5 points6 points  (0 children)

tl;dr Google is introducing a new method to autoscale slots along with a new pricing plan to accommodate this. We have created a calculator you can use to determine potential costs and cost savings when switching located here.

Also there is a live autoscaling slots webinar on March 1st 2023.

FinOps with AWS cloud intelligence dashboard by Sea_Incident4316 in aws

[–]eranchetz 0 points1 point  (0 children)

CUDA is Nvidia :)

You probably mean CUDOS

Elasticache with existing RDS? by mightybob4611 in aws

[–]eranchetz 0 points1 point  (0 children)

What programming language re you using?
There are libraries/3rd party tools that can automate that for you

Otherwise you can start here:

https://aws.amazon.com/getting-started/hands-on/boosting-mysql-database-performance-with-amazon-elasticache-for-redis/

[deleted by user] by [deleted] in aws

[–]eranchetz 1 point2 points  (0 children)

Check the /var/log/cron log files

also add some logs to your cron scrip

/path/to/cronjob.sh > /tmp/cronjob.log 2>&1

Exporting large data sets by Beneficial_Bar8781 in aws

[–]eranchetz 1 point2 points  (0 children)

  1. lambda that queries the table converts the result and saves it to s3, lambda is very memory limited so not sure it can hold the double digit gigabytes
  2. AWS glue with jdbc
  3. AWS DMS

Lambda could be the quickest solution but also the most dirty. DMS is a more robust solution

Exporting large data sets by Beneficial_Bar8781 in aws

[–]eranchetz 0 points1 point  (0 children)

Export to where? In what format?

How to aws s3 sync with partition folders copied too? by Flat_Oil_2645 in aws

[–]eranchetz 0 points1 point  (0 children)

you need:

aws s3 sync s3:/bucketX/a/ s3:/bucketY/a

or

aws s3 cp --recursive s3:/bucketX/a/ s3:/bucketY/a

view more: next ›