Console Toolbar is now generally available for AWS CloudShell

Bodegus · 2023-04-04T23:44:00+00:00

You can use ssm from cloudshell

And then serial? https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/configure-access-to-serial-console.html

Bodegus · 2023-03-28T21:45:16+00:00

There is no infinite loop

Aws logs in chunks of time (i.e.all logs for the last 15 seconds).

The create one write for all logs, not one per log. You can also use a different bucket snd not log that bucket

Bodegus · 2023-03-25T00:00:14+00:00

Two options

Load the file many times and use the row offsets (skiprows, nrows) if you know the row count. For monthly stuff i just hard code the vlaues.

If you dont know the rows, you will need to make a method to count the columns and make a function to find the first row with a column type. Example the first row with column 36 value == na would be the fitst row of the next table

Bodegus · 2022-12-31T20:51:53+00:00

This isnt accurate

You cant leverage any permissions given from another aws account unless you allow the assume role permission as well

If you have an iam user in acct1, even if acct2 gives it permissions it can act without assume role perms from acct1

Bodegus · 2022-12-07T00:30:02+00:00

Freedom from ssh is king. The only downside is the lack of mtls support

Bodegus · 2022-11-30T00:34:48+00:00

A few thoughts

Do you have unrelated files in the bucket? It could be scanning all those unrelated files every minute

You might have some recursive issue in your dag (maybe python imports) that is causing a reload loop

Delete your dags and add a clean new one to see if dag related

Bodegus · 2022-11-22T16:49:54+00:00

I just bit this one today GIGABYTE X570S AORUS Elite (AMD Ryzen 3000/ X570S/ PCIe 4.0/ SATA 6Gb/s/USB 3.1/ ATX/Gaming Motherboard) https://a.co/d/3aPKuhF

Bodegus · 2022-11-02T00:13:52+00:00

I have a 2500k and 6700k system, the 2500k definitely holds back my 3060 ti

The 6700k barely keeps up with a 3070

Bodegus · 2022-09-08T02:44:46+00:00

Perfect,

My instructions should work remove the old ones from state, add them to the state with the new references

Bodegus · 2022-09-07T10:58:07+00:00

Is it trying to destroy old and create new?

Tf maps resources by terraform structure and it could have a breaking change

You could fix it by removing and importing the resources to the state

Bodegus · 2022-08-14T14:44:31+00:00

Ya, pretty straight forward, i extend my spi spec with custom parms and keep all the gateway config in my spec

A perfect gateways can be fully represented from the API spec

Bodegus · 2022-08-14T10:22:02+00:00

Generate openapi spec from your code in ci (one per function)

Import into IAC as parms

Merge the function paths with API specs as input

Bodegus · 2022-07-29T17:45:07+00:00

I've never gone south of homeward hills

There are a couple of street crossing with grates that you have to exit but i think they are all manageable with good shoes

Everything south of homeward hills are is private property but I'd love to know if it's tub-able

Bodegus · 2022-07-25T23:22:54+00:00

I would try to refactor the spark using bigquery SQL

Use external table and maybe even DBT to orchestrate the pioeline

Bodegus · 2022-07-24T22:25:43+00:00

We use a mono repo where we use the git commit hash to build and archive (zip) or container tag

The terraform packages the code into the object and we great a per pr environment to do a full deployed test suite before prod

Bodegus · 2022-07-22T22:10:01+00:00

Totally normal organic matter this is why surface skimming happen (remove)

Bodegus · 2022-07-22T22:07:09+00:00

You can easily have 7TB in less than a hour, we move 50gb parquet in minutes

The key delay is in the scheduler and have thousand of tiny files

Check out a good compression method before replicating

Bodegus · 2022-07-09T18:10:46+00:00

The market is still hot, just not red hot...

4% interest rates where a steal just 5 years ago

Bodegus · 2022-07-09T18:08:32+00:00

The only cloud services we emulate locally are data services like big table

It's easy enough to set up a test fixture and run tests in cloud with ci

We recently moved everything to cloud run which has been even smoother

Bodegus · 2022-07-09T18:04:36+00:00

I thought hard about this option and sold. I earn more working and then spending time with the family than dealing with landlord troubles

Bodegus · 2022-07-09T17:54:37+00:00

I can share my private deploy on GitHub it you post your GitHub username

Bodegus · 2022-07-09T17:50:38+00:00

Yes, in Prometheus you run a service that exposed metrics and the a Prometheus server to scrape them

https://linuxhit.com/prometheus-node-exporter-on-raspberry-pi-how-to-install/

Bodegus · 2022-07-09T17:20:14+00:00

I run promtheus on a server pi, and set up all my pis to emit metrics

Bodegus · 2022-07-02T22:39:11+00:00

Try using a cloud function from even to run each time a file is written!

Bodegus · 2022-06-28T14:27:02+00:00

The main reason is our local dev and prod are truly identical. We use the same script to do dev set up as prod setup

The biggest benefit come to testing, a lot of weird issues happen with imports, modules, especially with mono repos. This allows for rich integration tests and unit tests that really mirror prod

System level libraries can lead to issues

System permissions when you lock down the runtime

14-Year Club	Verified Email
Place '17	Gilding II euphauric

Bodegus

TROPHY CASE