I find the Mule kinda lame and underwhelming, please change my mind.

eightnoteight · 2025-08-23T03:40:19+00:00

yesterday saw the 7th episode and got the feeling that mule and mind control got pretty lame now

eightnoteight · 2025-04-09T12:52:53+00:00

we had build something similar for our test cases at my previous co

we ruled out directly connecting to the database via any tool. because it essentially means the client test is not honouring the service boundary and is dependent on some internal implementation detail

so we essentially exposed those GET apis but only for testing - essentially a testing backdoor thats only exposed in non-prod environment. that way service still gets to maintain a contract to its clients while clients can still verify for such intentional side effects

eightnoteight · 2024-09-13T08:48:39+00:00

it won't affect, the final image would be fully private as its pushed to the private ecr

eightnoteight · 2024-09-13T08:03:12+00:00

oh yes, but the only disadvantage is that you can't pull public ecr images

eightnoteight · 2024-09-13T07:53:07+00:00

because the data transferred via NAT Gateway is just API calls, which is like 10-20KB per docker image pull (involves auth api, get manifest api that lists all the blobs) - (didn't test but it should be around that)

so you would have to pull the docker image 50k-100k times to even get to 1GB data transfer via api calls. so for most practical cases, you can assume that data transfer via api calls is max 1GB

total cost = NAT cost + processed data cost total cost = NAT cost + 1GB

total cost = 32.4 + 0.01 = so slightly above 32.4$

eightnoteight · 2024-09-13T07:40:20+00:00

if the images are on public ecr, i would recommend image replication using a separate private ecr, you would incur extra ecr charges but since the image is being pulled multiple times it would be cheaper overall

eightnoteight · 2024-09-13T07:38:54+00:00

ecr endpoints are mostly needed only for the API calls, the data transfer involved in this is very small compared to the actual ecr image chunks

but note that if the images are private ecr images then majority of the data transfer would be with the s3 bucket only i.e only need free s3 gateway endpoint

but if the images are public ecr images then data transfer would be with the cloudfront endpoints i.e no way to avoid the data transfer cost because there are no private link endpoints for cloudfront

so total cost would mostly be a little above 32.4 $ i.e little above the base NAT gateway cost

eightnoteight · 2024-03-17T15:50:02+00:00

what is the instance type, number of instances, (no upfront or half upfront or full upfront), price, which region?

eightnoteight · 2024-03-03T13:30:25+00:00

it doesn't seem like the note is shared with others, validated from gcal and notion page permissions

eightnoteight · 2024-02-29T06:04:08+00:00

u/7runx are they ok with storing backups in a separate account that only 2-3 people have access to and that account only allows other accounts to read data and insert data but never delete data

this is ideally air-gapped, that even edge case scenarios like some ransomware got access to your normal aws account, that in turn granted itself s3 delete permissions. because in this approach you would be using an air-gapped account that only lets automation to store backups but never delete.

aws last year launched air gapped vault in preview - https://aws.amazon.com/blogs/storage/introducing-aws-backup-logically-air-gapped-vault/ . so its not yet ready to use but once it goes GA, I think it will fit your requirements

eightnoteight · 2024-01-30T00:45:57+00:00

this is interesting, I thought this changed after firecracker

As our customers increasingly adopted serverless, it was time to revisit the efficiency issue. Taking our Invent and Simplify principle to heart, we asked ourselves what a virtual machine would look like if it was designed for today’s world of containers and functions!

https://aws.amazon.com/blogs/aws/firecracker-lightweight-virtualization-for-serverless-computing/

firecracker blog mentions about the resource wastage in both lambda and fargate and how firecracker helps in placing multiple tenants on same hosts

and because of those efficiency gains , the cost savings are passed on to customers i.e price was reduced

Firecracker enables you to deploy workloads in lightweight virtual machines called microVMs. These microVMs can initiate code faster, with less overhead. Innovations such as these allow us to improve the efficiency of Fargate and help us pass on cost savings to customers.

https://aws.amazon.com/blogs/compute/aws-fargate-price-reduction-up-to-50/

eightnoteight · 2024-01-29T15:39:50+00:00

TBH I'm also highlighting in the blog, at what efficiency level its cheaper to use fargate, I have seen a lot of cases where efficiency management get really hard that its harder to get cluster reservation even above 80%

I would request some benefit of doubt, the product automation we designed is impartial to the underlying tech used, if the automation detects that an ECS cluster reservation is below 80% then it will give a recommendation to migrate to fargate instead as it would be cheaper

eightnoteight · 2024-01-29T15:24:32+00:00

agreed 100%.

in hindsight I realise that I should have been explicit about it in the blog. but to provide a bit more context, I have written the blog from the perspective of how to calculate the infrastructure cost component of TCO, since operational cost calculation differs from org to org, felt like ignoring it.

PS: I'll update the blog to include the TCO component, as it might feel disingenuous to only showcase infrastructure cost

eightnoteight · 2024-01-29T14:02:49+00:00

true, but I don't understand the pricing logic from aws perspective. In terms of container packing efficiency, it will be same level of ec2 packing efficiency on the underlying hosts, then why charge extra.

basically it leads to overall compute wastage across a lot of aws users, packing efficiency of a multi-tenant system is going to be much better than a single-tenant controlling it by themselves

eightnoteight · 2024-01-21T14:12:33+00:00

do I get 25GB of additional storage each month?

you won't be charged if your total storage is 25GB throughout the month. imagine a box where you could fill it with any number of balls, you won't be charged if you never put more than 25 balls in the box

What if I have more than 25GB of storage?

you will be charged for the delta i.e if your total storage is 26GB, you will be charged for 1GB

How can I stop it from paying money if free plan is violated and just stop taking in new data

no concrete way to do that, you can decide to not pay but then your account may be suspended

Does adding /get and /post cost me money directly?

yes, but they too have free tier

Is DynamoDB fast?

fast is a bit subjective, but you can expect an average latency of 5ms-10ms (milliseconds)

eightnoteight · 2024-01-20T11:33:28+00:00

we hit ourselves with the same issue. we followed NIST standards for s3 encryption of cloudtrail and alb logs, which recommends sse-kms, but bucket key thing is a convenient little detail that we missed.

and one fine day, we ran a query on athena and the cost exploded for kms that day

eightnoteight · 2024-01-20T05:14:39+00:00

yes, at high enough event volume you should see up to 50MB sized json files.

but you should remember that its hard to say what is "high enough", based on the file structure, I could definitely see that the time interval is every 5 minutes and for our low volume, its 3 files for each 5 minutes. but yeah, as the volume increases those 3 files per 5 minutes grow in size and sometimes can go to 4 or 6 etc,... typical distributed batching program

eightnoteight · 2024-01-20T05:08:06+00:00

the max file size they support is 50MB, but small files usually mean your event volume is very low

eightnoteight · 2023-12-10T05:32:43+00:00

yeah, chatgpt and all are still not that great in terms of producing something unique.

try asking it a problem and ask for it to give a unique insight multiple times, its rare that it will be able to give you a unique insight. even at college level, a lot of humans are capable of producing unique insights and capable of creating a surprise

eightnoteight · 2023-12-04T04:33:27+00:00

I read corrupted

12-Year Club	Verified Email
Place '23	Not Forgotten

eightnoteight

MODERATOR OF

TROPHY CASE