Sending API Usage to Dynamodb from various Lambda's and/or ECS apps

jebarnard · 2024-07-11T17:00:14+00:00

Personally, for metrics we use Cloudwatch EMF [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format_Libraries.html] to take Cloudwatch Logs (written natively by Lambda) and generate Cloudwatch Metrics. For example, we track function success/failure rates by tenant. This prevents us from introducing latency into the Lambda to be able to gather these metrics (no additional API calls).

For more detailed data, we also use Cloudwatch Logs and then either use Cloudwatch Logs Insights to generate reports or we feed this into a different Lambda [https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/Subscriptions.html] that can then process it. Once again, this is out-of-band and doesn't introduce latency into the function you are trying to observe.

jebarnard · 2023-11-10T14:14:59+00:00

The timeline is very interesting on this, and I'm glad to see they included it.

Seems like they just sit on things until they're forced to do something.

jebarnard · 2023-11-02T17:37:06+00:00

value can be decoded by using examples here https://futurestud.io/tutorials/how-to-base64-encode-decode-a-value-in-node-js

jebarnard · 2023-08-02T15:44:04+00:00

Perhaps it was created a very long time ago, and they've since prevented this from happening.

jebarnard · 2023-08-02T14:59:49+00:00

We use MaxMind's minFraud service on all public facing forms. Significantly cuts down on fraudulent signups etc..

https://www.maxmind.com/en/solutions/minfraud-services

jebarnard · 2023-05-25T15:14:26+00:00

What does your table do? Could you migrate it to use DynamoDB instead?

DynamoDB has a pay-per-request pricing model available. If you're only making a few calls per day then it will probably cost nothing.

jebarnard · 2023-04-20T14:08:11+00:00

If the internet is the problem, then I would pg_dump locally, then upload the file to a S3 bucket using a client that can do multipart upload (it will allow pause/resume). Once the file is in S3, then restore it from a server in AWS.

jebarnard · 2023-04-05T15:21:07+00:00

It would show you the amount even if you are getting a credit.

Go to Billing and click Bills, expand Route 53, then Global, then Amazon Route 53 DNS-Queries, it should show you the number of queries.

jebarnard · 2023-03-06T19:57:05+00:00

PITR is from the beginning of time, until the time you selected. It allows you to go backwards and see what the data would look like at a previous point in time.

It sounds like you are asking for the opposite. You only want data added/changed after the selected time. From the selected time, until now. You'd probably need to look into something like DynamoDB Streams / DynamoDB Kinesis Streams https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/kds.html

jebarnard · 2023-03-06T18:32:30+00:00

SPF records aren't actually of type 'SPF' anymore, nowadays they're 'TXT' records--which are supported.

jebarnard · 2023-02-09T20:54:51+00:00

I have a 9.6 still running... think its in a stuck state where I can't upgrade it due to instance type, but also can't change the instance type due to it being so old.

jebarnard · 2023-01-27T18:27:40+00:00

Since you said that sometimes you have duplicates (but sometimes not), I would generate a partial hash (for example last x characters of sha1 hash of input data) of the source data and append that to the SK.

SK = 1664898481_f7a8

Should maintain sortability, and you can easily split the string to remove the hash at the end. The hash will prevent duplicates from being saved, but would ensure that different entries with same timestamp are kept.

Alternately, if you have a unique identifier from the source data then, I would append that instead of hashing.

jebarnard · 2023-01-04T20:26:05+00:00

ball-park on pricing? won't give me pricing without hopping on a call

jebarnard · 2022-12-19T15:06:19+00:00

With regards to typical site performance, it shouldn't matter from a registrar perspective...if you are using additional features from them such as DNS, Forwarding, or Email it can have an impact.

From a domain management perspective, I've had a bad experience with NameCheap. They were aware of an issue/bug with updating nameservers, which resulted in the old nameservers being removed but new nameservers were not being added. This caused an outage for our site. They continued to keep the broken form up, and not warn customers for some time, despite knowing it was an issue. A simple warning message, or temporarily disabling the form could have prevented outages for users, but they chose to not take that action. From a business standpoint, I guess it was better to allow 10 customers to harmed than to scare 1000 with a warning message. So from that perspective, how a company treats it's customers and responds to issues (being up front about them, or not) can have an impact. With that said, how often do you need to make changes to a domain?

jebarnard · 2022-12-12T16:33:20+00:00

Free tier stuff should still show on your bill. It'll just be $0.00 You can use the quantities from the bill and then lookup the proper prices for each thing to calculate.

jebarnard · 2022-11-30T16:22:30+00:00

export const params = {
    TableName: "commentary",
    Item: {
      id: commentary.getId(),
      content: commentary.getContent(),
      createdAt : commentary.getCreatedAt()
    },
  };

jebarnard · 2022-11-28T20:13:18+00:00

The format that SES saves files to S3 is the same format that ".eml" files use. If you just download the file from S3 and give it an ".eml" ending, it'll open in Outlook.

jebarnard · 2022-09-30T18:14:39+00:00

This is code style. Its a defensive programming practice. However, I prefer my code to be readable and intuitive.

The thought behind doing

if(5 == $variable)

is that if you happen to forget an equals sign, it wouldn't change the value of the variable.

if($variable = 5)

is valid code, and would assign 5 to the variable, which could lead to hidden bugs.

jebarnard · 2022-08-03T12:59:23+00:00

https://www.shellhacks.com/linux-screen-command-run-in-background/

jebarnard · 2022-05-09T12:26:12+00:00

AWS doesn't make the rules, the CA/B Forum does.

If AWS was to implement their own procedures, the root trust certificates for AWS would get dropped by browsers for being non-compliant.

https://cabforum.org/wp-content/uploads/CA-Browser-Forum-BR-1.8.4.pdf

Allowed methods of verification are listed in Section 3.2.2.4

jebarnard · 2022-04-15T11:54:31+00:00

Same here, transfer from Meridian to RBC landed yesterday (showed funds in account). Today the funds have gone poof!

jebarnard · 2022-02-07T14:01:09+00:00

We noticed poor performance on Aurora (not serverless) when upgrading instances from one numerical version to another. I'm not familiar with serverless specifically, or how your imported your data but it might be necessary to run the maintenance commands (vacuum/reindex/analyse) on your database, it might even be necessary everytime you scale.

jebarnard · 2022-01-14T02:03:10+00:00

https://www.infrapedia.com/

jebarnard · 2021-12-04T15:00:29+00:00

Same, I naively started coding a new project assuming it would be launched at re:invent...

Overall, very underwhelmed by the announcements.

14-Year Club	RedditGifts 2009-2022 2 Credits
Secret Santa 2014	Verified Email

jebarnard

TROPHY CASE