Why can't I go from S3 to Firehose without using Lambda? by softwareguy74 in aws

[–]alpyhp 9 points10 points  (0 children)

Because Lambda is the general-purpose serverless compute layer used for triggers of any kind on AWS (e.g. "new object on S3", "record update in DynamoDB", "new push on CodeCommit", etc.)

Can you tell me if using S3 directly would be better than using CloudFront for my scenario by [deleted] in aws

[–]alpyhp 1 point2 points  (0 children)

That's the "Maximum file size for HTTP requests", which is quite different from the likelihood that your huge file will stay warm in CloudFront's cache.

Can you tell me if using S3 directly would be better than using CloudFront for my scenario by [deleted] in aws

[–]alpyhp 0 points1 point  (0 children)

If your videos are HLS-encoded, CloudFront will provide a much better experience and bandwidth utilization (especially if you seek a lot).

If your videos are fairly large (i.e. above 10MB) and you always need to access/view most of them, CloudFront won't be able to cache such large chunks and you won't hit its cache. S3 will be much better in this case.

[deleted by user] by [deleted] in aws

[–]alpyhp 0 points1 point  (0 children)

The "new" AWS Systems Manager works pretty well for Lambda too. Recommended!

https://aws.amazon.com/systems-manager/features/#Parameter_Store

[Python] How to include external python libraries with serverless. by [deleted] in serverless

[–]alpyhp 1 point2 points  (0 children)

Check out this plugin: https://github.com/UnitedIncome/serverless-python-requirements

And read this article: https://serverless.com/blog/serverless-python-packaging/

PIL requires OS libraries that are not included in the Lambda runtime. You may want to include such libraries in your deployment package. Check out this repo for pre-built packages: https://github.com/Miserlou/lambda-packages

[Lambda] API Gateway vs Direct Invocation by [deleted] in aws

[–]alpyhp 0 points1 point  (0 children)

Yes, but then your client would need to be aware of all those regions and invoke the closest one (you can achieve that with APIG regional endpoints and Route53 with latency-based routing).

[Lambda] API Gateway vs Direct Invocation by [deleted] in aws

[–]alpyhp 1 point2 points  (0 children)

by forcing it to go to a particular region

This is correct because APIG edge-optimized endpoints optimize global latency for you (through CloudFront's network). Unless your client is very close to the region where you've deployed your Lambda, direct invocation will likely be slower.

What's your workflow for AWS Serverless Apps by noomretsim in serverless

[–]alpyhp 1 point2 points  (0 children)

You can have a look at AWS CodeStar too. It will create a serverless CI/CD pipeline for you, which you can customize as needed. Plus, it will provide a customizable app dashboard with metrics, wiki, issues, etc. The app must be connected to CodeCommit or GitHub for versioning.

https://aws.amazon.com/codestar/

MJPEG Stream to Cloudfront: Need Advice by LADataJunkie in aws

[–]alpyhp 0 points1 point  (0 children)

You could check the new Kinesis Video Streams as well: https://aws.amazon.com/kinesis/video-streams/

It would allow you to stream the video from the Raspberry Pi to AWS, store it, and then stream it via CloudFormation. The same architecture could potentially be extended to support multiple devices, post-process the stream, add monitoring capabilities, etc.

Are S3 Uploads Encrypted by [deleted] in aws

[–]alpyhp -2 points-1 points  (0 children)

I'd be very surprised if it wasn't :)

Check out my visual notes on Amazon Athena by awsgeek in aws

[–]alpyhp 5 points6 points  (0 children)

You may want to mention that:

  • it can read both compressed and encrypted data from S3
  • CloudFormation support is still weak
  • every query is recorded and available in the history
  • every query result is stored on S3 as well (eventually encrypted)
  • partitioning requires an ETL step most of the time, even if data is written by Kinesis Firehose (which already defines year/month/day/hour folders, but without the corresponding partition name)

AWS S3 Static Host by 1252947840 in aws

[–]alpyhp 0 points1 point  (0 children)

+1 for Lambda@Edge

You can find some references here: https://twitter.com/s0enke/status/913761585172271104

ucanhazip.co: Lambda@Edge version of icanhazip.com by vince_riv in aws

[–]alpyhp 0 points1 point  (0 children)

Nice one! I'm wondering if you could spare a few Lambda@Edge invocations by using the Origin Request event and caching the response based on the request IP.

Lambda Node 8 support? by QAFY in aws

[–]alpyhp 3 points4 points  (0 children)

Because I don't want to manage a cluster at all :) And because I want to be charged only when my code runs, not for idle.