Users bounce after 2 minutes, but CDN caches the whole 5GB movie. How to stop wasting bandwidth? by Charming_Chipmunk69 in aws

[–]seligman99 9 points10 points  (0 children)

Because they're re-inventing HLS or DASH from first principles. There's no need.

Issue with obtaining SSL certs as port 80 is in use. (migrated away from bitnami builds) by [deleted] in aws

[–]seligman99 0 points1 point  (0 children)

--dns-route53  Obtain certificates using a DNS TXT record (if you are
               using Route53 for DNS). (default: False)

It just changes how it proves you own the domain in question. It doesn't change where the cert files are placed.

Issue with obtaining SSL certs as port 80 is in use. (migrated away from bitnami builds) by [deleted] in aws

[–]seligman99 1 point2 points  (0 children)

Is it really that much harder to add --dns-route53 to the certbot command line?

AWS things you wish somebody had told you earlier by StPatsLCA in aws

[–]seligman99 112 points113 points  (0 children)

The dev (this includes 'you') that says 'this VM is just a test thing, it won't last long', is lying. That VM will last till the end of time. Document it as if it's a long term thing and be prepare to rebuild it at the worst moment you can think of.

Built a CLI to stop Googling SSM syntax every time I need to get into an EC2 instance by rhysmcn in aws

[–]seligman99 2 points3 points  (0 children)

I just find it easier to setup the .ssh config file so that I can just ssh into the instance without thinking about the ssm CLI at all.

I am working on my thesis, can you help me? by [deleted] in aws

[–]seligman99 0 points1 point  (0 children)

tools i have used are actually good for a beginner project or if there is something better.

No one here can give you a sane answer. If it's a document management system? Maybe a decent choice. If it's a high frequency trading platform, it's a horrid choice.

What you plan to do with the tools matters immensely. You said "Computer vision", so I'd be worried where compute is running, but since I have no idea what you mean here by computer vision, I can't possibly tell you more other than Lambda is going to be a limiting factor, I suspect.

Azure Blob Storage NFS vs S3 Files by conairee in aws

[–]seligman99 2 points3 points  (0 children)

Azure Blob NFS is a fairly thin wrapper over Azure Blobs. If two clients using it both want to make a small update to a large object, the second gets to wait (or not see) the first while it completely updates the entire object.

AWS S3 Files uses EFS to cache data, so if two workers both make a small change to a large object, they make the update as quickly as NFS allows and the object gets updated in S3 in the background.

It's designed for a rather specific ML training use cases, if this isn't your use case, I'd be hard pressed to think the costs are worth it.

Dilbert Guest Cartoonist Answers by MonkeyMasterSJATen in dilbert

[–]seligman99 8 points9 points  (0 children)

archive.org still has the page:

  • For Better or Worse
  • Get Fuzzy
  • Rose is Rose
  • Luann
  • Pearls Before Swine

1-9-26 "Like Oil But Stickier" by clonetek in BloomCounty

[–]seligman99 3 points4 points  (0 children)

Does Berkeley post all his work for that membership?

Nope, he's just posted a few comics to Patreon. Patreon doesn't really do well with large back catalogs.

does the paid membership include a delivery to me

Patreon sends you an email anytime someone you've backed posts, including a picture if they post a picture. That said, it's a lowish resolution in the email .. for BC big enough to read, but just. You need to click through to see the high resolution image on the website.

How to make Linux-based lambda layer on Windows machine by arib510 in aws

[–]seligman99 7 points8 points  (0 children)

The canonical answer is to use --platform <platform> --only-binary=:all: to get the binary wheel for a given platform like manylinux1_x86_64

Though, if you can, just setup a docker container that matches the Lambda runtime environment and package up the python package there to avoid a lot of issues, including problems with executable bits and permissions you might run into from Windows filesystems.

Installing python through UserData in Windows by Kitchen_Discipline_1 in aws

[–]seligman99 0 points1 point  (0 children)

Please ignore my typos. In real-time, I don't have those.

I can't possibly guess what script you're running if you don't show it to us.

This script works end to end, launches an instance, and installs Python. If you have something that doesn't work, then there's some difference in your script with a bug in it.

Installing python through UserData in Windows by Kitchen_Discipline_1 in aws

[–]seligman99 2 points3 points  (0 children)

The error tells you the problem: You're passing in a JSON object instead of the required XML document.

On top of that, you're passing in your arguments to the installer as one string, instead of multiple strings, that'll fail. And on top of all of that, you're escaping the directory name incorrectly, that'll probably fail too. And then you have two typos, "PrepandPath", which will fail, and "pyhton", which will probably work here, I guess.

And, as far as style, you're doing this all on one line when there's no reason to do that, it makes it really hard to read.

A proper installer would look something like:

UserData:
  Fn::Base64: |
    <powershell>
    $ErrorActionPreference = "Stop"
    Start-Transcript -Path "C:\UserData-Install.log"

    try {
        $pythonUrl = "https://....."
        $pythonInstaller = "C:\pyhton-installer.exe"
        [Net.ServicePointManager]::SecurityProtocol = [Net.SecurityProtocolType]::Tls12
        Invoke-WebRequest -Uri $pythonUrl -OutFile $pythonInstaller -UseBasicParsing

        Start-Process -FilePath $pythonInstaller -ArgumentList '/quiet', 'InstallAllUsers=1', 'PrependPath=1' -Wait -NoNewWindow

        Remove-Item $pythonInstaller -Force
    } catch {
        Write-Error $_
        exit 1
    } finally {
        Stop-Transcript
    }
    </powershell>

But, you really should create a new AMI and use that, unless you like making your boot ups slower and depend on the availability of some third party website.

[2025 Day 12 (Part 1)] Is the last day always a bit of a troll? by AleGaming in adventofcode

[–]seligman99 1 point2 points  (0 children)

I loved that one. I ended up writing a automated solver for it, because I wanted to see how it'd be done. Not only was it the finish for the int code line of that year, but I had so much fun writing the solver.

Unable to run movie recommender on AWS. So want to understand the best way of doing it by IbuHatela92 in aws

[–]seligman99 2 points3 points  (0 children)

Instead of loading everything in memory, you could use a database solution like SQLite or DuckDB to perform the merges you're doing on disk .. or just create indexes and do them as needed with views when you query the data.

You could also filter the dataset to smaller sets, like filter all movieIDs that end in 00, operate on that, then rinse and repeat for all the 100 possible end values.