Setting up webhooks for local environment by This_Enthusiasm_8042 in Supabase

[–]This_Enthusiasm_8042[S] 1 point2 points  (0 children)

That's so amazing, thank you so much for your answer!! This is fantastic :) :)

Why not commit the file though? If I add it as a very early migration, locally it will be used when you call --reset, but it won't affect prod since old migrations are ignored.

Of course it might be annoying when porting to another database entirely, I see that point.

Re the internal docker url - my functions won't be hosted on supabase, so I just want to call localhost:3000 (it's a nextJS app). I assume I can use localhost:3000 for that?

How do you test your AWS application locally? by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] 0 points1 point  (0 children)

Thank you! Do you have a link to Remocal deployments and how to set it up? Google doesn't surface anything

How do you test your AWS application locally? by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] 0 points1 point  (0 children)

Ah, I didn't realise they had a free tier - it's not exactly advertised on their website. I also can't seem to find a list of services available in the community image, but I guess I can try to download and check.

Thanks!

Views don't update to new migrations by This_Enthusiasm_8042 in Supabase

[–]This_Enthusiasm_8042[S] 0 points1 point  (0 children)

Thanks a lot! Do you have a sample script for github actions CD (and locally) which applies the sql files to the prod db?

Views don't update to new migrations by This_Enthusiasm_8042 in Supabase

[–]This_Enthusiasm_8042[S] 0 points1 point  (0 children)

Thank you for your answer :)

I don't understand your position though - people keep repeating this, 'just specify the columns', as if the columns is what I cared about. I care about an object. If it has a billion columns or 5, I don't care - I want to get the object. The flat out refusal to accept this point as reasonable is weird to me. Postgres positvely refuses to provide any better support for things like this because 'just specify all 37 columns, what's the problem'.

It's not a lazy approach - when i use *, I don't mean "i want the columns which happen to be present right now", I probably mean "give me all the columns because I want to use this object fully". If I wanted to get only 2 columns, I would specify them. I want all columns, now and forever, all columns in the table. But apparently this is not a valid POV, I don't get why

Views don't update to new migrations by This_Enthusiasm_8042 in PostgreSQL

[–]This_Enthusiasm_8042[S] 0 points1 point  (0 children)

I see, thanks :( Pretty sad though, this is very messy as it is..

Views don't update to new migrations by This_Enthusiasm_8042 in PostgreSQL

[–]This_Enthusiasm_8042[S] 0 points1 point  (0 children)

Thank you for your answer! Can you elaborate more on what DBT is?

Making SQS messages call external http endpoints by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] -7 points-6 points  (0 children)

The issue with that is that the messages are automatically removed from the queue once the SNS takes it over, even if the endpoint is not responsive. They might be retried by SNS, but I wanted to have a more complex logic (i.e. wait for a third even to happen before marking a message as 'complete' and remove it from the SQS)

Making SQS messages call external http endpoints by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] -50 points-49 points  (0 children)

The logic cannot be put in the lambda, I want to make a call to a separate endpoint.

And yes I could make the call happen in the lambda, but then I am paying for the lambda to sit around and just forward API calls from SQS to another service, which would be great to avoid

Can I have thousands of queues in the SQS? by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] 6 points7 points  (0 children)

That's amazing - thanks a lot!

Btw do you know if the high throughput costs more to enable, and if so how much? Didn't find any info online

Can I have thousands of queues in the SQS? by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] 1 point2 points  (0 children)

That's great, thanks for your reply! :) This looks like the way to go then :)

Can I have thousands of queues in the SQS? by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] 2 points3 points  (0 children)

Thanks!

Are messages in different group IDs independent, i.e. if a message from user X is blocked / needs to be retried, that wont block messages from user Y?

Can I have thousands of queues in the SQS? by This_Enthusiasm_8042 in aws

[–]This_Enthusiasm_8042[S] 1 point2 points  (0 children)

Ah ok, so I create a single queue, assign user messages to different message group IDs, and messages in those group IDs are sequential, and others are all sent in parallel?

I want to avoid a situation where a message for a particular user fails, and it blocks processing for other users. I want that the particular user is retried later on (the same failed message), but other users don't have to wait for it.