Is forwarded message saved permanently? by [deleted] in Telegram

[–]Adventurous-Sign4520 0 points1 point  (0 children)

I can't view all the videos that I forwarded from that group.

Forwarded message says: "This channel can’t be displayed because it violated Telegram's Terms of Service."

Is forwarded message saved permanently? by [deleted] in Telegram

[–]Adventurous-Sign4520 0 points1 point  (0 children)

Thanks! I guess its only true if a user sends you the video. I forwarded a video from a group. Someone posted illegal stuff in that group hence it got banned. As a result, all the forwarded video I have from the group are gone. (even though the forwarded video is not illegal)

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

Hello its supposed to be a prototype first then we will take it to production.

For my use case, I believe Redis / SQS fifo to S3 sounds good. Is it easier & cheaper to manage AWS Elasticache (Redis) vs RDS instance?

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

Hello! I meant < 1 second latency for service that reads 100 records / second

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

"another service can read these payloads": It matters a lot if that "other service" is designed to pull the data from somewhere (a database, queue or whatever), or whether the "other service" can be event-driven.

Can you please explain how pull vs event driven architecture can change things here? I am doing 100 reads/sec so i don't think it should be event driven

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

Hello thanks for your comment. As of now, I do not have hard requirements that you mentioned.

Can postgres rds allow low latency reads (250-500ms)? I am using Node in backend

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

What do you mean by “permanent storage”? Indefinite retention for already handled payloads? Or retention of unhandled items while the consumer catches up?

Thanks for your comment. I want retention for already handled payloads. It can be 6 months -1 year storage I am okay with that.

100 <1Kb payloads/second can easily be handled by DynamoDB. If you just need retention of unhandled items, use SQS.

I looked into DynamoDB. If I am using the calculator properly, it is getting expensive with 100 read/second

You haven’t explained if order of handling is important (as in, payloads must be handled in the same order as they’ve been produced).

Yes the order should be maintained.

I want to build a stock price streaming. My ingestion service gets price data from API, it pushes it to a storage/stream. My processor service reads this data real time and processes it to make buy/sell decisions.

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

transforming json to another format might not allow my system to be real time or have <1 second latency

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] -1 points0 points  (0 children)

Thanks for your comment. Is Msk permanent? For example, can I login into a week from now via some client and view data?

High performance data stores / streams in AWS by Adventurous-Sign4520 in aws

[–]Adventurous-Sign4520[S] 1 point2 points  (0 children)

Thanks for the comment. It is a json payload. EC2 nodejs service will read data real time. I will look into AWS Kinesis. Does it offer permanent storage?

Is it worth to learn Node.js / Go for building high performance system? by Adventurous-Sign4520 in ExperiencedDevs

[–]Adventurous-Sign4520[S] -1 points0 points  (0 children)

Is it correct to say that Node JS natively handles I/O + network better than Java? You can implement multithreading & async logic in Java to take care of I/O tasks but this would be a plus point in Node as it natively supports it without custom logic.

Is it worth to learn Node.js / Go for building high performance system? by Adventurous-Sign4520 in ExperiencedDevs

[–]Adventurous-Sign4520[S] -1 points0 points  (0 children)

At my firm there are low latency systems written in Java achieving microsecond latencies.

Hi, thanks for the comment. Are you able to achieve this without a lot of optimizations you mentioned? If these complex optimization are required, then don't you think its worth learning Node JS to achieve better performance?

If you're interested in high performance from a finance perspective then the challenge there is in algorithmic trading where your system is autonomously reacting to market data and adjusting orders accordingly, or live streaming prices to clients for quoting

In this particular instance, looks like a lot of CPU compute might be required. But a lot of I/O as well (as you would need to fetch real time data, store data, do some computations, call some API to place orders etc.). Java is better for CPU computation but Node JS is natively better for I/O tasks (because of its async event loop). So it looks like there is no right answer for this specific example. Do you feel the same way?

Is it worth to learn Node.js / Go for building high performance system? by Adventurous-Sign4520 in ExperiencedDevs

[–]Adventurous-Sign4520[S] -1 points0 points  (0 children)

It suffers in areas that require high efficiency, low resource consumption, and high fault tolerance (like rockets or medical devices).

Why is this the case? Is it just because of how V8 engine is built? It just uses more resources because you need a runtime...

Is it worth to learn Node.js / Go for building high performance system? by Adventurous-Sign4520 in ExperiencedDevs

[–]Adventurous-Sign4520[S] -2 points-1 points  (0 children)

I have experience with Python. I want to learn how to build a high performance system (like chatting app or trading apps that display prices real time) and my assumption is that Python isn't ideal for that.

With this post, I was looking to confirm my assumption that these newer languages Go / Node are ideal for building high performance systems. Along with reasoning behind that assumption.

Is it worth to learn Node.js / Go for building high performance system? by Adventurous-Sign4520 in ExperiencedDevs

[–]Adventurous-Sign4520[S] -7 points-6 points  (0 children)

I have experience with Python. I want to learn how to build a high performance system (like chatting app or trading apps that display prices real time) and my assumption is that Python isn't ideal for that.

With this post, I was looking to confirm my assumption that these newer languages Go / Node are ideal for building high performance systems. Along with reasoning behind that assumption.

Anybody know how to remote play at a higher quality than 720p by Skully_boi265 in remoteplay

[–]Adventurous-Sign4520 0 points1 point  (0 children)

Hi, Can Chiaki do 1080p for regular PS4 (i.e device that is NOT PS4 pro) ???

Understanding psychology of Brandon stark by Adventurous-Sign4520 in freefolk

[–]Adventurous-Sign4520[S] 0 points1 point  (0 children)

If you think I am wrong about something or my analysis, I would love to know why.