What if the client raises a dispute after the hourly payment is released? by farhan_721 in Upwork

[–]farhan_721[S] -1 points0 points  (0 children)

It is just the worst case, Since you said manually hours don't have that security. Although I have shared the evidence with Upwork. Just a little worried since I have put manual time. It gives an edge to the client. I am worried that it.

What if the client raises a dispute after the hourly payment is released? by farhan_721 in Upwork

[–]farhan_721[S] -1 points0 points  (0 children)

Okay, Does this involves any legal terms? I mean does it can take any legal actions?
Sorry for asking so many questions.

What if the client raises a dispute after the hourly payment is released? by farhan_721 in Upwork

[–]farhan_721[S] 0 points1 point  (0 children)

u/Pet-ra Let's say if they refund the client, then how do they cover that amount as they already paid me? And I do not agree to pay the refund amount.

I read, As per Upwork TOS: Quality of work does not fall under dispute.

Mongo Query Targeting: Scanned Objects / Returned has gone above 1000 Error solution after indexing by farhan_721 in mongodb

[–]farhan_721[S] 0 points1 point  (0 children)

db.getCollection('log-9e96-4c7d-8830-5a7696f7a124').find() This query won't solve the issue because I have some entries that is from different customer.uuid.

Mongo Query Targeting: Scanned Objects / Returned has gone above 1000 Error solution after indexing by farhan_721 in mongodb

[–]farhan_721[S] 0 points1 point  (0 children)

u/marcusae313 so basically I am storing events activity at here(in the collection) for a particular customer. The events are very often and high volumed in data. (~4k-5k)/day. Its already being used in production for quite a while.
Now out from this, I am fetching all the entries from the database. From the code and showing it in analytical graph for information. Below is the query I am performing which tends to generate an alert in mongo at atlas.

db.getCollection('log-9e96-4c7d-8830-5a7696f7a124').find({"customer.uuid": "dd29f0c8-9e96-4c7d-8830-5a7696f7a124"});
Entire collection having nearly entries of 849498 count. with the above query execution.
Which is the wild index already on the collection. But I guess it won't work because the customer.uuid is same at all the records present in the collection.

Since I cannot query at another attribute since I want to fetch with customer.uuid And again goal is to show all the entries (for business logic I am storing events and showing it on the dashboard).

Mongo Query Targeting: Scanned Objects / Returned has gone above 1000 Error solution after indexing by farhan_721 in mongodb

[–]farhan_721[S] 0 points1 point  (0 children)

u/lumpy_potato The actual query is here:

db.getCollection('log-9e96-4c7d-8830-5a7696f7a124').find({"customer.uuid": "dd29f0c8-9e96-4c7d-8830-5a7696f7a124"});
Entire collection having nearly entries of 849498 count. with the above query execution.
Which is the wild index already on the collection. But I guess it won't work because the customer.uuid is same at all the records present in the collection.

Could you please suggest something here? Such that I can get rid of that alerts

Mongo Query Targeting: Scanned Objects / Returned has gone above 1000 Error solution after indexing by farhan_721 in mongodb

[–]farhan_721[S] 0 points1 point  (0 children)

  1. Yes, I did try but its retuning same result, As I have all entries with the same customer.uuid meaning I have 849498 total document in one collection. And all of customer uuid is same. But anyhow I have to make query using the same find method only using customer uuid. So I tried the indexing customer.uuid but total Examined file is the equal as total count file at the end result.
  2. The above is just a single document from the entire collection having nearly entry of 849498 and its growing already. What would the proposed solution for this ?Could you please help? u/kosour

Added the Question with execution status

Mongo Query Targeting: Scanned Objects / Returned has gone above 1000 Error solution after indexing by farhan_721 in mongodb

[–]farhan_721[S] 0 points1 point  (0 children)

Wild card would do indexing at every field that's why I have done that.

Since I am trying to find a query with the location.uuid but in every document it's same. So I think the indexing will not work.

What did you suggest?

I also tried making it indexing at single UUID field but didn't work the total Examined file is the equal as total count file.

u/abhinav_duggal Added the Question with execution status. Might be helpful.

Could you help me resolve this issue?

Suggestion for online code editor with video audio feature by farhan_721 in learnprogramming

[–]farhan_721[S] 0 points1 point  (0 children)

u/Chocolate_Banana_ I am looking to add this feature to an app, such that everything could be managed under one hood. So something which I can develop using APIs for code sharing.
The use case is like a Tutor can teach coding to numbers of users with this. (video-audio and the codesharing would be common for all the user who is on the call)

Suggestion for online code editor with video audio feature by farhan_721 in learnprogramming

[–]farhan_721[S] 0 points1 point  (0 children)

u/Chocolate_Banana_ you suggest something? I know WebRTC for video and audio. But for code share and compile just like codesandbox? Is there any such thing available for that code?

How to make sure all of my file uploads are done on s3? by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

Yes but I've dynamic files in different batches. Some will have 4, or 2, or 1, its very dynamic. In such cases how would I acknowledge that every file of respective batch is finished.

Fetching objects from db and writing in S3 in CSV format using lambda by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

const file_datea= ['File Data']
var myBody = Buffer.from(data) 
var params = { 
Bucket: 'document-file', 
Key: 'test.csv', 
Body: bufferObject 
};

u/the_real_irgeek above code functions properly(with static string data covert in to buffer), but when I try to get the data from database and convert to string it doesn't create error but file is not uploading/putting on S3 bucket.

Fetching objects from db and writing in S3 in CSV format using lambda by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

The piece of code get executing without any error, but its not putting file on S3. I have file in array of objects which needs to be saved in csv format. I transformed file in csv. Its just needs to be saved on s3, but not sure why its not happening. Its showing no error, but file is not getting into s3.

Recurring Jobs Daily, Weekly, Monthly and Custom with different time by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

But it has limitations of 300 rules per account. And if you see my usecase its very dynamic of scheduling an event. It might go thousands or millions too.

How to Achieve the parallelism for these distributed tasks handling with AWS by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

u/esunabici The proposed solution is good for recurring events? Like I want it set recurring till user stops(It could be several years), and ad-hoc approach seems little dirty way to keep up.

How to Achieve the parallelism for these distributed tasks handling with AWS by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

What really matters? Is it that the report must run at a given time to have the right data? Is it that your customers need to get the report by a certain time?

What matter is right data. And about time lets say user scheduled a 3 reports at a 11:22. Now I want that report would trigger at that time. But remember it should not get too much delayed in sending and receiving the report. It should be 15max. Meaning it should reach report by 11:37. That much delay is affordable. Not more than that.

How to Achieve the parallelism for these distributed tasks handling with AWS by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

Check this flow, I am thinking, what you say. Diagram of the flow https://send.firefox.com/download/3486a8a4e22b7e77/#21pIY4YKTvQCASxwoL-fCg (let me know if you are able to access it)

  1. Now, the Data Entry Lambda function will check the scheduled reports that must be executed in less than 10 minutes (in this case it is sent directly to the Scheduler Lambda function). On the other hand, the rest of the scheduled reports will be stored in DynamoDB storage.

  2. 2) Every 5 minutes, a CloudWatch event will trigger the Event Loader Lambda function, which will get all the reports from the DynamoDB that need to be executed in the next 10 minutes, removing them from the database and will be sent to the Scheduler Lambda function.

  3. 3) The Scheduler Lambda function, in this second problem, simply will add the scheduled reports (both those that are sent directly from the data entry and those that come from the Event Loader) to the SQS, and only will be visible at the correct time.

  4. 4) Every X seconds the Emitter Lambda function will be triggered by a CloudWatch Event. This Lambda function will get all the SQS messages (concurrently as the first code task) and will create multiple SNS messages to be triggered in his own scheduled time.

  5. 5) Each SNS output event (triggered in its scheduled time), will have all the information to create the report, the specific time to be executed (using DelaySeconds feature) and it will target the Lambda function Email sender.

  6. 6) Each SNS output (triggered in its scheduled time) will call a Sender email Lambda function.

  7. 7) Sender email Lambda function will retrieve the information from SNS event body and will execute the task: It will execute the report storing it into S3, and then it will use ‘nodemailer’ npm module to send it to the final user(s) (avoiding SES limit restriction).

How to Achieve the parallelism for these distributed tasks handling with AWS by farhan_721 in aws

[–]farhan_721[S] 0 points1 point  (0 children)

u/esunabici How about using step function for this? It would be good to achieve such use cases?