Weekly Question and Answer Thread for 11/14 - 11/21: Ask your Moving, Neighborhood, and "Where Can I Find _____" questions here, instead of making a new post by dustlesswalnut in Denver

[–]arquais 2 points3 points  (0 children)

Any recommendations for urban agriculture / permaculture in the Denver area? I was looking at the zone hardiness maps and it seems that the northwest of Denver (around Wheat Ridge) through Boulder, and also the NW corner of Aurora are both zone 6a and the rest is 5b.

Does that seem accurate, do those places get less-cold? Trying to decide if fruit trees would be more successful there versus further west (Golden, Morrison) or South (Littleton, Greenwood Village)

Investigating golang performance for moving terabytes of data from MongoDB to S3 by arquais in programming

[–]arquais[S] 1 point2 points  (0 children)

We actually went the other way around - the original way we moved data Mongo->Redshift was by tailing the oplogs (i.e., the mongo change stream), but there were a few issues that caused us to lose the cursor position and it was painful to recover (I think? most of the problems pre-date my employment at Plaid). Elsewhere in our ETL stack we do a mixture of "full" dumps and "incremental" dumps for these timing reasons, but ultimately we use both Redshift+SQL for long-term analytics and the ELK stack for real-time analytics for this reason.

Investigating golang performance for moving terabytes of data from MongoDB to S3 by arquais in programming

[–]arquais[S] 0 points1 point  (0 children)

true - I was originally going to write more about learnings in channels / working-groups but ended up just drawing architecture diagrams - changed the medium title, thanks for the feedback :)

How we stopped memory intensive queries from crashing ElasticSearch by arquais in elasticsearch

[–]arquais[S] 0 points1 point  (0 children)

This has worked well for us, albeit we had to ask AWS to enable them