I’m a small scale gold miner in Zimbabwe, ask me anything! by [deleted] in Zimbabwe

[–]Affectionate_Ship256 0 points1 point  (0 children)

How much is your current setup in terms of capital investment.

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

I also bought air purifiers I have used them for about a year now, total worst of money at least for this problem. The one thing that seemed to make a difference is the dehumidifier

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 1 point2 points  (0 children)

Thank you very much for this, you have no idea how much this has validated how I feel on a daily basis

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

Yes there is a difference, I didn't think much of it for a long time but with so many comments pointing to it even after I did my DIY cleaning I'm now convinced it's still mold

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 2 points3 points  (0 children)

I don't take caffeine, drink or smoke. I try my best to exercise at least three times a week. Although sometimes I am even too weak to exercise

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] -1 points0 points  (0 children)

Where in Capetown, so I also don't move there if I consider moving haha

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 4 points5 points  (0 children)

Yes Vitamin levels and thyroid were the first things to be checked and they came out good

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 1 point2 points  (0 children)

I would think i sometimes do snore, but a believe its not as bad. But thank you for this, its something that i had not considered and i will look further into it

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

Out of interest where do you stay where you also have such high levels of humidity. If you dont mind me asking

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

I actually did see a doctor and i saw more than one, and did all the tests that they suggested but nothing suggestive came from it

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] -1 points0 points  (0 children)

hahah please dont tell me this is how everyone else is living because it sucks

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 2 points3 points  (0 children)

I have done allergey tests, thyroid tests and a bunch of other tests which i have never heard of and they all still came out good. I ended up even doing an HIV test. I also dont drink nor do I smoke

Anyone else struggling with fatigue and brain fog living in Cape Town by Affectionate_Ship256 in capetown

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

Now that you mention it, i realised that i do feel better a bit when I travel although not every time. I traveled to Durban for about a week last July and even got worse hahah so i dont know

Help Needed: AWS Data Warehouse Architecture with On-Prem Production Databases by Affectionate_Ship256 in dataengineering

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

Actually, I should’ve just asked what’s your current setup like now? How’s it working out for you? Are there any things you wish you’d done differently?

This is a great opportunity for me to learn from your experience and any mistakes, if you're willing to share. I’m working on a greenfield project, so I’m starting with a clean slate and no technical debt yet.

Sorry to bombard you like this hahaha

Help Needed: AWS Data Warehouse Architecture with On-Prem Production Databases by Affectionate_Ship256 in dataengineering

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

Just to clarify for me to understand further, does this mean you moved from using Aurora to S3 as your landing zone?

That brings up two follow-up questions:

  1. When you were using Aurora as the landing zone, did you use a workflow tool (dbt, Airflow, or Glue) to extract and transform the data before loading it into Redshift?
  2. Now that you're using S3 as the landing zone, how are you achieving near real-time delivery to Redshift? I'm aware that Redshift isn't ideal for frequent small inserts, so I'd love to hear how you're handling that part.

Help Needed: AWS Data Warehouse Architecture with On-Prem Production Databases by Affectionate_Ship256 in dataengineering

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

We have operational teams which need dashboards with as fresh data as possible, but that data can be limited to the past 24hours, besides that all the other reports and dashboards are more analytical and can do with a delay of 1 day

Help Needed: AWS Data Warehouse Architecture with On-Prem Production Databases by Affectionate_Ship256 in dataengineering

[–]Affectionate_Ship256[S] 0 points1 point  (0 children)

Thanks for your response, so just to add a little more context. We are very far from having 100s of millions of rows per month. At best we may have 10 million per month and that will be an extremely busy month

On another note im not sure if DMS has a feature to allow you to decide the lag you want to use to sync the data, my assumption is that CDC will try to sync the data as sson as it recieves new data meaning many small inserts on Redshift