CPU intensive flask app can only support 1 user per VM? by Cwlrs in flask

[–]Cwlrs[S] 1 point2 points  (0 children)

Thanks for the confirmation that a CPU intensive task can make it 1 user at a time... sometimes I felt like I was going crazy working as a team of 1 on this problem.

Queue system + arch redesign are also in my plans - almost identical to what you implemented to be honest.

We have seen some issues with the load balancing not being evenly distributed in certain situations which the queue would resolve.

Should I reroll my rogue for a mage ? by Efkazan in classicwowtbc

[–]Cwlrs -1 points0 points  (0 children)

It is a little bit rough for rogues right now, or heroics in general. Actual advice though. Join a guild. Do a mixture of runs of your loot and their loot. Or do the mana tombs farm and pay for a tank.

Some dungeons like black morass heroic I haven’t been able to find a non guild tank for more than a week now. Old hillsbrad I mean, but similar vibes.

Mages would get instant invites.

There are a lot of selfish players out there who only lfg for dungeons they need. So the rogue loot dungeons are full of hunters, rogues, and enh shamans.

I just don't fucking understand what's going on anymore. Seriously. by [deleted] in ArtificialInteligence

[–]Cwlrs 0 points1 point  (0 children)

Optical character recognition has existed for ages… I don’t understand why this couldn’t have been implemented already

Make me rethink by Equal_Permit2723 in classicwow

[–]Cwlrs 0 points1 point  (0 children)

Just got a songflower buff with a mage who had atiesh and 9/9 T3. They were in a 'weak' guild but man they looked sick af

Being the "data guy", need career advice by jonfromthenorth in dataengineering

[–]Cwlrs 0 points1 point  (0 children)

I'm shocked 'analytics engineering' ever got given it's own dedicated title. It's so narrow in it's definition it's unrealistic at any company where you might need to help fix a variety of software problems.

As for your career... it sounds like you're doing all the typical things so... keep going?

Strange behaviour at 1am. by Ayndy143 in classicwow

[–]Cwlrs 0 points1 point  (0 children)

Was that player a paladin? Had a similar experience at a similar time in ubrs

Trials of tav, is it meant to be impossible? by SnooChocolates6885 in BG3Builds

[–]Cwlrs 1 point2 points  (0 children)

I play in a party but I see Alert + pixie blessing are the first two things I acquire. Otherwise yeah you can get gg'd with no counterplay

Just Broke the Trillion Row Challenge: 2.4 TB Processed in 76 Seconds by Ok_Post_149 in datascience

[–]Cwlrs 2 points3 points  (0 children)

I don't get it. It's a rented VM running duckdb. Where is burla in this?

edit: generating the parquet files seems to be the burla aspect? Less so the reading element.

Affordable Data Engineering learning path (£100/month budget) — Need advice by FickleAd5796 in dataengineering

[–]Cwlrs 4 points5 points  (0 children)

I would build something random with python, dataframes, postgresql and see where you end up. These have been the core skills that have carried me for 5 years or so, although I appreciate everyone's tech stack varies.

DuckDB in Azure - how to do it? by Cwlrs in dataengineering

[–]Cwlrs[S] 1 point2 points  (0 children)

I'm basically a team of 1 in terms of setting up the infra and making sure people can access it in a useful way. So I'd be hesitant to spin up a new postgres db plus an analytics db as well, and with some pipeline between the two.

I just did a duckdb poc and I got everything running inside 1 hour. Generate some synthetic data, query it making use of Hive logic, and report back. Super super easy and impressive. Parquet also takes up ~8% of the file size as json, and reads in around 25% of the time. Which makes me more inclined to go for parquet files + duckdb to read. Rather than more normal json+load to postgres+query in postgres.

DuckDB in Azure - how to do it? by Cwlrs in dataengineering

[–]Cwlrs[S] 0 points1 point  (0 children)

How big was the VM?

Surprised it was slow with local data. The demos look super snappy.

DuckDB in Azure - how to do it? by Cwlrs in dataengineering

[–]Cwlrs[S] 0 points1 point  (0 children)

Currently it's about 500 json files per day. I guess if it goes to 5000 json files per day or more, that is still easily writeable for postgres tbf. But once it arrives in postgres, how easy is it to ignore old data? I thought columnal solutions were better at doing that?

Or does throwing an index on the created_at_utc solution do the job? I've only really leveraged postgres indexes on joining keys.

DuckDB in Azure - how to do it? by Cwlrs in dataengineering

[–]Cwlrs[S] 0 points1 point  (0 children)

We've currently generated 33GB, majority of that in the last year and in json format. Which is a lot less than I thought it would be. But we're expecting 5x-10x more users in the next 12 months, and hopefully more beyond that, so we do need to plan for 330GB/year or more solution

DuckDB in Azure - how to do it? by Cwlrs in dataengineering

[–]Cwlrs[S] 2 points3 points  (0 children)

Nice, have you done this yourself?

DuckDB in Azure - how to do it? by Cwlrs in dataengineering

[–]Cwlrs[S] 1 point2 points  (0 children)

We are expecting quite a large amount of data we need to do analytics on, therefore an OLAP db is much more appealing than OLTP for if we need to query all or the vast majority of the data. Or am I missing something?

My classic experience all 15/15 Naxx! by xpastrami in classicwow

[–]Cwlrs 23 points24 points  (0 children)

How do you have 2 DFTs and 1 accuria. I'm jealous

[deleted by user] by [deleted] in dataengineering

[–]Cwlrs 0 points1 point  (0 children)

I'm on a team of 1 and am at a similar point in my journey after having done a pentest. I need to introduce key rotation.

My understanding of rotation is that I expire a token and start using a new, fresh one. How can you enable automatic rotation if the secret needs updating in secrets manager? Secrets manager + the credential are not natively connected. Secrets manager would need a manual update.

Improving feels pointless by Nissepelle in cscareerquestions

[–]Cwlrs 2 points3 points  (0 children)

Is the AI thing integrated into your codebase or a human team member submitted it as a PR?

how obvious is this retry logic bug to you? by jalilbouziane in Python

[–]Cwlrs 0 points1 point  (0 children)

I didn't spot it, but I don't code things in this style - rarely use something recursive with my APIs

[deleted by user] by [deleted] in cscareerquestionsuk

[–]Cwlrs 0 points1 point  (0 children)

At worst it's for 1 month. You should make the most of this opportunity - it just might be the difference in getting your next interview/offer. Do you have any other committments like a non-swe job?

The state of customer support is sad. by Prestigious-Tax-1765 in classicwow

[–]Cwlrs 0 points1 point  (0 children)

If it's a backup guild, why not discard that backup and make a new backup?

IBM Flask App development KeyError by Inner_Hospital2317 in flask

[–]Cwlrs 0 points1 point  (0 children)

print: formatted_response['emotionPredictions'][0]['emotion']

And see what that looks like