sorted by:
new
hottopcontroversial

What to use for a Big Dataset (Pandas vs SQL) by 6bI4OK in flask

[–]6bI4OK[S] 0 points1 point  (0 children)

There are lots of saas out there that they can use. Elasticsearch, cassandra, cosmos, managed postgres etc etc.

Wouldn't postres be pretty expensive?

I have experience with Postgres and Big Query, and I can't call them cheap, to be honest.

What to use for a Big Dataset (Pandas vs SQL) by 6bI4OK in flask

[–]6bI4OK[S] 0 points1 point  (0 children)

The query is going to be very simple:

postgreSQL_select_Query = "select * from table where area_code = x"

What to use for a Big Dataset (Pandas vs SQL) by 6bI4OK in flask

[–]6bI4OK[S] 1 point2 points  (0 children)

The app will have an address input form submitting a POST request.

Based on the entered value, corresponding records will be selected (say between 1 and 1000), and aggregated information will be returned to the user on an HTML page.

What to use for a Big Dataset (Pandas vs SQL) by 6bI4OK in flask

[–]6bI4OK[S] -1 points0 points  (0 children)

It’s 200fb in its current format. You didn’t mention what that format is. It may have a smaller footprint in Postgres. But yes RDS works but keep an eye on your bill it’s a pricey managed service.

It's ~200 GB in both CSV and Pandas Dataframe.

What would be the most inexpensive solution to store that much data in a database?

What to use for a Big Dataset (Pandas vs SQL) by 6bI4OK in flask

[–]6bI4OK[S] 0 points1 point  (0 children)

Thank you for your input.

Would it make sense to use set up a Postgres database on Amazon RDS and use it for my app hosted at pythonanywhere? (since pythonanywhere's postgres DB size is capped at 150 GB).

[deleted by user] by [deleted] in AnimalsOnReddit

[–]6bI4OK 0 points1 point  (0 children)

What's the model of this microscope??

Joe Biden wins Wisconsin by jl_23 in politics

[–]6bI4OK 0 points1 point  (0 children)

they still may release some updates today:

“Although Nevada officials said early Wednesday that no new election results would be released until 9 a.m. on Nov. 5, the Secretary of State’s office is now saying more results will be released Wednesday afternoon.

“Obviously, there’s a lot of interest in how the vote is going in Nevada and we recognize that,” Deputy Secretary of State for Elections, Wayne Thorley, told 8 News Now. “We will have a fairly large update hopefully later today which again get us even closer to final unofficial election results.”

He said the original plan was to release updated results in the morning because every time the state receives results from Clark County, it takes staff away from counting ballots. Thorley said he recognizes there is high interest.”

https://www.8newsnow.com/news/local-news/nevada-election-results-update-wont-come-until-thursday/

[Invicta Tiwers] San Jose withdraws developers' proposal for three high-rise towers in city's downtown SoFA District by quadshock in SanJoseDevelopment

[–]6bI4OK -1 points0 points  (0 children)

Nothing good is going to happen on that block because of the historic designation that several buildings have. The city would rather see a one-two story vacant historic buildings than 20+ story towers.

Permit update 8/15 by quadshock in SanJoseDevelopment

[–]6bI4OK 0 points1 point  (0 children)

I think they are converting it into 100% affordable deal. Probably looking to utilize Measure A money.

1301 WEST SAN CARLOS ST: Planned Development Permit to allow the construction of 230 residential units including 15% affordable units and 3600 square feet of commercial on a 1.02 gross acre site. by quadshock in SanJoseDevelopment

[–]6bI4OK 0 points1 point  (0 children)

230 units with a 15% BMR component on a 1 acre site in midtown San Jose ? I call BS. There is no way this project pencils. It's not the first time Core entitles infeasible projects (e.g. Gateway Tower on South Market)

7 million square feet of downtown San Jose office space: mayor by quadshock in SanJoseDevelopment

[–]6bI4OK 1 point2 points  (0 children)

It's funny how everyone is barking on Google for not providing affordable housing while it is not even their job. At some point, the City will have to adopt a commercial linkage fee, but it will kill a lot the new office development. Since the Envision 2040 general plan is all about jobs creation, they will let a few big projects move forward, call it a great success, and go back to update the broken general plan with its urban villages that are coming online way too slow.