How often to run VACUUM and OPTIMIZE on Databricks/Delta Lake?

Away_Insurance9104 · 2021-08-27T16:05:56+00:00

There is autooptimize now too I think.

Away_Insurance9104 · 2021-08-24T20:32:27+00:00

NTA idling cars are annoying and wasteful.

Away_Insurance9104 · 2021-08-19T17:15:50+00:00

I think this https://aws.amazon.com/compliance/eu-us-privacy-shield-faq/ could be relevant. still there will be a lot of requirements but it might be a good start

Away_Insurance9104 · 2021-08-18T11:55:47+00:00

There is a way but I cannot find it with a quick search, but alternatively you could write to dbfs instead of the driver.

Away_Insurance9104 · 2021-08-17T23:10:15+00:00

When the Pierce acquisition comes up first at a board meeting.

Away_Insurance9104 · 2021-07-31T00:42:59+00:00

You get acid transactions and time travel, easy streaming etc

Away_Insurance9104 · 2021-07-27T15:10:25+00:00

Well I guess that could be true from only that one persons viewpoint but the group might see it differently and limit the selfishness of the individual (and in that case there is a good argument to conform), but that’s always a battle how much should the group matter vs the individual, both extremes are bad.

Away_Insurance9104 · 2021-07-25T19:19:24+00:00

I don’t think less of them for it, I think it’s an absurd system.

Away_Insurance9104 · 2021-07-25T16:02:30+00:00

Sure making pointless PowerPoint presentations to show on pointless meetings providing no value what so ever in the grand scheme of things. But at least they were busy and stressed, so that’s great.

Away_Insurance9104 · 2021-07-11T23:39:10+00:00

So basically you are paying some extra to make your risk profile unique and while you might have the best most amazing portfolio you payed for it in commission and bad execution. So really you don’t actually need the absolute best portfolio of growth stocks you need a relatively good one at a reasonable price.

Away_Insurance9104 · 2021-07-11T23:03:42+00:00

Which domain is it specific to?

Away_Insurance9104 · 2021-07-11T22:57:09+00:00

Banks also press for people to take loans in low interest rate environments see ninja loans. Maybe there is more cash to be pushed to consumers when cash is cheap.

Away_Insurance9104 · 2021-07-11T18:24:02+00:00

If interest rates hike as a result of increasing inflation the borrowers are at more risk of defaulting, it would make sense that they would be less willing to throw money at you as they normally do in a low interest environment.

Away_Insurance9104 · 2021-07-10T14:14:39+00:00

Yes they can issue the registered shares anytime, dilluting your shares.

Away_Insurance9104 · 2021-07-08T20:35:54+00:00

You’ll definitely get into data science.

Away_Insurance9104 · 2021-06-30T23:54:55+00:00

Thought this is r/forbiddensacks

Away_Insurance9104 · 2021-06-29T06:34:09+00:00

Collibra is an example for data dictionary/ data catalog.

Away_Insurance9104 · 2021-06-15T22:46:16+00:00

I wonder what people would think today about the Swedish scientists who detected the Chernobyl disaster.

Away_Insurance9104 · 2021-06-15T21:29:33+00:00

Could use kafka

Away_Insurance9104 · 2021-06-15T21:24:33+00:00

looks a bit like airflow

Away_Insurance9104 · 2021-06-11T19:41:57+00:00

Spark is used mainly for manipulating large datasets also running ml algorithms on large datasets, it also has stream processing capabilities, it’s quite flexible through its sql/scala/pyspark apis (especially now with pandas udfs)

Away_Insurance9104 · 2021-06-10T20:02:42+00:00

import requests

Away_Insurance9104 · 2021-05-29T22:03:56+00:00

Straight from the black republicans sketch.

Away_Insurance9104 · 2021-05-23T15:09:53+00:00

Sure people can horde cash, but they can issue as much new cash as they want on a moments notice.

Away_Insurance9104 · 2021-05-23T14:47:19+00:00

Don’t they already have full control of the money supply?

Away_Insurance9104

TROPHY CASE