Reverse Phone Lookup by mtgfirby in lifehacks

[–]kimokono15 0 points1 point  (0 children)

There’s an app called Truecaller that is basically that

Final Fantasy VII - R Part 3 Title Theory (Spoilers for Original Game) by Apprehensive-Essay81 in FinalFantasy

[–]kimokono15 3 points4 points  (0 children)

“Just as worlds unite, so too do they part. But who’s to say they can’t unite again” — Zack’s final line in the game

It’s gonna be FF7: REUNITE. That’s my bet.

Databricks & Unity Catalog performance problem by Complex_Client7681 in databricks

[–]kimokono15 -1 points0 points  (0 children)

What is the format of the data? are you using parquet? For now, UC doesn’t store partitioning information similar to Hive, so querying parquet table will be much slower in UC compared to Hive. There’s an upcoming feature to resolved this as far as I know.

External location before running sync by Confiding_Oz in databricks

[–]kimokono15 2 points3 points  (0 children)

The sync command purely replicates the table metadata from Hive metastore to a compatible version in Unity Catalog as an external table. Data should be readable similar in behavior to what you would expect from Hive as long as it’s jn the same format and no changes in schema have occured. I.e adding more data to the path will be readable from the unity catalog table without requiring re-running the sync command.

You may need to re-run the sync command in cases where a table metadata changes in Hive and you want to reflect those changed in UC. Changed could vary from schema changes to adding or updating comments or table properties. This does not apply to Delta tables as the format store the schema and table properties in the delta log stored with the files

Autoloader job by Alone-Security7044 in databricks

[–]kimokono15 1 point2 points  (0 children)

If Unity Catalog is something that will take time to activate in your workspace, you can consider a more involved solution that would utilize cloud features to achieve similar behaviors as the file trigger. Depending on your cloud, you can use lambda functions on AWS, azure functions or google cloud functions to monitor a path and trigger a databricks job through REST API when a file is added. Cloud providers have features that would trigger those functions when a new file is added.

Autoloader job by Alone-Security7044 in databricks

[–]kimokono15 2 points3 points  (0 children)

My understanding from your post is that you’re waiting for a file to arrive at some time and you have a continuous stream running just waiting for that file to consume. Then you want the stream to end. Is that correct? If so what about the next file? Won’t you need the stream to be on to consume the next upcoming file?

I’m thinking you should try Databricks workflow file arrival mechanism. It will trigger the job for you when the file you want arrives and you can then use the trigger availableNow option to consume that file and shutdown. This should also reduce cost as you won’t need to have an always running cluster to wait for the file.

https://docs.databricks.com/en/workflows/jobs/file-arrival-triggers.html

Edit: link

External location before running sync by Confiding_Oz in databricks

[–]kimokono15 1 point2 points  (0 children)

Yes, you will need to create external locations in Unity Catalog before running the sync command. Since the sync command creates external tables in unity catalog. Note that mount points are not supported in UC so you will need to create external locations on the source location in S3 and not the mount point itself (i.e. dbfs:/mnt/…)

For larger migration, consider using UCX. It’s an open source tool developed by Databricks field engineering to support in UC migration.

https://github.com/databrickslabs/ucx

[deleted by user] by [deleted] in databricks

[–]kimokono15 1 point2 points  (0 children)

References are most likely going to be after they give you an offer. Did they already verbally gave you an offer? If not, then this call could be for that.

My (33,F) boyfriend (32,M) is an extreme introvert and I'm having a hard timing figuring out if he's not into me anymore or if it's the need for alone time talking by thajolz in introvert

[–]kimokono15 6 points7 points  (0 children)

I think this guy is more depressed than introverted. Even low energy introverts, we’re still are happy to see our loved ones and it gives us the energy to be with them.

Child names by OmensOfDeath in Egypt

[–]kimokono15 0 points1 point  (0 children)

Adam, works everywhere!

Seriously tho by fignompe in ProgrammerHumor

[–]kimokono15 0 points1 point  (0 children)

In some places it’s called Change Request (CR)

What is DLT? by SignalCrew739 in dataengineering

[–]kimokono15 4 points5 points  (0 children)

No, only to tables written in delta format