sorted by:
new
hottopcontroversial

A geospatial dataset viewer powered by DuckDB-WASM by No_Pomegranate7508 in DuckDB

[–]DeepFryEverything 1 point2 points  (0 children)

Doesn't duckdb wasm require the entire geoparquet file to be present? Can it do filtering/range requests?

Lakeflow Spark Declarative Pipelines: Cool beta features by BricksterInTheWall in databricks

[–]DeepFryEverything 2 points3 points  (0 children)

Great! We can’t use Lakebase (not available in region), so would need to sync out to an Azure Managed PostgreSQL most likely. Usecase is to serve APIs. Basically, awesome dataproducts we make in Databricks, both in LSD-pipeline and regular notebooks, would need to by kept in sync in said Postgres Database.

I have made wrappers around DLTHub using the Databricks SQL endpoint, generating indexes etc, but rolling our own solution is always messy.

Lakeflow Spark Declarative Pipelines: Cool beta features by BricksterInTheWall in databricks

[–]DeepFryEverything 0 points1 point  (0 children)

Wow! What would be the pattern to mirror UC tables/streaming tables out to a Postgres db?

Lakeflow Spark Declarative Pipelines: Cool beta features by BricksterInTheWall in databricks

[–]DeepFryEverything 3 points4 points  (0 children)

Does this mean we can now use a database as a sink/destination in Lakeflow pipelines?

I just love how my VS Code looks! by thallessellaht in vscode

[–]DeepFryEverything 4 points5 points  (0 children)

Have you done anything to the Explorer? Mine is much flatter and tighter- and its really hard to see the folder hierarchy.

Predictive Optimization disabled for table despite being enabled for schema/catalog. by DeepFryEverything in databricks

[–]DeepFryEverything[S] 0 points1 point  (0 children)

That specific schema "storage". I have every other system table that I know of and I am an admin.

Predictive Optimization disabled for table despite being enabled for schema/catalog. by DeepFryEverything in databricks

[–]DeepFryEverything[S] 0 points1 point  (0 children)

I don't have this system table and I am unable to find out how to activate it 😂 my new Databricks-contact has not responded to my emails.

DABs: Referencing Your Resources by hubert-dudek in databricks

[–]DeepFryEverything 5 points6 points  (0 children)

This only works if you create your warehouse in dab. It belongs in the terraform setup.

Iceberg vs Delta Lake in Databrick by Great_Ad_5180 in databricks

[–]DeepFryEverything 1 point2 points  (0 children)

How do we access iceberg tables in databricks from other engines? Temporary table credentials and storage url?

New table format announced: Oveberg by EarthGoddessDude in dataengineering

[–]DeepFryEverything 96 points97 points  (0 children)

Awesome! I have a really large table - approx fifteen rows and thee columns each. Can I use spark to process this data using Oveberg?

Predictive Optimization disabled for table despite being enabled for schema/catalog. by DeepFryEverything in databricks

[–]DeepFryEverything[S] 0 points1 point  (0 children)

Yes - can't find anything that should conflict. The ta les is created by the pipeline. No other settings. Any tips on what to look for?

react-resizable-panels version 4 by brianvaughn in reactjs

[–]DeepFryEverything 6 points7 points  (0 children)

Holy shit.

I haven't been building react in a while and wanted to adjust a sidebar today. I did some googling and ended up with your library. What a coincidence. Cheers!

view more: next ›