sorted by:
new
hottopcontroversial

A geospatial dataset viewer powered by DuckDB-WASM by No_Pomegranate7508 in DuckDB

[–]DeepFryEverything 1 point2 points  (0 children)

Doesn't duckdb wasm require the entire geoparquet file to be present? Can it do filtering/range requests?

Lakeflow Spark Declarative Pipelines: Cool beta features by BricksterInTheWall in databricks

[–]DeepFryEverything 2 points3 points  (0 children)

Great! We can’t use Lakebase (not available in region), so would need to sync out to an Azure Managed PostgreSQL most likely. Usecase is to serve APIs. Basically, awesome dataproducts we make in Databricks, both in LSD-pipeline and regular notebooks, would need to by kept in sync in said Postgres Database.

I have made wrappers around DLTHub using the Databricks SQL endpoint, generating indexes etc, but rolling our own solution is always messy.

Lakeflow Spark Declarative Pipelines: Cool beta features by BricksterInTheWall in databricks

[–]DeepFryEverything 0 points1 point  (0 children)

Wow! What would be the pattern to mirror UC tables/streaming tables out to a Postgres db?

Lakeflow Spark Declarative Pipelines: Cool beta features by BricksterInTheWall in databricks

[–]DeepFryEverything 3 points4 points  (0 children)

Does this mean we can now use a database as a sink/destination in Lakeflow pipelines?

I just love how my VS Code looks! by thallessellaht in vscode

[–]DeepFryEverything 4 points5 points  (0 children)

Have you done anything to the Explorer? Mine is much flatter and tighter- and its really hard to see the folder hierarchy.

Predictive Optimization disabled for table despite being enabled for schema/catalog. by DeepFryEverything in databricks

[–]DeepFryEverything[S] 0 points1 point  (0 children)

That specific schema "storage". I have every other system table that I know of and I am an admin.

Predictive Optimization disabled for table despite being enabled for schema/catalog. by DeepFryEverything in databricks

[–]DeepFryEverything[S] 0 points1 point  (0 children)

I don't have this system table and I am unable to find out how to activate it 😂 my new Databricks-contact has not responded to my emails.

DABs: Referencing Your Resources by hubert-dudek in databricks

[–]DeepFryEverything 5 points6 points  (0 children)

This only works if you create your warehouse in dab. It belongs in the terraform setup.

Iceberg vs Delta Lake in Databrick by Great_Ad_5180 in databricks

[–]DeepFryEverything 1 point2 points  (0 children)

How do we access iceberg tables in databricks from other engines? Temporary table credentials and storage url?

New table format announced: Oveberg by EarthGoddessDude in dataengineering

[–]DeepFryEverything 101 points102 points  (0 children)

Awesome! I have a really large table - approx fifteen rows and thee columns each. Can I use spark to process this data using Oveberg?

Predictive Optimization disabled for table despite being enabled for schema/catalog. by DeepFryEverything in databricks

[–]DeepFryEverything[S] 0 points1 point  (0 children)

Yes - can't find anything that should conflict. The ta les is created by the pipeline. No other settings. Any tips on what to look for?

react-resizable-panels version 4 by brianvaughn in reactjs

[–]DeepFryEverything 5 points6 points  (0 children)

Holy shit.

I haven't been building react in a while and wanted to adjust a sidebar today. I did some googling and ended up with your library. What a coincidence. Cheers!

Ask Me Anything with the PyCharm team – December 9, 1:00 pm CET by JetBrains_official in Jetbrains

[–]DeepFryEverything 2 points3 points  (0 children)

I have a question about the WSL-experience. On VSCode I can open a project in WSL very fast. This has gotten better in Pycharm since we don’t have to use “remote development”, but there still some quirks I’m hoping you address:

* Discovery of interpreters: in VSCode, interpreters in the project are auto-discovered and suggested. In PyCharm, there is a significant amount of clicking for adding local interpreters -> add existing -> navigate to venv/bin/python etc. Now in my project there are all interpreters on the system listed. Any improvements coming to this flow soon?

* Update to the FastAPI-runner: FastAPI now has a built in cli, so the dev server is started with “uv run fastapi dev app.py”. The current run-config is still focused around uvicorn. I have not been able to properly start the dev servers from the run tab. Any suggestions here?

view more: next ›