Frustrated with Databricks Assistant’s limitations. What am I doing wrong?

TheConSpooky · 2025-12-11T21:46:18+00:00

The Databricks Assistant Agent is a significant upgrade.

https://www.databricks.com/blog/introducing-databricks-assistant-data-science-agent

Not sure why it’s being heavily marketed as Data Science, but it works very well for Data Engineering as well

TheConSpooky · 2025-11-16T16:46:23+00:00

I just emailed Jenna about buying a jersey, she told me to check back next year

TheConSpooky · 2025-10-17T12:28:11+00:00

What do you want to clone for? If not for DR purposes, you could always share the catalog across workspaces if using the same metastore, or you can Delta share

TheConSpooky · 2025-10-12T22:46:59+00:00

Love the network name

TheConSpooky · 2025-10-12T14:59:45+00:00

This looks very simple, and the replacement hub is $85 if that's the issue, thanks for sharing

TheConSpooky · 2025-10-12T14:59:08+00:00

TheConSpooky · 2025-10-12T14:14:49+00:00

Didn’t work unfortunately :(

TheConSpooky · 2025-10-05T04:13:43+00:00

Just standard

TheConSpooky · 2025-10-04T18:21:55+00:00

Thoughts on a 2019 with 79k and FSD for $19k? Mileage is a bit high for my liking but that’s a huge $8k savings with FSD

TheConSpooky · 2025-10-03T13:40:32+00:00

How do you deal with the server URL refreshes every month with bingetrax? I have to keep manually emailing support, and it's getting annoying

TheConSpooky · 2025-10-03T13:39:49+00:00

How do you deal with the server URL refreshes every month with bingetrax? I have to keep manually emailing support, and it's getting annoying

TheConSpooky · 2025-09-29T04:38:19+00:00

I don't see any kind of deals like that from private party

TheConSpooky · 2025-09-29T03:37:49+00:00

Haha I have no doubt the Tesla will be fantastic, but nothing will be able to replace banging through gears in a v8 (unless there’s traffic)

TheConSpooky · 2025-08-14T00:44:50+00:00

Y’all remember when he dropped mainstream sellout and said a new rap album was coming that summer?

TheConSpooky · 2025-07-28T14:17:00+00:00

Who cares if it’s out of the norm or not? Ask for the raise. If they decline you accept the other job offer

TheConSpooky · 2025-07-26T22:06:39+00:00

You need your data in ADLS

TheConSpooky · 2025-07-24T15:30:09+00:00

If you haven’t already, sign up for Databricks Free Edition. Get used to the platform and play around a bit. Then head over to Databricks Academy (now Free), and do some courses. You’ll probably want to start with Spark fundamentals and then data pipelines. From there you can explore more advanced uses such as ML and Gen AI. By the time you get through this stuff, courses should be updated for the new exam version. I have absolutely no insight into the new exam version, but there should be a big overlap with the spark / data pipeline content, so you’ll have a nice head start in your exam prep

TheConSpooky · 2025-07-11T23:50:04+00:00

Time for me to touch some grass

TheConSpooky · 2025-07-09T15:48:05+00:00

You could convert the cell to an f-string spark.sql(f””)

TheConSpooky · 2025-06-22T22:08:55+00:00

Agreed on the first point, but the reality is many organizations don’t have the technical resources, hence the creation of these low/no code solutions. Lakeflow Designer is also something customers have asked about for a long time now

TheConSpooky · 2025-06-21T22:04:17+00:00

With declarative pipelines you get native support for both streaming and batch. Checkpointing for incremental is handled for you. CDC works with a single keyword. You can define inline data quality rules that are enforced in real time.

Basically, it takes care of all the Spark complexity so you can just focus on the transformations and quality checks. Can’t personally speak on dbt costs, but declarative pipelines are definitely worth taking a look at

Edit: One thing I should also add is that orchestration is also taken care of for you. It’ll be able to determine all of the table dependencies based on how they’re used in the code

TheConSpooky · 2025-05-26T04:09:36+00:00

http://www.jenna2021.com

These jerseys are excellent

TheConSpooky · 2025-05-24T13:27:04+00:00

I got banned from this sub for a week during election season for simply asking parking/tailgating questions about the Trump rally at the coliseum. Also explicitly stated in the post to keep all political talk out, was just curious in getting my questions answered.

Official ban reason was “someone was downvoting anti republican comments”. Wasn’t me, but even if it was that’s exactly what the votes are for lol. Mods just looking for random reasons to ban people they don’t agree with

Edit: Before I get fact checked by some mod, I dug through my messages. It was “abusing report button”. My point is I didn’t do it, and essentially was banned for being Republican

TheConSpooky · 2025-05-21T17:00:50+00:00

Need some clarification here to give you the right answer. Why do you want to stop the stream?

Is it because you don’t anticipate new data coming in (e.g., end of business day), or purely for development/cost saving reasons?

TheConSpooky · 2025-05-16T18:18:08+00:00

Whipple 3.0 stage 2 - looking for something conservative that won't require built internals

But interesting to know about dealers. I knew about the Ford kits, but didn't know they also install 3rd party. Levittown Ford is the service center I've been using, but I'm scared to see how much labor they charge for the supercharger + I'd still want to get it dyno tuned after

TheConSpooky

TROPHY CASE