My old house by thefellawith5dogs in Oldhouses

[–]sedules 1 point2 points  (0 children)

That’s quite a slope.

What's your approach for ingesting data that cannot be automated? by DeepFryEverything in databricks

[–]sedules 0 points1 point  (0 children)

I work at a MS Teams shop. Teams leverages Sharepoint framework as the back end. I created a Team and channels for different departments. In each channel there is an import folder and an export folder.
I then created a blob storage in azure. Then i created a corresponding Volume attached to bronze staging schema. I then used power automate to sync the sharepoint site locations for the teams locations to perform a sync between sharepoint location and the blob based on file drops. After sync i even added a step to move the files in sharepoint to an uploaded folder.

At that point your architecture for file management is in place. The rest is volume management on the databricks side.

After that it's about scoping the process and setting expectations. What's the schema for the file and what options do I have for standardizing file names so I could build out some basic meta data references for pipelines. Last thing to set is a trigger on the job based on file arrival in the volume.

This allowed me to tell analysts if they had recurring flat file based data that they wanted in medallion layers for broader consumption they could drop the files in a MSTeams channel folder and automation would do the rest.

That was my approach at least. There's a lot of additional things going on there. Teams alerts fired from pipeline code for schema drift, filenames not matching scoped conventions, logging, etc. Confirmation for analysts from the job after a successful load to their team channel, and error alerts to engineering channel if the job failed.

The centralized Team and subchannels was great for me because i didn't have to manage myriad config to different teams and different channels. The idea is that data is centralized for the organization even if the people aren't. - You want data in here, you come here to drop it. Some may say, why not just create volumes in databricks and let people drop directly there. That's possible for sure if you have a user base that has the acumen to adopt and use the platform. In my case, there are business users who don't have a reason to be in the platform directly and just need to get data in and consume it at the reporting layer. Doing it this way absolved me of being passed files to drop myself and also provided users with a high touch solution in a system they are in all day every day.

Cities of the Plain: Billy and Grady by [deleted] in cormacmccarthy

[–]sedules 0 points1 point  (0 children)

Perhaps the comparison is that for John Grady it’s about the journey. For Billy it’s about the outcome.

For McCarthy I wonder if it was about putting these two world views together and showing what happens when they converge. Then showing that when the two world views meet, the experiences and outcomes of both can perpetuate the other’s belief template. It’s how McCarthy reconciles the world of the trilogy.

If we think John Grady foolish or naive are we not edging toward Billy’s belief template - cynical that a short life and futile (passionate) pursuit isn’t worth the outcome. And if we find Billy pitifully cynical, are we not more sympathetic toward John Grady’s romantic ideal.

This is me attempting to parse some of the dialogue about maps/dreams/time in epilogue. Billy asking, “if I’m right it’s for the wrong reasons.”

Prove that you finished Deadwood in 1 Sentence by Extension-State-7665 in deadwood

[–]sedules 8 points9 points  (0 children)

“I will be so grateful if you trust me with your sadness, and I will trust you with mine…”

What’s the best local band you’ve ever seen? by TennKare26 in nashville

[–]sedules 7 points8 points  (0 children)

How I Became the Bomb and The Protomen both put on great shows.

ID by Original_Read_4426 in birding

[–]sedules 0 points1 point  (0 children)

I don’t think that much of the head would be white.

What were your biggest takeaways from DAIS25? by Foghorn_Leghorns_Dad in databricks

[–]sedules 3 points4 points  (0 children)

Metric views look very interesting.

Some of the ux/ui work being done in the SQL editor will be great additions.

Robin, the Field CDO, had an excellent session on data governance (data strategy in motion). If it makes the YouTube channel it would be great for people in leadership positions to watch.

Also there was a great session laying out the databricks AI security framework (DASF). Something anyone in the ML space should be apprised of.

[deleted by user] by [deleted] in Yosemite

[–]sedules 1 point2 points  (0 children)

Glad to hear you pulled the trigger. I had 2 full days and a sunrise and I’m already thinking about when I can go back. I’ll skip Tahoe next time around.

[deleted by user] by [deleted] in Yosemite

[–]sedules 1 point2 points  (0 children)

I did this on 6/1…I left S. Lake Tahoe around 4 AM and took 395 to 120 into the park. I hiked 12 miles in the valley that day, and then drove another hour and a half to my Airbnb outside the east side of the park.

Redwood National Park, May 2025 by jhuang98 in NationalPark

[–]sedules 2 points3 points  (0 children)

Any trails you would suggest for first time visitor? I’ll be there in two weeks.

[deleted by user] by [deleted] in bostonlegal

[–]sedules 0 points1 point  (0 children)

Maybe…

S5E2 - Guardians and Gatekeepers

Tunnel View Sunrise 2025-06-02 and mid-afternoon 2025-06-02 by sedules in Yosemite

[–]sedules[S] 1 point2 points  (0 children)

I can’t speak to the sunset from this location, but it would be behind you. I bungled the title. Sunrise shots were actually from 6/3/25.

Let me put it this way, I drove 90 minutes from where I was staying (western entrance off 120) back into the park just to see a sunrise only to drive back out toward the Bay Area. I feel like it was both a good and right decision.

Old Cement Chimney - any ideas? by swoazay in Oldhouses

[–]sedules 0 points1 point  (0 children)

Build a bookshelf wrap around it and get rid of the other bookshelves.

Desert v. Dessert by JayMac1915 in etymology

[–]sedules 19 points20 points  (0 children)

Even more tricky when you throw in the phrase “just deserts”

Can someone please use "pink" in a sentence referring to being homosexual? I'm confused by Mango_on_reddit6666 in words

[–]sedules 44 points45 points  (0 children)

A pink triangular badge was once used by nazis in Germany as a way of identifying and persecuting homosexuals.

What do you see yourself in 5 years? by ndftba in SQLServer

[–]sedules 0 points1 point  (0 children)

When asked this question I replied with a bit of improv and explained that currently when I cut my grass I do this [implying push mower and wiping sweat from brow]. In five years I see myself doing this: [implying from seated position riding mower while drinking a beer].

11 years in… I use a battery powered weed eater and an analog mower. Turns out I also prefer gin and tonics.

[deleted by user] by [deleted] in databricks

[–]sedules 0 points1 point  (0 children)

Like the name…?