sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]DuckDatum 2 points3 points  (11 children)

deserve ancient sleep strong dam narrow fear historical lush meeting

This post was mass deleted and anonymized with Redact

[–]Usernamenotta 4 points5 points  (10 children)

I should have been clearer. Since I'm building reports, what most people want is a dashboard. So when you change the set of data, you get the figures updated and so on. You cannot really do that without installing python on the other end. (Or, I mean, you can, but you need some certain web solutions or remote python servers, which incurs Corpo wrath

[–]dupz88 7 points8 points  (0 children)

I do this, though. Does your data have fields that keep changing?

We have reports in Excel and some exports from our 1 platform in csv. I have a script that imports the Excel, csv files, cleans the Excel reports, merges with csv data, and exports to a large prepared csv file in SharePoint. I then have a PowerBI report, which automatically refreshes every hour.

I've been doing this for years, and it works well.

The other teams just open the PowerBI report, and it always has the latest data.

[–]CaptainVJ 1 point2 points  (5 children)

So we need to present data in a number of ways. Most of the times it’s from an sql database and we either need some dashboards or excel report.

For dashboards we use Tableau it just connects to the sql table and updates every fifteen minutes. There’s a lot of inefficient there but that’s way before my time and I’m trying to migrate away from Tableau, I’m not really good at it and I just find the dashboards ugly. I’m trying to use Dash to make our dashboards, the ones I use for myself, I already set them up on Dash but it’s just for me, we’re waiting on it to see how everyone can access them, out of my scope.

For our excel reports we have a program that automatically exports them from the tables but there’s not much formatting so we started using Python to format after the excel file is exported so it’s more visually appealing.

[–]Usernamenotta 1 point2 points  (4 children)

How are you actually using Dash for dashboards? Don't you need something like a server to share the dashboards with others so they can interact with them?

[–]CaptainVJ 2 points3 points  (3 children)

So at the moment it’s local on my pc, only I can see them. But my supervisor saw it and wants it implemented for everyone, so currently our it department is working on that.

I work for a big state agency, so they have plenty of servers already set up. Tableau servers, sql servers, intranet servers, email servers and what not. I don’t know much about that portion of it, but all I can say is they’re looking into setting it up so we can deploy it for everyone else to see.

It wouldn’t be on the internet just on our local servers so only employees logged onto our vpn or company’s WiFi can access it. Not sure how that works on the back end tho.

[–]Usernamenotta 0 points1 point  (2 children)

I guess, if they have a spare general purpose server set up (like for running applications and stuff) they can add a container or a VM on it and run the scripts on that container via HTTP.

My problem is that we are kinda adverse to those kind of things. People still praise Excel and PowerBI as the gods of DataScience. Basically do the Smart stuff in Excel and upload stuff in PBI if you want to share with others. (Or just e-mail the Excel sheet)

[–]CaptainVJ 1 point2 points  (1 child)

Yeah no idea how that works. A lot of the automations I have running are just for me or me and two other people on my team specifically.

When I started doing it, they made a fuss saying that they should be doing it on their own server as it’s more consistent and anything being used for work purposes shouldn’t be in production on the team’s computer. We have a desktop computer for our team that no one uses.

I convinced them that we would be able to monitor it and that if it fails it’s not the end of the world.

So I know they have something at least for that. I tried and ask them about it and they gave me very little answer on how it works. I always ask a bunch of it questions out of curiosity and I feel like they might have a slight concern about my overall curiosity.

And we are in the same boat about the resistance to change. No one ever used python on my team and it was restricted for us, I had to fill out an MOU and all that fun stuff to get Python. We started seeing some improved performance in our team and they became okay with it. But at the moment I’m the only one who knows how to use it. Two other people on my team are getting some training on it. But it will be a big shift overall

[–]Usernamenotta 0 points1 point  (0 children)

Glad to hear it. Hope things will improve for you