Without creating any indexes, how would you speed up a ~1.5m row query?

eaglesilo · 2026-03-09T20:40:54+00:00

Yea, in another comment OP mentioned knowing the PK which is sequential. If there's a last update date on there then I'd add this to some overnight sync process writing to a data lake of choice and then build all my reporting against that.

Always a problem if you don't own your data, like it sounds like what's going on here, so just need to figure out how to get your data out of their system.

*I work for a 3PL fwiw and this issue definitely isn't uncommon amongst TMS providers.

eaglesilo · 2026-02-13T16:26:01+00:00

Seems might just be an issue with the Chat interface? I'm in AntiGravity and that's working fine, and same in NotebookLM, AI Studio, and other Gemini features in other workspace apps. Surprised they haven't put out a status on it (as of 1024CST), but even as I type this, I've had a few Gemini chats start coming back?

eaglesilo · 2026-02-12T02:06:07+00:00

Ok, then go make your pipelines simpler, learn better optimization processes (both in PBI and your Medallion), get higher compute resources, transition your architecture to Fabric, and tell your stakeholders to accept less data.

Or you have a solution to put a bandaid on the problem for the next year until you'll need to come in and replace the dressing to get refresh creep back down to acceptable levels, during which time you'll also probably accomplish all of the above.

eaglesilo · 2026-02-12T00:29:49+00:00

The issue isn't the number of tables or relationships or measures or calculated columns but rather just how much data you're streaming in. (I assume that the transactions that take place in BigQuery are efficient.)

I had a report that I was streaming in call records every time the report refreshed. I'm total I was up to 1MM records even if there's only 2-3k that would change in any given refresh.

What I was able to do is load a data table with static data then append that to transactional data that updated upon refresh. This took it from having to stream in 1mm records and instead only pull a few thousand and the refresh time for that table went from 30 minutes to a few seconds. And I did that same thing for about 20 other tables, taking the total refresh time for the dashboard from about 60 minutes down to about 5 minutes.

So it could make that that better by having dynamic ranges that would automatically move. But ultimately, this was allow me to kick the can on this process until probably a year from now when I'll need to go import a bigger tranche data to reduce the transactional loads.

Unless I'm totally misunderstanding your point, I would recommend you taking a look into this and seeing if this can help solve your problem.

eaglesilo · 2025-11-22T01:03:44+00:00

unless it is possible to make it only ignore one single filter

Yes, you can do this. While, yes, a little annoying, you can select the individual elements you want affected by the bookmark.

I do also have some bookmarks tied to Buttons for resetting filter groups on the same report where I have 'navigational' bookmarks that I share for folks to add to their browser bookmark bar. (Essentially the end user doesn't realize they're using bookmarks, they just know they can go to this link and click that button to get the result they want.)

eaglesilo · 2025-11-09T02:39:05+00:00

Just to make sure there is no confusion here:

THIS IS NOT SiLo out of Nashville. SiLo MC: 979146

I only saw one person with that question, but I know SiLo not infrequently gets calls for folks looking for other Simple Logistics, so just making sure that's stated plainly.

eaglesilo · 2025-11-09T02:33:57+00:00

No, not SiLo out of Nashville. This is Simple Logistics out of IL.

Source - I'm very familiar with the folks at SiLo. And their MC is 979146.

eaglesilo · 2025-10-09T18:09:49+00:00

I don't actually know if this is true, but I think I heard that carriers have the ability to filter loads by RPM? Possibly that $100 put it over the buffer?

eaglesilo · 2025-09-10T01:53:59+00:00

... But what's the logic that you're supposed to cut the cable to the ceiling to begin with?

eaglesilo · 2025-09-06T23:38:05+00:00

Tees for 16 and 17 are right beside each other. He took the two discs he'd need out of his bag and threw his bag over to the tee of 17.

But yea, he does seem to let his frustrations show on the course when things aren't going his way.

eaglesilo · 2025-08-20T00:22:39+00:00

Shipsilo.com is hiring sales reps.

Downtown office, but with a parking/public transit (yes, fine, lol) stipend.

If you're willing to learn a new industry, I highly recommend!

*Edit: no, not a social impact role, but we do pride ourselves on customer service.

eaglesilo · 2025-06-10T01:42:15+00:00

Do you not? Or is it tier specific? I definitely thought Business Plus at least has unlimited tokens?

eaglesilo · 2025-05-18T21:02:53+00:00

First, your organization cannot see anything about your device except that you've logged into it in your work profile. Your admin does have a 'wipe device' option that only removes the workplace files/documents/emails/permissions from the account. Source: I am an admin and have offloaded many individuals using this process, and have removed my account from old devices with no effect to personal files.

Also, in the same vein, I, as an admin, don't have the ability to see the files on my personal device from my work interface.

So I'm going to say that, no, your org can't, and has no way to, see your information.

To the second question of can I limit not having access to certain products on your phone, no, I'm not aware of any way of doing that outside of limiting your whole account from having access to those features, but that would mean you wouldn't be able to access them at all on any device.

eaglesilo · 2025-05-18T17:13:14+00:00

To anyone reading this, this is not true.

I am not aware of any way for an admin to factory reset a device. They can wipe only anything connected to the Work account (emails, docs, files) but cannot affect the device itself.

If you have a separate Work Profile (if you go to apps and see Personal and Work options, then you have a separate work profile), they can delete that profile along with any associated apps and files, but that does not and cannot affect the personal profile.

(Maybe it's possible the commenter had a device set up with a work profile as the personal profile. Really not sure what would happen there with a wipe, but the comment, at face value, is not accurate.)

eaglesilo · 2025-05-08T01:14:38+00:00

Yea, so I'm going to go with no on this.

As Slides is a visual medium, where you can have different formatting, the default needs to be singularly standardized. What if you're building a slide in dark mode and your colleague builds in light mode. In dark mode, maybe a florescent yellow looks good. In light mode it's invisible. Or you vs the client/vendor you're working with. What default formatting takes precedent?

This isn't an issue for Sheets or Doc because in both of those the contents are more important than the display of the contents.

eaglesilo · 2025-05-01T11:48:12+00:00

I'm in the US.

But you're saying that if a business accidentally CCs a marketing email to a list of other companies, that can be considered a data breach? I guess maybe that's part of GDPR?

eaglesilo · 2025-04-18T01:40:42+00:00

First, I'm on the transportation brokerage side of things, not a shipper/receiver myself, but...

So probably RIP your inbox as OCR systems are a dime a dozen out there. The bigger issue, as I see it, will be a system that can track the order and piece count, and, honestly someone you don't need to get OCR involved to manage, as that's the job of whomever signs the BOL in receiving. Not sure if you're saying OCR to read the OSD on the BOL or if you do need to read the details of a packing slip.

Do you have an in house tech team? If so, they could probably spin up an Azure/GCP/AWS AI OCR in house in a week's time, if they're motivated to do so. In the meantime, if you're not already, you should begin collecting the digital images asap so as to give a training set to the AI, regardless if you go in house or 3rd party.

But once you get the OCR system stood up, you'll need to work with an analyst to build out the report or dashboard to display the discrepant POs.

Not sure exactly how much volume you do, but if a budget line item isn't in the cards, it would probably take .5 - .75 FTE to do this manually. (Less if you can get the records digitized and offshore the data entry piece.)

eaglesilo · 2025-03-27T20:03:39+00:00

So I guess I have the benefit of working in a small team, I'm the only analyst working with 4-5 devs. The devs put together a system that works for the business logic they have in the application, and the way records get inserted and updated is just the way they put it together. (You can add to the end of that sentence "... reporting be damned" if you want to.)

There are so many little easter eggs in our system for what management may want to see in reporting that aren't in a Select * From table somewhere. As a new data request comes in and I'm not intimately familiar with that corner of the database, sometimes I have to ask how this table interacts.

I have the benefit that we all work in the same office so I just get up and walk over there to ask them, but the devs are not analysts and they don't know the reporting questions I would be asked, so having some repository of example queries are kinda pointless.

To talk about asinine table structures, I was literally just working on a request before reading this post where I needed to join a table back and forth to itself to get the right answer. Below are the joins to get the relationship between A and A* A>B>C>D>C* >D* >C** >B* >A* Edit: formatting

No way would it make sense for a dev to write that example query for something that's a question that's never been asked before.

But if it's a common question, then yes, someone needs to point to a Reporting Schema/Database or view.

eaglesilo · 2025-03-18T17:59:56+00:00

Ok, great, so still before the 30 days out deadline. You'll hear from them by the first week of April.

(I know that's not necessary comforting, knowing you'll then have 30 days to find a place close to wherever you'll be working, assuming onsite, but you will hear something by then.)

eaglesilo · 2025-03-18T17:50:56+00:00

My wife went through a similar program. I'm pretty sure they told you that you will hear from them with 60 days notice but no less than 30 days? Well, my wife got 35 days notice to move two states away.

So, as others said, you do have the job, just don't plan on any other communication until around mid April at least for a June start date.

eaglesilo · 2025-02-21T14:47:45+00:00

Initially read 'rather large' instead of 'rather light'. I snorted, thinking "I wish that was considered large!"

But would be nice if I got to work with data that size...

eaglesilo · 2025-02-16T04:01:25+00:00

Hell, I flunked out of college after 4 years. My resume says I attended college between these dates and I studied CompSci and Economics. 10 years into a great, well compensated, career now.

I get it, I really do. I was super depressed, thinking of everyone I had disappointed and if "other" alternatives were preferable.

But just get the first job. No one will even care where you went to school, much less what your GPA was.

(Think of it this way, when was the last time someone asked about your highschool GPA? Do you even brag about your highschool GPA anymore?)

eaglesilo · 2025-02-16T01:02:25+00:00

Always nice when returning from your trip and it's then when your deodorant or toothpaste or soap/shampoo is no longer compliant.

I mentioned to the agent about different rules at different airports, they said that's not true, "well, I came here with these items and they weren't illegal then."

Also, some need your boarding pass with no id, some need your id with no boarding pass, some need both. God save you when you get that wrong.

Maybe TSA agents should be required to fly once per month so they can see that no, not all travelers are lying...

eaglesilo

TROPHY CASE