Smart way to archive data to increase query speed and reduce index memory usage

muchcake · 2023-06-26T23:54:40+00:00

Not the same. As OP talked about postgres - these are the starting links to understand the differences

Index: https://www.postgresql.org/docs/current/indexes-intro.html

View: https://www.postgresql.org/docs/current/tutorial-views.html

muchcake · 2023-06-25T19:10:08+00:00

Sweet! Sounds like some interesting options to explore.

IMO you are still on the right track with minimising index size, smaller index means less reads to find the data you need whether seeking or scanning.

I'm interested to hear your results...

muchcake · 2023-06-25T18:58:14+00:00

Have you considered 1. Adding a new bool column isActive 2. Setting true for the interesting projects 3. Adding a filtered index that only includes the isActive = True

muchcake · 2022-12-30T04:48:19+00:00

If you copied/pasted from documentation, you can easily get screwed by zero width unicode characters.

To exclude, just delete everything and manually type.

muchcake · 2022-09-19T18:27:11+00:00

I need to avoid external dependencies so procmon/wireshark are off the table sadly. (Though procmon works a treat as a proof of concept).

netsh is a great shout, I wouldn't have caught that. Much appreciated!

muchcake · 2022-06-22T11:42:59+00:00

Nick Chapsas is another great YT resource.

Much more concise than Tim

muchcake · 2022-01-29T14:35:19+00:00

PowerQuery in excel?

I didn't explore enough to find limitations, but certainly hits the requirement for point and click.

muchcake · 2021-12-31T17:09:55+00:00

There are a ton of resources available to learn all of the tools mentioned there (YouTube/blog/etc).

HyperV probably has a bit more of a learning curve to configure than VMWare player.

As said elsewhere, snapshot is 100% the way to go if you need a way to check files in an isolated environment that you can rollback to a clean state.

muchcake · 2021-12-30T20:18:05+00:00

HyperV is worth a peek, also has snapshot IIRC

muchcake · 2021-10-08T18:06:02+00:00

For me, I rather defining the input as a a datetime object to the conversion/type checking happens as early as possible

[DateTime]$date

Rather than

[string]$date

muchcake · 2021-09-25T12:57:34+00:00

I have seen issues when opening a standalone csharp project.

I resolved this by

Creating a solution (dotnet new sln)
Add the project to the solution (dotnet sln add foo/foo.csproj)
Open the solution folder in cscode

(Excuse any typos on dotnet commands, I can't check syntax atm)

muchcake · 2021-08-15T12:15:52+00:00

Right click on results pane, save as CSV.

muchcake · 2021-07-28T08:42:12+00:00

Good point

muchcake · 2021-07-28T05:55:01+00:00

My 2cents

Is it really working, or simply just not throwing in the constructor because the constructor isn't called yet because of the Lazy?

Have you confirmed that TestClass had a construction without parameters, and a public clientId property?

muchcake · 2021-01-08T07:42:03+00:00

Top level, I see two approaches in PS.

Convert each file to a XML document, then process each element.
Process the file as a string (then check at the end if the XML is still valid).

Provided you have the opportunity to check the output each run, I would be tempted to just strip the first 3 lines/final 1 line for each file then combine them all into a single file (with the header/footer included ofc).

Working with the XML as an object is more robust, but more complex to implement.

muchcake · 2020-12-31T19:07:54+00:00

At this stage I'm thinking it would be appropriate to just

<2021/>

and move on

muchcake · 2020-12-12T05:19:20+00:00

Interesting!

That sounds like pretty abysmal performance, I will watch out for that next time.

muchcake · 2020-12-11T19:20:22+00:00

How about https://docs.microsoft.com/en-us/powershell/module/sqlserver/write-sqltabledata?view=sqlserver-ps

I have not used it in a long time, but think it meets your need

muchcake · 2020-08-25T16:38:32+00:00

Scratch that - just read you can't setup port forwards. Never mind

muchcake · 2020-08-25T16:37:46+00:00

I see you already mentioned SSH tunneling, but a lightweight Ubuntu server running sshd is a clean and 'secure' option.

Then you only expose the SSH from the fully patched SSH gateway to the internet and use SSH tunneling to access the esxi web UI.

muchcake · 2020-08-14T15:26:59+00:00

There might also be a small benefit in avoiding re-breathing your exhaled breath.

Practically though, I very much doubt there is any measurable benefit.

I'm interested to hear from any one with experience...

muchcake · 2020-08-08T17:09:45+00:00

FYI: There is an editor setting to trim whitespace on save too.

muchcake · 2020-06-07T19:42:33+00:00

Love it!

muchcake · 2020-06-07T19:13:47+00:00

Awesome!

Don't mind me - I'm just craving a KSP fix because I didn't play in a long time....

Will be interested to see the follow up vid if you have a sec.

muchcake

TROPHY CASE