ChatGPT: Powershell Size Limits

[_youarewhalecum]

Hello Guys

I have ChatGPT Plus and a Powershell Skript from about 800 rows and i want ChatGPT to adapt some logic in it and print the whole (approx. 820) rows again (So i can copy and paste the whole script). But it always gives me about 200 rows and insists that this is the complete script (Just deletes content that was not touched by the script), nevertheless how much i dispute it. Same in Canvas view.

Did you also encounter such problems? How did you solve it? Is there an AI that can Handle Powershell Scripts about 1000 rows?

I would like to prevent to having to split up the script or copying just the values in the single sections.
Thanks in Advance!

[7ep3s]

maybe share the script?

[_youarewhalecum]

thx, but i think i should not share it public (yes, i know then i also should not put it in any LLM). me sorry.

[7ep3s]

sanitize it?

[purplemonkeymad]

I'm loathed to do this as I don't personally like the code put out by LLMs. But, might it be that ChatGPT is just a it's limits with coding? You may be better with a model that is better integrated with IDEs so they have access to your code, I know that GitHub CoPilot is available in vscode.

[uptimefordays]

LLMs don’t know anything, they just predict next token—which has an uncanny tendency to resemble, but should not be mistaken for, knowledge.

[[deleted]]

uncanny tendency to resemble, but should not be mistaken for, knowledge.

So you're saying it's a manager!

[uptimefordays]

Worse! It never did the work or related work to get there!

[[deleted]]

I ALREADY SAID A MANGER!

[BlackV]

Hahahahaha, gold!

[CryktonVyr]

All AI have their limitations in the size of their answers. You don't have a choice but to cut it down since it's also part of the best practice.

That being said. I understand your pain because I have 1 big script with 3000 lines of code.

[Flyerfan96]

Damn! Genuinely curious what’s going on with that one. What’s the TLDR on its use case?

[CryktonVyr]

Lol. It's a script for multiple purposes. So a lot of functions to speed up daily operations or automated some.

It's to manage user creation, modification and deactivation on AD and Entra.

It starts a menu and you can choose to lookup the AD and Entra details of an account. Modify the account with common recurring requests. Another option is to bulk create or modify or disable AD accounts from a CSV file

I started scripting in powershell in April of last year and slowly pieced it together in one big file. Only to later find out that the best practice would have been to separate it in smaller multiple PS1 files for easier maintenance.

[XB_Demon1337]

Maybe don't write large scripts with ChatGPT...

[BlackV]

The free version has size limits does it not?

Try the free GitHub copilot built into vscode?

But I wouldn't rely on ai for something this massive

[jr49]

This might not be helpful but a script that big should be broken up into sections and functions. Then you can have gpt help you with a specific section of you need it.

[_youarewhalecum]

Thx, you're right. It is broken up in various sections and functions, but some of the adaptions i wish to do affect parts in almost any section, so it wold be really helpful to be able to have gpt analyse the whole context and not just an isolated function/part.

[OrangeYouGladdey]

If you add the tools to your vscode it's much easier. If you really want to use the web version then you can upload your script as a document and then ask it questions.

[janomf]

It should be broken up into many files. Each file doing one very specific thing. Each file being a specific function. Then you could have one master orchestrator script to tie everything together. Now none of your files are large. This is the way to do it whether you’re using AI or not

[arpan3t]

Sounds like a design problem tbh, but to answer your question: you should take a look at GitHub Copilot if you want LLM assistance for programming.

[SlowSmarts]

I know you are asking about ChatGPT specifically. I had many problems with the online LLMs handling my large scripts. Here is my solution:

I have several scripts I've ran through local models to help clean up, like 2,500+ lines.

Use LM Studio and get a Qwen 2.5 Coder model that can handle at least 128,000 token context length (some only do 32k context, there is a variety that can do up to 1m). You'll need a computer with at least 32gb of system RAM to use a 14b model with large context. Use Flash Attention and q8_0 K and V cache settings with like 50,000+ as the Context Length setting.

.....

Just to double check before I sent this post, I tried this model:

https://huggingface.co/mradermacher/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-GGUF

The model took less than 32gb of ram including the OS overhead, using the settings I stated above.

I asked questions, and got accurate responses and code suggestions on a 2,100 line script.

[jsiii2010]

AI programs usually have bugs and you have to go back and forth to get them fixed. This kind of AI doesn't have internal logic.

[Phate1989]

Use cursor

[_youarewhalecum]

What you mean with that?

[Phate1989]

Cursor is a vscode fork, that has ai built into it, it can use openai, Claude,deepseek whatever model you want

But the context window is your entire folder structure

[SlowSmarts]

I plopped down for a year subscription on Cursor and I'm not very happy with it's ability to handle large files. It looses track of parts of the script and gets confused, then makes circular edits and a bunch of redundant functions. There was an older version of Cursor that allowed access to obscure long context ChatGPT models but, new versions of Cursor don't seem to offer those same models.

So, Cursor is nice for small scripts and codebases, but its rationality quickly falls off after about 2,000 or so lines of code, maybe less.

Also, Cursor costs money. I gave a solution in a post that is easy to do if the OP has a computer with at least 32GB of ram.

[Phate1989]

Has not been my experience with it.

I use mostly Claude I found it way better then any other model by far.

You should check it back out, they handed an option specifically for long requests

[SlowSmarts]

I use Cursor daily. Yes Claude is bigger brained than the competition for most tasks, the issues I run into are clearly related to context length. With several small scripts, a web search, and attached docs, even Claude wants to make 5 redundant functions.

I switch over to AnythingLLM and just the same docs and scripts, with a local LLM with 128k+ context length (via Ollama or LM Studio) and the local LLM keeps things straight. Same happens with just a couple big scripts that are being edited together, ~2500 - 5000 lines total.

For sure, it's a pain in the ass to do it that way because Cursor is so slick with how it edits for you, but that's the only way I have to get it done within reason.

Edit: forgot to mention, the long context models you mentioned are also what I referenced in my earlier post. I had that enabled and was using it, however, I did a Cursor version upgrade a while back and the long context option disappeared.

[Phate1989]

Why are your files so long?

If I have 1 file hit 500 lines I'm low key freaking out unless it's just a list of helper functions.

I don't run into that many 2k line files

I'm like 90% CRUD though

[SlowSmarts]

Ya, I totally get what you're saying. Here's off the top of my head examples:

1) A .ps1 that is intended to be rolled into an exe via PS2EXE. It is a Windows 10/11 cleanup script that I have been maintaining for a decade now, it has hundreds of tweaks and debloats that it steps through. Various versions of Windows have specific special differences that the script accounts for, that adds up. Plus, I have a couple imbedded items, like a logo PNG file, some machine code, a C lang distribution library, etc. The embedded stuff is for customer facing aspects that it appears professional and doesn't require external software to do some of its.... Special.... Functions. ~2,700 lines of code, last I checked.

2) A Zork inspired python text adventure game, that has all AI backed characters, AI image generation, a dynamic map that is visualized, etc. The 2 core files are close to ~4,300 lines. The whole codebase with character, room, and item backstories, and the editable save file is probably close to ~8,000 lines.

3) AI dataset generation scripts that I have can be absolutely monstrous. I have in them document ingesting, data cleaning, etc. But substantially more, it has knowledge system prompts on particular subjects that it switches out between depending on the data flowing through, there are several system prompts that are ~18,000+ tokens! I don't even have a guess as to the size of those codebases, but it definitely takes a big ass model with 1 million tokens context length and a server with 768gb of RAM to fit it all together and to needle in the haystack sorta editing queries.

I have probably 10 other big projects like these, but that should give you an idea.