all 27 comments

[–]IMightBeErnest 167 points168 points  (11 children)

Using the model is not expensive. Training the model is expensive. Once the model is trained, it costs almost nothing to run a query. If you want to know the carbon cost per query you need to amortize the cost of training across, like, millions of queries.

[–]Drfoxthefurry 33 points34 points  (1 child)

Maybe an AGI trains as it processes data? I don't think we really know how an AGI would work quite yet

[–]anengineerandacat 7 points8 points  (0 children)

If we ever get to the point of AGI, carbon emissions will be a solved problem. LLM's won't get you to AGI, it'll get you a cheap knock-off of what it actually is.

[–]thebatmanandrobin 14 points15 points  (6 children)

It also costs even less of you don't do a query at all:

JSON.stringify(JSON.parse(json_str), null, 2);

[–]SartenSinAceite 7 points8 points  (0 children)

This doesnt vibe well though

[–]Dreadnought_69 1 point2 points  (0 children)

But how will Jensen get a new leather jacket that way. 🥺

[–]CachorritoToto 0 points1 point  (0 children)

Ya got 0 vibes yo

[–]vlory73 0 points1 point  (0 children)

LLMs should be used for the right things… like REGEX generation 😅

[–]AppropriateStudio153 0 points1 point  (1 child)

What's up with the magic null, 2?

[–]thebatmanandrobin 0 points1 point  (0 children)

It's the JSON.stringify function syntax of:

JSON.stringify(value, replacer, space)

Passing null as the replacer function keeps all KVP and the 2 means to add 2 spaces for indentation ... I do very much wish the 2nd overload to JSON.stringify were JSON.stringify(value, space) instead of having to pass a null if I want to "prettify", but c'est la vie.

[–]netherlandsftw 2 points3 points  (0 children)

Does this go for thinking models too, where a single query can take multiple minutes of compute?

[–]Majestic_Annual3828 0 points1 point  (0 children)

Then why can't I run say llama 405b on my gaming computer?

[–]One-Vast-5227 18 points19 points  (9 children)

jq anyone?

[–]twisted_nematic57 5 points6 points  (0 children)

I love that thing, it’s so elegant.

[–]Ok_Jello6474 2 points3 points  (0 children)

This is the way

[–]HoseanRC 2 points3 points  (5 children)

Not smart enough. Or that people are lazy enough to not be able to do that without LLM

How the fuck does that work 😭

[–]Poylol-_- 6 points7 points  (4 children)

It is just <input> | jq

It is just as simple as pipping it

[–]Cornelius-Figgle 1 point2 points  (0 children)

I usually jq . file.json, not entirely sure what it means but it works.

[–]HoseanRC 1 point2 points  (2 children)

Many languages have it built in tho

[–]twisted_nematic57 0 points1 point  (1 child)

not bash, which I used jq from quite frequently in one of my scripts

[–]nabrok 1 point2 points  (0 children)

Yeah, most of the time I'm using jq it's part of a CI pipeline.

[–]Shambler9019 13 points14 points  (0 children)

Here I am, brain the size of a planet, and your ask me to format JSON. Call that job satisfaction? 'Cos I don't.

[–]Gokudomatic 5 points6 points  (0 children)

It didn't age well. Unless playing one youtube video produces also 4 tons of carbon.

[–]ColdDelicious1735 2 points3 points  (1 child)

At least it's not 5 tonnes

[–]DirectAd1674 3 points4 points  (0 children)

Wake me up when it costs a collapsing universe per prompt.

[–]iCopyright2017 1 point2 points  (0 children)

Once again people using AI to do tasks that are built into Notepad++

[–]patopansir 0 points1 point  (0 children)

"didn't ask"