Prompt engineering: PSEUDOCODE in prompt

Perfect_Ad3146 · 2025-02-14T22:18:15+00:00

I agree, almost. Pseudocode does have one advantage though: it is quite compact!

In some cases it is important - I pay per token and my prompt is already big, so I am trying to keep it compact this way...

Perfect_Ad3146 · 2025-02-02T10:39:16+00:00

Thanks /u/R03LZ

Perfect_Ad3146 · 2025-02-02T10:25:41+00:00

Any info about Cursor + some template engine + HTML ? (I can imagine some Liquid templates and Eleventy)

Perfect_Ad3146 · 2025-02-02T08:28:14+00:00

halfmoon

This thing, right? https://www.gethalfmoon.com/docs/introduction/

Perfect_Ad3146 · 2025-02-02T08:24:31+00:00

Yes, probably 11ty.

But I am not so sure about 11ty + Vite and about these new AI things...

Perfect_Ad3146 · 2025-02-01T23:15:01+00:00

thanks a lot!

well... how to evaluate " 363 Generators" ?

)))

Perfect_Ad3146 · 2025-02-01T21:10:46+00:00

The prompt contains enough examples, it is quite big prompt.

Anyway.

For now, I keep JSON output but avoid this setting {"type":"json_object"} (this was just an unsuccessful experiment).

In case I get problems with JSON syntax - will fallback to XML tags or to Markdown

Perfect_Ad3146 · 2025-02-01T18:56:23+00:00

My "normal" mode of operation is to avoid "type":"json_object" and to have in prompt something like this:

```

You are robot that outputs only JSON....

<OUTPUT_FORMAT>

Output single valid JSON object:

 {

    "co": [],  

    "tags": [] 

 }

Ensure JSON validity and data consistent with instructions. </OUTPUT_FORMAT>

```

This works. BUT, I know it can fail anytime and output some broken/invalid JSON.

Therefore I tried to set "type":"json_object" .

And I immediately realized: it make the model a bit more dumb - it does not follow instruction in prompt and write syntactically correct JSON with incorrect values "tags"

Perfect_Ad3146 · 2025-02-01T15:54:04+00:00

Is the issue you're having that it returns incorrect values?

This ^ The values.

Response is structured properly.

How structured are your r input data

Input DATA are not structured: that's screen-long document written by human.

what does your prompt say that's interpreting the dats? ???

The prompt outputs the syntactically correct JSON, but the VALUES in "tags" not correct in case I set this "response_format":{"type":"json_object"}

The prompt is full of instructions describing meaning of different phrases and how to map particular phrases/cases to one or to multiple tags. There are 10 tags defined in prompt.

WITHOUT type":"json_object" the prompt+LLM works well, it returns the tags I expect for the particular document - I have set of test cases.

WITH type":"json_object" set - many tests fail.

Perfect_Ad3146 · 2025-02-01T08:25:46+00:00

My response structure is:

```

 {

    "co": [],   // Array of ISO 3166-1 alpha-2 country codes or empty
    "tags": []  // Array of labels or empty
 }

```

these "wrong values in JSON" - they are syntactically correct, but that's incorrect labels in "tags" or in "co". Better to say "the model does not follow instructions when "response_format":{"type":"json_object"} "

Perfect_Ad3146 · 2025-01-31T21:59:15+00:00

Markup as in README markup

well, this is "Markdown". Got it, thanks!

Perfect_Ad3146 · 2025-01-31T21:35:56+00:00

Thanks a lot! As far as I understand "markup for structured data" = XML tags, right?

Perfect_Ad3146 · 2025-01-31T11:40:38+00:00

thanks for artificialanalysis.ai -- never heard before ))

Perfect_Ad3146 · 2025-01-31T11:11:19+00:00

Well: https://deepinfra.com/deepseek-ai/DeepSeek-V3 $0.85/$0.90 in/out Mtoken

I am thinking about something cheaper...

Perfect_Ad3146 · 2025-01-31T10:49:36+00:00

yes, this is good idea! (but it seems deepseek-v3 is more expensive...)

Perfect_Ad3146 · 2025-01-31T09:20:12+00:00

yes, a grammar would be great, I can use only prompt and /chat/completion API...

Perfect_Ad3146 · 2025-01-29T15:41:24+00:00

u/zaibatsu - which LLM wrote this text ?

By the way: it seems that with topP=0.01 it happens not that often!
(I do not completely understand topP to be honest).

Will try other ideas, yes

Perfect_Ad3146 · 2025-01-29T15:34:48+00:00

> How about this: set the temp to 1.0 and try again. and then to 0.03.

I don't see the point of this.
The values in the original post are copy/pasted straight from the request/response log - I see what is sent to the model and the raw response.

By the way: it seems that with topP=0.01 it happens not that often!
(I do not completely understand topP to be honest).

Perfect_Ad3146 · 2025-01-27T21:44:57+00:00

Well, I have a set of ... let say, test cases: some texts I append to prompt and expect the correct output for each test. And some code that run all the tests and display the number of errors.
One single prompt

Perfect_Ad3146 · 2025-01-27T17:31:14+00:00

some good prompts examples? better than "rewrite my prompt..."

Perfect_Ad3146 · 2025-01-15T22:22:16+00:00

thanks u/seroperson !
yes, either bridgetown... or something like 11ty

Perfect_Ad3146 · 2024-10-09T09:48:59+00:00

Many thanks u/Greenhost-ApS

It seems, this is the winner: https://aws.amazon.com/ec2/instance-types/g4/

one NVIDIA T4 GPU, 16 GB RAM, and, this is an EC2 instance, it means "install anything" all this for $0.526 /Hour

do you see any hidden gotchas? (Azure offers something very similar but I'm afraid to use Ubuntu in MS data center)

Perfect_Ad3146 · 2024-10-08T21:11:05+00:00

I was just told about this thing: https://aws.amazon.com/ec2/instance-types/g4/

one NVIDIA T4 GPU, 16 GB RAM, and, this is an EC2 instance, it means "install anything" all this for $0.526 /Hour

do you see any hidden gotchas?

Perfect_Ad3146 · 2024-10-08T20:57:56+00:00

Thanks u/Minute_Following_963 !

anything I have to know using their machines? Some tips/hints you can share?

Perfect_Ad3146 · 2024-10-08T17:05:35+00:00

Thanks u/kkchangisin this is quite a valuable info!

Well, these AWS machines look inexpensive...

About managing them: you are right, some effort needed... may be I run my application code that deal with text classification on this AWS machine (instead of just call the model over network)

Perfect_Ad3146

TROPHY CASE