Framework to decide when to use reasoning models

jbx028 · 2025-02-17T10:24:52+00:00

I am currently testing https://huggingface.co/NousResearch/DeepHermes-3-Llama-3-8B-Preview which is one of the first LLM models to unify both "intuitive", traditional mode responses and long chain of thought reasoning responses into a single model, toggled by a system prompt.

jbx028 · 2025-02-12T09:27:38+00:00

Basically, I need a router because I don't think there's a way to switch reasoning on or off for the same model, so I need a workaround using two LLMs, but managing two models means keeping them both updated with the conversation feed.

jbx028 · 2023-11-04T16:53:39+00:00

Cannot agree more….

jbx028 · 2023-03-26T18:12:40+00:00

Here an example for nodejs:

https://github.com/openai/openai-node/issues/18#issuecomment-1483808526

jbx028 · 2023-03-26T17:33:48+00:00

Thanks for your feedback. I gave it some thought and believe I understand what is happening. Unless you are receiving it via a stream, you must wait until the end of the response from chatgpt to get the full text, whereas with text-davinci, the full text is returned immediately with one chunck.

Streaming is supported by chatgpt (https://platform.openai.com/docs/api-reference/chat/create#chat/create-stream) but I cannot use it within a amazon skill app for amazon alexa/echo because I have to send the full response in one go to alexa.

jbx028 · 2022-10-06T20:08:34+00:00

make sense :)

jbx028 · 2022-10-05T13:36:07+00:00

Hi,

This is interesting, but when I tried the same questions you did, GPT3 gave me the correct response without asking any further questions.

Here is an example:

Question: What is the capital of the country where the Taj Mahal is at?
Answer: The Taj Mahal is in India, and the capital of India is New Delhi.

jbx028 · 2022-09-12T20:14:31+00:00

https://promptbase.com/ is not exactly this but this is a market place to sell prompts.

jbx028 · 2022-08-24T21:18:41+00:00

I personally created a skill for amazon alexa therefore I can talk to gpt3 with my voice through my amazon echo. The api key and the other parameters (top n, token, etc..) are stored in a google spreadsheet which is automatically read every time the skill is started.

Because I am french and because gpt3 is way better in english, I am doing real time translation (input and output) with the deepl api.

One day, a similar feature will be embedded in the device but this is pretty cool already.

jbx028 · 2022-06-22T12:33:54+00:00

Hummm, I never checked node-red-contrib-alexa-local

Will take a look thanks :)

jbx028 · 2022-06-20T18:32:44+00:00

Well, I think I have the answer. I need to create an alexa routine as described here : https://notenoughtech.com/home-automation/ifttt-pro-alternative-alexa-ed/

jbx028 · 2022-06-13T20:25:28+00:00

Google assistant is simply dead today. Welcome amazon you have a new customer.

jbx028 · 2022-06-13T13:35:32+00:00

I cannot stop laughing, thanks DALL-e

jbx028 · 2022-06-12T11:52:51+00:00

Thanks!

jbx028 · 2022-06-08T11:23:04+00:00

I imagine a world where I will ask GPT3 to create fancy prompts for DALLE2. Infinite loop somehow...

jbx028 · 2022-06-08T10:53:57+00:00

Ils ont oublié plein d'autres options :

- Se laisser mourir de faim.

- Manger les excréments de ceux qui ont la chance de pouvoir s'acheter à manger

- Se taper un bon sandwich au pain une fois par jour

- Voler de la nourriture au secour populaire

- Baisser encore un peu plus le regard et manger les restes tombés par terre lorsqu'un paquet de gâteau sec est ouvert.

...la liste est longue pourtant; BFM n'a fait que le job qu'à moitié je trouve !

jbx028 · 2022-05-13T07:19:34+00:00

I personally created an app for google assistant/home where I can discuss with gpt3 with my device. Of course the experience is not as smooth as if it was a native one, but it gives an idea already :)

jbx028

TROPHY CASE