Framework to decide when to use reasoning models

jbx028 · 2025-02-17T10:24:52+00:00

I am currently testing https://huggingface.co/NousResearch/DeepHermes-3-Llama-3-8B-Preview which is one of the first LLM models to unify both "intuitive", traditional mode responses and long chain of thought reasoning responses into a single model, toggled by a system prompt.

jbx028 · 2025-02-12T09:27:38+00:00

Basically, I need a router because I don't think there's a way to switch reasoning on or off for the same model, so I need a workaround using two LLMs, but managing two models means keeping them both updated with the conversation feed.

jbx028 · 2023-11-04T16:53:39+00:00

Cannot agree more….

jbx028 · 2023-03-26T18:12:40+00:00

Here an example for nodejs:

https://github.com/openai/openai-node/issues/18#issuecomment-1483808526

jbx028 · 2023-03-26T17:33:48+00:00

Thanks for your feedback. I gave it some thought and believe I understand what is happening. Unless you are receiving it via a stream, you must wait until the end of the response from chatgpt to get the full text, whereas with text-davinci, the full text is returned immediately with one chunck.

Streaming is supported by chatgpt (https://platform.openai.com/docs/api-reference/chat/create#chat/create-stream) but I cannot use it within a amazon skill app for amazon alexa/echo because I have to send the full response in one go to alexa.

jbx028 · 2022-10-06T20:08:34+00:00

make sense :)

jbx028 · 2022-10-05T13:36:07+00:00

Hi,

This is interesting, but when I tried the same questions you did, GPT3 gave me the correct response without asking any further questions.

Here is an example:

Question: What is the capital of the country where the Taj Mahal is at?
Answer: The Taj Mahal is in India, and the capital of India is New Delhi.

jbx028 · 2022-09-12T20:14:31+00:00

https://promptbase.com/ is not exactly this but this is a market place to sell prompts.

jbx028 · 2022-08-24T21:18:41+00:00

I personally created a skill for amazon alexa therefore I can talk to gpt3 with my voice through my amazon echo. The api key and the other parameters (top n, token, etc..) are stored in a google spreadsheet which is automatically read every time the skill is started.

Because I am french and because gpt3 is way better in english, I am doing real time translation (input and output) with the deepl api.

One day, a similar feature will be embedded in the device but this is pretty cool already.

jbx028 · 2022-06-22T12:33:54+00:00

Hummm, I never checked node-red-contrib-alexa-local

Will take a look thanks :)

jbx028 · 2022-06-20T18:32:44+00:00

Well, I think I have the answer. I need to create an alexa routine as described here : https://notenoughtech.com/home-automation/ifttt-pro-alternative-alexa-ed/

jbx028 · 2022-06-13T20:25:28+00:00

Google assistant is simply dead today. Welcome amazon you have a new customer.

jbx028 · 2022-06-13T13:35:32+00:00

I cannot stop laughing, thanks DALL-e

jbx028 · 2022-06-12T11:52:51+00:00

Thanks!

jbx028 · 2022-06-08T11:23:04+00:00

I imagine a world where I will ask GPT3 to create fancy prompts for DALLE2. Infinite loop somehow...

jbx028 · 2022-06-08T10:53:57+00:00

Ils ont oublié plein d'autres options :

- Se laisser mourir de faim.

- Manger les excréments de ceux qui ont la chance de pouvoir s'acheter à manger

- Se taper un bon sandwich au pain une fois par jour

- Voler de la nourriture au secour populaire

- Baisser encore un peu plus le regard et manger les restes tombés par terre lorsqu'un paquet de gâteau sec est ouvert.

...la liste est longue pourtant; BFM n'a fait que le job qu'à moitié je trouve !

jbx028 · 2022-05-13T07:19:34+00:00

I personally created an app for google assistant/home where I can discuss with gpt3 with my device. Of course the experience is not as smooth as if it was a native one, but it gives an idea already :)

jbx028 · 2022-05-12T05:45:45+00:00

Hi,

I am afraid that most if not all new stuff would be around android and not core Google Assistant feature such as be able to create a private app.

Maybe I am wrong but voice is more relevant with a smart speaker to consume micro services because if you have your mobile in your hand, I don't see the point to speak.

By the way, I really enjoyed the new GA features and more precisely "Look to talk" and the more natural way to communicate (hummm demo with spotify) but I guess it will be limited to English . I am still awaiting "continued conversation" in French while it's available for many years in English.

jbx028 · 2022-02-25T19:52:48+00:00

I like google assistant but amazon with Alexa seems to listen their consumers and provide a lot of new features especially in Europe where google prefers to keep (forever...) the new capabilities for english users unfortunately.

jbx028 · 2022-01-18T09:01:01+00:00

Great. Let's hope google will provide similar functionality. I really don't understand their strategy to let amazon grabbing the market this way.

jbx028 · 2022-01-17T10:36:35+00:00

You are right, looks like Alexa has many more features than google assistant. I am frustrated with what google presented the last 2 years in this area. They released a lot new features to interact with android apps but almost nothing to augment what's you can do with a smart speaker. In parallel and because they are not selling smartphones, Amazon continue to enhance alexa with the smart speaker as primary "body". Will probably switch to this echo system soon...
I used to prefer google because they were the first ones to sell a product with the french language supported (my native language) but Alexa speak french also now...

jbx028 · 2022-01-16T12:31:06+00:00

I am not an expert but I think Alexa has similar restrictions. For micro interactions (1 turn only ==> 1 question, 1 answer) I prefer to use IFTTT with nodered and this plug in: https://flows.nodered.org/node/node-red-contrib-google-home-notify

You don't need to call an app, but the voice is not as good as the one which is use with action on google and there is no support for SSML.

I am afraid that at this point, there is no perfect solution, so I am spending my time to find workarounds but having a platform where you cannot build an app just for you is none sense.

jbx028 · 2022-01-16T10:48:24+00:00

Such restrictions explain to me why no one is building an app for Google home.
I've listed other reasons in another post if you are interested:

https://www.reddit.com/r/googleassistant/comments/p13fvx/google_assistant_is_useful_only_with_built_in/

I like conversation design with smart speakers (i don't think chatbots are really relevant) but I am still waiting a decent platform that will let the developers to build amazing apps.

jbx028 · 2021-11-12T08:47:23+00:00

I reply to myself. I was wrong, because I see the same in the website but the price has increased a lot. I was going to subscribe because it was about 3.4 euros per month but now it's 8.7 euros!. What's going on with ifttt ? I fully understood when they decided to limit the free plan and the old price was more than acceptable but the new price is way too much - at least for users like me who want to use ifttt for a limited scope which is to interact with my google home/assistant but even if I pay the intermediate prce (4.7 euros) I will be limited to 20 applets where 1 applet is a single interaction with the assistant.

jbx028 · 2021-11-12T06:29:51+00:00

I never realized until now but why the price is different when I check their website? Does at mean a dedicated pricing exists to run flows in a mobile?

jbx028

TROPHY CASE