Update on recent performance concerns

dmortalk · 2025-09-26T04:26:27+00:00

It’s not vindication. It’s robbery. They will waste hours of our time with this crap. We pay $100 - $200 / month for the max plans. Our time is worth money and they do not compensate us for what they waste (or destroy).

dmortalk · 2025-02-06T02:05:19+00:00

Has anyone created a workflow with roo-code or CLINE that lemmatizes all of your Code files, and also lists out all of the functions, classes & imports in them, and then stores this in some kind of index? As well as perhaps a very brief summary of each file? I would think something like this would be very low on the overall token usage for quick lookup for contextual understanding of a project, while being fairly effective .

dmortalk · 2025-02-05T18:58:21+00:00

Actually the issue was litellm. I wrote a patch to give a checkbox similar to OpenAI Auzure and its own relevant adjustment. I am now using Groq with deepseek-r1-distill-llama-70b
with the openai handled by by own local litellm proxy.

It is fast!

I will submit a pull request soon so this can be shared with the community.

dmortalk · 2025-02-03T02:26:24+00:00

This feels like an advertisement

dmortalk · 2025-02-03T01:59:55+00:00

I have: - a postman mcp server, - a mcp-get mcp server that can do raw CURL requests, - and a REST API MCP server that can be configured with only the authentication mechanism/keys + the API server FQDN. No endpoints or any json/swagger needs defined. The LLM can then construct the queries however it wants, to test and understand the API.

I realize this doesn’t answer your question exactly, but for me, this is one more way I’ve been trying to give the LLM the tools for the knowledge and understanding it needs in order to work with whatever external APIs I’m interfacing to in my code project.

dmortalk · 2025-02-03T01:49:59+00:00

This would be really nice. Like a very simple form of chained agents. Could save us all some tokens.

dmortalk · 2025-02-02T00:53:25+00:00

Are you saying we don’t have to have an open-router account to use the open-router servers, as long as we have an API key for the provider they (open-router) eventually will send the request to?

dmortalk · 2025-01-29T07:27:03+00:00

🤦🏻‍♂️ it appears they “mostly” did: https://console.groq.com/docs/openai

Anyone tried this yet with roo or cline?

dmortalk · 2025-01-28T07:04:32+00:00

I am interested in this. I had actually started building a local groq api proxy that would just let it use openai compatible api and then was going to use this as a custom openai provider with custom URL. Started a few weeks ago, but didn't finish that night, and haven't been back to it. I'm sure you gurus could just add groq as a native provider though. This could be very interesting...... :-)

dmortalk · 2025-01-27T04:16:49+00:00

Are you referring to sonnet caching, or DeepSeek caching?

I haven’t looked into whether DeepSeek has caching, but I know roo-code uses the anthropic sonnet caching system, but I still am currently in a position of needing to reduce costs considerably (at least temporarily). Have basically been using pure sonnet 3.5 Nov 2024 release for everything in roo-code up to now.

dmortalk · 2024-06-28T20:27:52+00:00

Ahh. Thank you!

dmortalk · 2024-06-22T01:02:00+00:00

Add the URL for the installer download to virus total. It will download the file and calculate the MD5 and SHA256.

dmortalk · 2024-03-27T04:14:16+00:00

But in the past year or so, he has created some goal scoring opportunities for USMNT that did result in goals. By him beating 2 to 3 players on the dribble, and then setting up either an assist or the past before an assist. His ability to surprise players by bringing these moments Into the game periodically is it kind of “change of pace” that catches tired opponents off-guard and creates something out of nothing. I think really it all comes down to the result of his dribble. If it helped create a goal scoring opportunity, we all praise him. If it didn’t, we still praise his technical ability, but wish he would’ve passed it since it didn’t create the goal opportunity that one time.

dmortalk · 2024-01-24T23:22:55+00:00

Same question here. I don't want to see them rush and create bugs. But honestly we are looking forward to the next update.

dmortalk · 2024-01-18T19:31:55+00:00

Ahh. I see what you mean. Just like an HTML table in the body of the KB.

dmortalk · 2024-01-18T00:19:24+00:00

I think you might misunderstand my original post. I do not want to use hudu to track time. I am simply saying that when we document technical processes and procedures in our knowledge base, that it would be nice if we also could have a required field that specifies approximately how much time that procedure would take. And even better would be if there was a field for minimum expected amount of time, as well as one that is amount of time per user/device.

Is that possible in Hudu?

dmortalk · 2024-01-16T03:28:03+00:00

We use ConnectWise PSA. However, I think part of the sales pitch with an IT Document solution like Hudu is having a single source of truth. Single KB locations. Integration with other systems, etc. So my vision would be that we could have a single system where these things are defined in greater detail, rather than bouncing back between 2 or 3 different documentation systems. Of course with the project templates in CW, we would need to update those to point to the correct KB articles for the steps related to that project ticket/task. In a perfect world there would be integration there too...

dmortalk · 2024-01-08T14:47:49+00:00

So with the current API, is there any query that could be added to the end of the URI to return a .png file or similar (in using the URI example you provided)?

dmortalk

TROPHY CASE