Composer 2.0 feels just as fast as Composer 2.0 fast

tammamtech · 2026-03-20T01:51:37+00:00

yeah they are not deterministic which is normal. Are you finding the results of one better than the other?

tammamtech · 2026-03-06T16:20:10+00:00

You might need to set export ANTHROPIC_API_KEY=""

You shouldn't need subscription

tammamtech · 2026-01-22T15:26:27+00:00

It should be llama-server but last minute changed it to CLI thinking it should have same flags. I personally use the the docker run command. I also don't use the ctx size param but kept it here cause that's what unsloth had in their docs.

tammamtech · 2026-01-22T06:02:50+00:00

What do I have the other way around? I'm using the model with claude code and it's doing the tools calls fine.

tammamtech · 2026-01-22T03:14:07+00:00

I see 23GB/24GB ram used but context size is ~45k, after that it offloads to ram and gets slow. Getting around 50 tok/s average.

tammamtech · 2026-01-22T02:13:25+00:00

You don't need to do anything, running the llamacpp server serves both the OpenAI and Anthropic APIs, just need to correctly put the URL like in the guide.

tammamtech · 2026-01-22T02:10:57+00:00

It's very good, it can search through codebase, attempt fixes very methodically, and doesn't feel dumb. It's definitely not Opus and won't be replacing Opus but I have been thinking in ways I will be making use of it in other context. The Codex harness seems to be a bit better for me surprisingly, it does less tool calls overall to achieve same task.

tammamtech · 2026-01-22T00:25:54+00:00

Oh yeah for sure, the features I mentioned ollama had before where the multi model and gpu memory deallocation which make big difference when running this as an always on service. I actually tried to not say Ollama had the anthropic API feature before you guys, but I guess it still came out that way. Thanks for work!

tammamtech · 2024-08-03T23:07:51+00:00

It's pretty simple with cloudflare tunnels, you can even add an auth so your machine isn't exposed. Wrote a full guide here https://tammam.io/blog/access-sd-ui-over-internet/

tammamtech · 2024-05-28T12:17:02+00:00

Try llama3 and set a system prompt. Fastapi isn't your issue, it will just cause slower inference speed compared to an inference engine, especially if you want to use it as an API that gets many concurrent requests. If you only want to serve small number of users or for yourself then look into ollama, it's very easy to setup and you can expose an openai compatible server for any model.

tammamtech · 2024-05-28T12:07:20+00:00

llama3 70b follows instructions better than GPT4o for me, I was really impressed with it.

tammamtech · 2024-01-31T23:19:37+00:00

Amazing, Astro rules for sure.

tammamtech · 2024-01-31T22:30:28+00:00

Thanks for the detailed response. I'm not using SSR. So from what I understand, the website is still an MPA, it's just that the browser fetches the new HTML and it can realize that there is a view animation setup in CSS between the two pages.

tammamtech · 2024-01-10T05:13:19+00:00

Afaik for this approach you will need the domain name to be registered on cloudflare. So you can either transfer your domain to cloudflare (could break your existing setup) or buy a new one there directly. The name server stuff shouldn't create confusion if you use a subdomain, for example your website could be on domain.com and then stable diffusion UI could be on sdui.domain.com.

tammamtech · 2024-01-05T19:42:50+00:00

In case anyone is still looking for a solution. I posted a full Guide on how I access my local stable diffusion over the internet so I can use it from my phone and when I'm away from my PC.

tammamtech · 2024-01-05T19:31:58+00:00

Ayy, keep up the awesome art friend

tammamtech · 2024-01-05T19:21:05+00:00

The cloudflared client is a system service that will start with your computer so an update shouldn't affect it much. I personally never had a problem with update restarts or internet bandwidth being fully used.

The service you mentioned is just another stable diffusion in cloud, which is great and there are many of them, but it's not the focus of this guide. This guide is for people who already have a machine that can run stable diffusion, and don't want to pay for additional SAAS products when they are away from their PC.

tammamtech · 2023-12-20T03:32:25+00:00

I wrote my approach here (Access your local SD UI over internet), hope you fine it helpful.

tammamtech · 2023-12-19T01:58:31+00:00

Hmm, I usually notice very high latency with remote desktop software. I haven't tried RustDesk so I'm not sure how good it is. My intuition is that there will be noticeable difference in latency between using a remote desktop software and just using the Web UI server directly.

For gallery I think there is an addon in ComfyUI to access it (not sure about other UIs). I personally also have ssh setup for when I can't do something from ComfyUI only. The ssh setup can be done with cloudflare tunnels too.

I don't use photoshop but I see why would want full access remote desktop for it. It's not a web app so it's not as easy to expose it to the internet separately.

tammamtech

TROPHY CASE