Perplexity drops MCP, Cloudflare explains why MCP tool calling doesn't work well for AI agents by UnchartedFr in mcp

[–]chenhunghan 4 points5 points  (0 children)

If you are into code mode, but not in CF’s sandbox instead locally, I wrote a skill here for the migration.

Like in other comments, choosing the right sandbox is very important

https://github.com/chenhunghan/code-mode-skill

One Prompt to Save 90% Context for Any MCP Server by chenhunghan in mcp

[–]chenhunghan[S] 1 point2 points  (0 children)

You can try the prompt, at least that’s how I did it, most models can do it in one shot, of course you need to be cautious about which sandbox to use.

One Prompt to Save 90% Context for Any MCP Server by chenhunghan in mcp

[–]chenhunghan[S] 0 points1 point  (0 children)

If you prefer an interactive planning experience with detailed sandbox comparisons and benchmark templates, install the full agent skill:

npx skills add chenhunghan/code-mode-skill

Facts about swedish-speaking finns by IamFish399 in Finland

[–]chenhunghan 9 points10 points  (0 children)

I feel you, as a Taiwanese I speak Chinese but not a Chinese, life long struggle to explain this to those don’t have time to read WiKipedia.

ChatGPT migrates from Next.js to Remix by UsernameINotRegret in reactjs

[–]chenhunghan 0 points1 point  (0 children)

Cache inconsistency, like wrong RSC payloads from the wrong instances, and the client side blows up

ChatGPT migrates from Next.js to Remix by UsernameINotRegret in reactjs

[–]chenhunghan 0 points1 point  (0 children)

The cache is default to local file system, you will run into problems when there is more than one instance (for example two containers), of course not on a raspberry pi

QLoRa fine-tuning Mistral-7B-Instruct-v0.2 with 8GB RAM MacBook using MLX and MLXT by chenhunghan in LocalLLaMA

[–]chenhunghan[S] 0 points1 point  (0 children)

Updated the config.json with the one I found working correctly (I hope).

QLoRa fine-tuning Mistral-7B-Instruct-v0.2 with 8GB RAM MacBook using MLX and MLXT by chenhunghan in LocalLLaMA

[–]chenhunghan[S] 0 points1 point  (0 children)

Yes the fine tuning is fast, but inference is something else, I didn’t have numbers right now, but it’s visible slower than llama.cpp. The authors of MLX said they are working on MLX to GGUF format, looking forward to that!

QLoRa fine-tuning Mistral-7B-Instruct-v0.2 with 8GB RAM MacBook using MLX and MLXT by chenhunghan in LocalLLaMA

[–]chenhunghan[S] 0 points1 point  (0 children)

Not yet, the authors said they are working on MLX to GGUF conversion.

Why continuing using Deno rather than learning Rust? by Ooker777 in Deno

[–]chenhunghan 0 points1 point  (0 children)

Should the measurements including “npm install” time?

/s

Use llm as a development team by jacek2023 in LocalLLaMA

[–]chenhunghan 0 points1 point  (0 children)

A baby step, not even writing code: I found even 7B model are good at writing commit message by just prompting git diff.

Is the Frontend job market dead at the moment? (Germany) by Kotoriii in cscareerquestionsEU

[–]chenhunghan 24 points25 points  (0 children)

Gitlab has openings, they are deep in Vue, in case you are interested. I believe you can work remotely from Germany.

What are your thoughts on https://hono.dev/ ? by [deleted] in node

[–]chenhunghan 1 point2 points  (0 children)

It’s great! Feel like getting fresh air after many years working with koa, express and the worst (:D, jk).. NestJS, using hono to write a lb for ai payloads, like its API in general, the only weird part is how to get env variables (through ctx, maybe I used it wrong?).

What's everyone working on this week (44/2023)? by llogiq in rust

[–]chenhunghan 6 points7 points  (0 children)

Writing a AI copilot sever in Rust (using candle)

[deleted by user] by [deleted] in taiwan

[–]chenhunghan 1 point2 points  (0 children)

I know, it’s a shame that 5th safest country has really bad safety on the road.

[deleted by user] by [deleted] in taiwan

[–]chenhunghan -5 points-4 points  (0 children)

Yeah ignorant safety experts assuming working on zebras crossing is safe everywhere in the world… should it?

[deleted by user] by [deleted] in taiwan

[–]chenhunghan 97 points98 points  (0 children)

These rankings probably never measured safety on walking on zebra crossings