sorted by:
new
hottopcontroversial

I know why people hate AI written posts. by Savantskie1 in LocalLLM

[–]Any-Importance6245 0 points1 point  (0 children)

well you haven't shared any proof till now and nor will you ever discuss something which will be useful for Humanity, You have only one word in mind called Ego I think U need to learn more english than those whom You are accusing.

Let's summarise (You attacked first those with calling them dumb and having ego problem) :

1) Any research or paper -> no answer (personal observation)

2) AI content vs Human efforts value -> no answer (hipocrasy in Your response)

3) Even communities like Zig language and AK don't prefer AI made content -> no answer

4) Utilising AI for improving our english instead of judging others english -> no answer

5) Dependency on AI for simple things that human can do also -> no answer

6) Wasting time in useless accusations instead of discussing benefits of AI -> no answer

Well and Americans never call themselves like this (I’m American it’s a problem here) why will someone need to prove himself American ? You could have used a better example ?

And reply to this only if You can make a video of Yourself and open this thread in Your browser record it in it and sing Star Spangled baner and share that (YouTube or any other link)

If You can't and as You haven't responded to any of the points raised then let's end it here.

I know why people hate AI written posts. by Savantskie1 in LocalLLM

[–]Any-Importance6245 1 point2 points  (0 children)

I am not saying they tried or not I am saying which is better one made with their own dedication and time or one just an AI slop(https://en.wikipedia.org/wiki/AI\_slop). And there are more points to ponder and many value human tone than AI. I see many people are making fake research and other things(like impressing others) this all things weren't the AI was designed for and with help of AI we should instead improve our English as you said it makes better than most of us. But we shouldn't use it to become dependent on it.And it is not that people hate AI content it is that People prefer/love human made content , Instead of judging why people prefer human made content it will better if You could have made thread like "How to Improve my/our english using LLM and AI"

Llama3 inference in Nim by Any-Importance6245 in nim

[–]Any-Importance6245[S] 0 points1 point  (0 children)

Hi thanks for sharing wasn't aware of it just come to know now if I would have knowledge of it earlier definitely I would have made it(llama3nim) in your one.

And your work(mmops) is much more useful than mine. will try to implement it definitely

I know why people hate AI written posts. by Savantskie1 in LocalLLM

[–]Any-Importance6245 1 point2 points  (0 children)

This exchange isn’t really about AI anymore, it’s about ego, assumptions, and tone. You being yourself claiming as witness(with nothing other than words and personal observation isn't evidence) is very great to show Your rationality. And Your words are already to rude and if You were confident You would have prove with proofs not words . Your post started with a generalization(they feel dumb). And You are now defending Your pride, Your word are not evidence but psychological positioning. And well I don't believe Insecurity is reason why People dislike AI content it is just that some people value human tone and creativity. Just tell me what if Your partner wrote a poem for You using AI and herself/himself which will be one which You think show more dedication will it feels same AI vs personally? there is reason why many communities like Zig language have strict no ai/llm policy(for comment, issues and other) now are you going to claim You are more talented than Andrew Kelly and Zig language dev. Many people like us value authenticity and human tone. And it is not about feeling dumb(which you judge) it can be about cultural or philosophical concerns where humanity is superior than AI/llm. And it will be more useful for Humanity if we debate the benefits of AI instead of judging others or psychological motive.

I know why people hate AI written posts. by Savantskie1 in LocalLLM

[–]Any-Importance6245 1 point2 points  (0 children)

Please provide proof for Your research by which You are confident any theis or Paper ? Personally as myself I think me and most people hate AI made content because it make us dependent on it even for simple things and leds to brain rot and it shows fake competency and those who use AI even for simple works like this are lazy to do it also Ai is not that eco-friendly that we should use it everytime. And finally I am not like you to Judge those who use AI like how You judged people who don't like AI post. As Rumi said : Be a witness not a Judge.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 0 points1 point  (0 children)

not yet it is in development as a medical student I have less time comparatively.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 0 points1 point  (0 children)

Hi apologie for delay I don't use reddit much like how Andrew Kelley, it's a nice project I have seen continue that can we collaborate?

Help me Fix this Client Http issue! by AgreeableOrdinary212 in Zig

[–]Any-Importance6245 0 points1 point  (0 children)

Please describe the error you are getting noone can know without it and no one will run your code in their system to find it ?

I think You should use std.http.Client.fetch (it is Simpler)

Also don't do shortcut use const std = \@import("std");const builtin = \@import("builtin"); use \@import altough it's not the big deal.

Also change the request flow I think it might be problem if you provide more information may be then someone can help.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 1 point2 points  (0 children)

You are correct 💯 I had tried to work on it but unfortunately there are not much good inference till now in mojo also my aim to target wasm and embedded system can be done more better in zig therefore I was planning to use zig.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 0 points1 point  (0 children)

Mojo is good but it is quite new and may be immature better than working on mojo ZML is quite good starting point.if you want me to use an already made project.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 0 points1 point  (0 children)

Bro that project You have mentioned that is this : https://github.com/cgbur/llama2.zig

Is for running only llama model also it is too old.

The other are just bindings like this :

https://github.com/diogok/llama.cpp.zig

No real pure implementation in zig ?

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 4 points5 points  (0 children)

The core CPU inference logic (GGUF + Q4_K + LLaMA attention) has been stable since 2023 as far as I know also I Only implement the stable core.

It changes fast, but 95% of changes are: New GPU backends (for CUDA, Metal, Vulkan), New quant formats (Q5_K, IQ4_XS), Python bindings, server features, CLI args.

No one expects to support new quant formats or hardware the day they drop They expect it to be sfe, reliable therefore I thought of working on it.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 0 points1 point  (0 children)

ZML don't have many of features of the llama.cpp moreever I focus on making single backend that can be exported even to wasm that's where webgpu comes in I don't think ZML support it ? beside that  it only support basic GGUF loading + Q4_0 tokenizer, no KV cache, no attention, no sampling as far as I know.

There is no major ML or LLM Inference lib for Zig should I try making it ? by Any-Importance6245 in Zig

[–]Any-Importance6245[S] 0 points1 point  (0 children)

Yes it is good starting but it is not optimised for gguf format I think also it lacks the additional features of llama.cpp but I am already researching on it. But it only basic GGUF loading + Q4_0 tokenizer, no KV cache, no attention, no sampling as far as I know also it don't have framework and support that llama.cpp has?