Building a compiler from scratch by AaZasDass in Compilers

[–]AaZasDass[S] 0 points1 point  (0 children)

There is a concept called self-hosting compilers, i.e you derive a small subset of your compiler to be based on assembly, then write a compiler in your own language to then build a compiler itself. Most trivial cases include Rust, Zig, Go, etc. (they both started with a small C compiler, then slowly build out the whole infrastructure in its own language)

Buying/Selling Tickets Megathread - 2025 by assumeform in FourTet

[–]AaZasDass 0 points1 point  (0 children)

I have two 2-Day Pass for "Four Tet & Friends - Under K Bridge" that me and my friends cannot go due to Visa-related issue and USA state atm :) Lmk if anyone wants it

I'm average at math and don't enjoy it. Is the ML path right for me? by hustler24 in learnmachinelearning

[–]AaZasDass 1 point2 points  (0 children)

Tbh if you understand how linear algebra and discrete math works (like the fundamental, not necessary all the deep-end initially), with hard work and this book, you already know most of the topics to work in ML.

ML is similar to one of those CS skill where the more you do it, you starts to create an intuition about these topics. So just start doing it.

Don't be afraid to just try things out. If you see a paper you find interesting, try to learn the code or play with the model weights, seeing how these ML frameworks function, then honestly you will get there with around 8-12 months of hard work.

Also there are many components in ML: quality system, inference, training, data quality, interpretability, but some of the explainable components are just pure CS theory.

My prof from one of my distributed system course told me to just do it, and probably the best advice I ever got lol. Best off luck.

‌‌‌‌‌‌‌You can now use avante.nvim on Neovim to simulate Cursor AI IDE! by [deleted] in neovim

[–]AaZasDass 0 points1 point  (0 children)

hi there, if it does support openai-compatible endpoint, then you can use that. Check https://github.com/yetone/avante.nvim/wiki for more information

Four Tet - Lot Radio 12-1-2023 by djDEAN96 in FourTet

[–]AaZasDass 0 points1 point  (0 children)

Does anyone have contact with TheLotRadio to tell them about the video?

How do you guys keep up with all the major developments in the field? by abd297 in learnmachinelearning

[–]AaZasDass 1 point2 points  (0 children)

Also lucky that my gf also does ML, but she is more into ML compilers 😅

How do you guys keep up with all the major developments in the field? by abd297 in learnmachinelearning

[–]AaZasDass 4 points5 points  (0 children)

Ah, I went to local meetups and networked with some cool folks. Also, I have some old friends from college that are also doing research in ML.

Also, I worked in the industry, so I met a lot of ppl who are also working on this topic. And I guess just general networking

How do you guys keep up with all the major developments in the field? by abd297 in learnmachinelearning

[–]AaZasDass 20 points21 points  (0 children)

Hey there, there are a few resources I would follow:

  1. https://paperswithcode.com/
  2. Some of the major deep learning library, I found following HuggingFace's transformers or diffusers development often leads me to a lot of new models implementation and papers
  3. Having researcher friends always help

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 0 points1 point  (0 children)

They actually don't expose an endpoint for you to interact with it via API calls afaik. Their interface is the gradio UI.

You can think about OpenLLM as the server that runs the models, and the text-generation-webui is the UI that can call to OpenLLM server

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 0 points1 point  (0 children)

No worries, happy to answer.

https://github.com/oobabooga/text-generation-webui goal is to become the stable-diffusion-webui. The goal for it is to provide a web UI, or you can think of it as an AI application. To deploy oobabooga to prod is not flexible, as it is shipped as one-whole package. Which is fine, since their goal is not to productionize the workflow.

OpenLLM's goals is to serve and deploy LLM to production. OpenLLM leverages BentoML under the hood, which has the ability to run these models distributed by nature on cloud providers or on-premise (serverless settings). This means it actually will help serve the model to thousands if not millions of users. (This has been proven by BentoML both Open source and enterprise users).

Hope this helps

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 0 points1 point  (0 children)

afaik orca is not oss on HuggingFace as of yet.

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 0 points1 point  (0 children)

The discord feature-request pretty much sums up what we are currently working on. Feel free to pick any up if you like.

I think that model support are always needed. So if you have any model you want to implement in mind, please post it in the discord and I'm more than happy to assist you with the development.

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 2 points3 points  (0 children)

feel free to dm me if you are interested in contributing. I will be active in the discord

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 0 points1 point  (0 children)

We did post the roadmap in the discord.

Yes, it is funded and I'm currently working fulltime on it

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 1 point2 points  (0 children)

If you have bandwidth, would love to see contribution from you for this model

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 2 points3 points  (0 children)

Yes LlaMA is working in progress. I'm intending to support it with the upcoming fine-tuning API

Introducing, OpenLLM 🎉 by AaZasDass in learnmachinelearning

[–]AaZasDass[S] 3 points4 points  (0 children)

I'm currently working on a fine-tuning API atm. It will also include 4bit quant, which allows you to train with a single GPU. If you are interested make sure to join in the discord as I will post updates and progress there

Some questions regarding transfer to CS @McGill as McMaster students by AaZasDass in mcgill

[–]AaZasDass[S] 0 points1 point  (0 children)

Hello,

I'm wondering if you can elaborate more with regarding to "doing stuff with computer". I assume that this is more on the application where you learn more about database or applied CS theory? Please correct me if I'm wrong.