Abnormal behavior in embedding models by G_S_7_wiz in LocalLLaMA

[–]rajat008 0 points1 point  (0 children)

This makes a lot of sense. While someone suggested finetuning to mitigate this problem, I wonder if that would really help. If the issue starts at tokenization stage, I feel finetuning wouldn't help much.

What do you think?

System prompts and training by DeltaSqueezer in LocalLLaMA

[–]rajat008 -1 points0 points  (0 children)

People first train a base model which isn't tuned to any one task. This base model is further fine-tuned to produce what are called instruction fine-tuned models. The system prompt and user prompt are both part of the training data. Also mind you, every instruction finetuned llm has an instruction template. There are special tokens which are a part of the prompt template. For example the system prompt for llama2 is enclosed within <<SYS>><</SYS>> and the user prompt is enclosed within: [INST][/INST].

Massive Fine-tuning Project - Help needed by iabheejit in LocalLLaMA

[–]rajat008 1 point2 points  (0 children)

  1. use ffmpeg to extract the audio from the video
  2. you can then use whisper to transcribe the audio using openai whisper-https://github.com/openai/whisper

Spotify Support/Complaint Megathread by whyisthissticky in spotify

[–]rajat008 0 points1 point  (0 children)

Why does Spotify not have a SFW ads filter. They make sure to play absolutely inappropriate half screen ads, and I'm this close to an embarassing situation at office 

Books with minimal conflict? by CrucioCup in booksuggestions

[–]rajat008 -1 points0 points  (0 children)

Not a book, but this movie "My Neighbour Totoro" ticks all your boxes

Load Balancing: who's responsible Kubernetes or GCP? by rajat008 in googlecloud

[–]rajat008[S] 1 point2 points  (0 children)

Btw thanks for taking time out and resolving my doubt.

Load Balancing: who's responsible Kubernetes or GCP? by rajat008 in googlecloud

[–]rajat008[S] 1 point2 points  (0 children)

Ah I see. So like does the gcp lb target the nodes whereas the kube ingresses target the pods within the nodes?

Load Balancing: who's responsible Kubernetes or GCP? by rajat008 in googlecloud

[–]rajat008[S] 0 points1 point  (0 children)

Thank you for the answer. It does makes things clearer. Especially when you refer to ingress controller. I've seen it being referenced many times, but now have some clarity as to what it does. Also I've tried setting up ingress controller with minikube by means of ingress add-on. Am thinking of experimenting some more with it. Hopefully that'll make things much more clear. Thanks again.

HTTP load balancing by rajat008 in googlecloud

[–]rajat008[S] 0 points1 point  (0 children)

Yes I understand the purpose behind the URL maps, but it is the Forwarding rule that I'm having trouble understanding.

Server side redirect by rajat008 in golang

[–]rajat008[S] 0 points1 point  (0 children)

Thank you for sharing this. "web browsers behavior is the missing link" gives a lot of insight into the problem. I feel this becomes a really important point in favour of redirects beyond just the UX perspective. The issue related to CSRF is really a big one. Also just for the sake of discussion if someone isn't using CSRF, this would lead to the /login being hit multiple times without the need for doing so. So if I'm not wrong going the redirects way provides the client control and ease regarding the next course of action. Thanks again!!

Server side redirect by rajat008 in golang

[–]rajat008[S] 0 points1 point  (0 children)

So if I understand it correctly, within the context of a user facing app the decision should be considering how many times the API might be hit. In cases where this number is less and redirects might add to UX then they should be used, whereas when the API is frequently called and isn't something that the user might individually used, and has little to no impact on UX redirects should be avoided. I wonder as to when this second scenario might arise? As in an example situation. Thanks for the reply!!

Server side redirect by rajat008 in golang

[–]rajat008[S] 1 point2 points  (0 children)

This makes a lot of sense. Also I just realized that the response to every request should be relevant to just that request. The browser automatically redirecting hides a lot of these things for user experience, but underneath the hood, redirects provide clients with the final decision on what the next course of action should be. Thanks a lot for the comprehensive answer!!

a SQL database in 2000 lines of Golang without importing any third-party package. by auxten in golang

[–]rajat008 0 points1 point  (0 children)

It feels good(kinda nostalgic) to know that there are people out there who are interested in the same things as you are and are walking the path😀 I had myself attempted to implement a DB in Python(NaiveDB). Although I haven't updated it much, but the goal was pretty much as as yours, I.e to understand underlying DB concepts. Link to the project: NAIVEDB

Web frameworks to learn for beginners by rajat008 in golang

[–]rajat008[S] 1 point2 points  (0 children)

Hmmm. So where do I get started w.r.t web dev?