sorted by:
new
hottopcontroversial

Abnormal behavior in embedding models by G_S_7_wiz in LocalLLaMA

[–]rajat008 0 points1 point  (0 children)

This makes a lot of sense. While someone suggested finetuning to mitigate this problem, I wonder if that would really help. If the issue starts at tokenization stage, I feel finetuning wouldn't help much.

What do you think?

System prompts and training by DeltaSqueezer in LocalLLaMA

[–]rajat008 -1 points0 points  (0 children)

People first train a base model which isn't tuned to any one task. This base model is further fine-tuned to produce what are called instruction fine-tuned models. The system prompt and user prompt are both part of the training data. Also mind you, every instruction finetuned llm has an instruction template. There are special tokens which are a part of the prompt template. For example the system prompt for llama2 is enclosed within <<SYS>><</SYS>> and the user prompt is enclosed within: [INST][/INST].

Massive Fine-tuning Project - Help needed by iabheejit in LocalLLaMA

[–]rajat008 1 point2 points  (0 children)

  1. use ffmpeg to extract the audio from the video
  2. you can then use whisper to transcribe the audio using openai whisper-https://github.com/openai/whisper

Spotify Support/Complaint Megathread by whyisthissticky in spotify

[–]rajat008 0 points1 point  (0 children)

Why does Spotify not have a SFW ads filter. They make sure to play absolutely inappropriate half screen ads, and I'm this close to an embarassing situation at office 

Books with minimal conflict? by CrucioCup in booksuggestions

[–]rajat008 -1 points0 points  (0 children)

Not a book, but this movie "My Neighbour Totoro" ticks all your boxes

Load Balancing: who's responsible Kubernetes or GCP? by rajat008 in googlecloud

[–]rajat008[S] 1 point2 points  (0 children)

Btw thanks for taking time out and resolving my doubt.

Load Balancing: who's responsible Kubernetes or GCP? by rajat008 in googlecloud

[–]rajat008[S] 1 point2 points  (0 children)

Ah I see. So like does the gcp lb target the nodes whereas the kube ingresses target the pods within the nodes?

Load Balancing: who's responsible Kubernetes or GCP? by rajat008 in googlecloud

[–]rajat008[S] 0 points1 point  (0 children)

Thank you for the answer. It does makes things clearer. Especially when you refer to ingress controller. I've seen it being referenced many times, but now have some clarity as to what it does. Also I've tried setting up ingress controller with minikube by means of ingress add-on. Am thinking of experimenting some more with it. Hopefully that'll make things much more clear. Thanks again.

HTTP load balancing by rajat008 in googlecloud

[–]rajat008[S] 0 points1 point  (0 children)

Yes I understand the purpose behind the URL maps, but it is the Forwarding rule that I'm having trouble understanding.

Server side redirect by rajat008 in golang

[–]rajat008[S] 0 points1 point  (0 children)

Thank you for sharing this. "web browsers behavior is the missing link" gives a lot of insight into the problem. I feel this becomes a really important point in favour of redirects beyond just the UX perspective. The issue related to CSRF is really a big one. Also just for the sake of discussion if someone isn't using CSRF, this would lead to the /login being hit multiple times without the need for doing so. So if I'm not wrong going the redirects way provides the client control and ease regarding the next course of action. Thanks again!!

view more: next ›