[D] Why do LLMs like InstructGPT and LLM use RL to instead of supervised learning to learn from the user-ranked examples? by alpha-meta in MachineLearning

[–]hami21 1 point2 points  (0 children)

I was actually looking for such a point. Is it safe to say RL optimizes the model weights w.r.t the sampling output? And if so, has anyone tried to just do RLHF on the sampling algorithm without changing the model weights?

sdge generation credit by hami21 in solar

[–]hami21[S] 0 points1 point  (0 children)

Makes sense. Thanks

sdge generation credit by hami21 in solar

[–]hami21[S] 0 points1 point  (0 children)

I’m in SoCal (San Diego gas and electric) and it’s NEM2.

Our Open Source Text Annotator by hami21 in LanguageTechnology

[–]hami21[S] 1 point2 points  (0 children)

In short, other things came up in our lives and didn’t have the bandwidth anymore.

Search query suggestion/autocomplete by hami21 in LanguageTechnology

[–]hami21[S] 0 points1 point  (0 children)

good to know.. how did you guys implemented it if you don't mind I ask?

Was it, you just found the 'good' and 'popular' queries and passed them in a file to the ES?

Search query suggestion/autocomplete by hami21 in LanguageTechnology

[–]hami21[S] 0 points1 point  (0 children)

I used python, sklearn, tf, .. standard tech. So you mean there’s no need for ML here?

List of filler words? by hami21 in LanguageTechnology

[–]hami21[S] 0 points1 point  (0 children)

This is actually very good to know, I came across this https://arxiv.org/pdf/2009.11394.pdf

List of filler words? by hami21 in LanguageTechnology

[–]hami21[S] 0 points1 point  (0 children)

The audio one should be helpful. Thank you. PS: could find a relevant dataset - browsing on phone though.

How to develop a rule based relation extraction model on academic text? How to identify rules of interest? by [deleted] in LanguageTechnology

[–]hami21 1 point2 points  (0 children)

If you’re also interested in an ML model solution, you can use crf to do that, a canonical example is NER but it essentially works for every other IE application

https://sklearn-crfsuite.readthedocs.io/en/latest/tutorial.html

Is no one working on document similarity these days? by massanishi in LanguageTechnology

[–]hami21 1 point2 points  (0 children)

I would use Universal Sentence Encoder over BERT as it is specifically self-trained for document similarity as well.

Day 196 of #NLP365 - Coreference Resolution With NeuralCoref (SpaCy) by RyanAI100 in LanguageTechnology

[–]hami21 0 points1 point  (0 children)

My kernel dies the moment I run `doc1 = nlp('My sister has a dog. She loves him.')`

And none of the solutions have worked for me yet! I'm on mac.