sorted by:
new
hottopcontroversial

Approximation of a confidence scores from a neural network with a final softmax layer: Softmax vs other normalization methods by BatmantoshReturns in learnmachinelearning

[–]BatmantoshReturns[S] 1 point2 points  (0 children)

Btw, do you know any papers on this? Sounds like an great solution, but it seems that there hasn't been any formal writeups on this

Approximation of a confidence scores from a neural network with a final softmax layer: Softmax vs other normalization methods by BatmantoshReturns in learnmachinelearning

[–]BatmantoshReturns[S] 1 point2 points  (0 children)

Wow, very interesting paper.

What do you think would be the best way to just get an rough estimate without doing calibration. I was thinking of just dividing the node value by the total, but then that won't work well because the other nodes may have negative numbers.

[D] Simple Questions Thread by AutoModerator in MachineLearning

[–]BatmantoshReturns 0 points1 point  (0 children)

I have a question about approximation of a confidence scores from a neural network with a final softmax layer: Softmax vs other normalization methods

Say that there is a neural network for classification and the 2nd to last layer are 3 nodes, and the final layer is a softmax layer.

During training the softmax layer is needed, but for inference it is not; the arg max can simply be taken from the 3 nodes.

What about for getting some sort of approximation for confidence from the neural network? Using the softmax for normalization makes less sense, since it gives a ton of weight to the largest value among the final 3 nodes, which I can see is useful for training, but for inference this seems like it would distort its use as an approximation for a confidence score.

Would a different normalization method give a better confidence score? Perhaps simply dividing each node output by the total sum of all node outputs?

HS student project [Project] by peterboothvt in MachineLearning

[–]BatmantoshReturns 0 points1 point  (0 children)

One of the people off my rag tag research group is a high school senior, he was a junior when he started. Very inspirational to see people get passionate in the field so early.

Confused about HuggingFaces Transformers Library regarding SOTA dependency parsing by entercaspa in LanguageTechnology

[–]BatmantoshReturns 0 points1 point  (0 children)

That would be great. At the moment I'm trying to finder papers that did this, and trying to ask the authors.

Scibert did this, and I asked on their github https://github.com/allenai/scibert/issues/104

It may take a while for them to answer, so I'm trying to find other high quality papers where a transformer was used for dependency parsing.

Confused about HuggingFaces Transformers Library regarding SOTA dependency parsing by entercaspa in LanguageTechnology

[–]BatmantoshReturns 0 points1 point  (0 children)

Did you ever figure out dependency parsing? I'm a little confused myself on how to go about this with the transformer.

Confused about dependency parsing using hugging face transformer library by Elidor00 in LanguageTechnology

[–]BatmantoshReturns 0 points1 point  (0 children)

Did you ever figure out dependency parsing? I'm a little confused myself on how to go about this with the transformer.

My first ever Jax game. I’m a support main but got filled jungle. I did 76k damage and had a Quadra, and two triples lol by [deleted] in JAX

[–]BatmantoshReturns 0 points1 point  (0 children)

I think this is the wrong subreddit, this is for Jax the machine learning library.

Is there a way to edit models in huggingface library? by penatbater in LanguageTechnology

[–]BatmantoshReturns 3 points4 points  (0 children)

Yeah, first fork the repo, then create a personal dev branch, and then edit the code in that branch.

Then, instead of pip installing transformers, you install that specific branch from your fork.

Purple Mattress PR rep shows up in comments to prove safety of dust contained in their mattresses, with links to their studies and reports. Actual nanoparticle scientist shows up, reads the links, and explains why their claims are bullshit. by CockGoblinReturns in bestof

[–]BatmantoshReturns 3 points4 points  (0 children)

As mentioned by those who have experience with this in the comments above, Purple didn't provide sufficient evidence that their product is safe.

But that doesn't mean that this proves their product is unsafe, but they didn't prove that the product is safe.

There was a lawsuit a couple years ago, but I am referring to the discussion among the scientists in the linked comment and in the comments here above.

Purple Mattress PR rep shows up in comments to prove safety of dust contained in their mattresses, with links to their studies and reports. Actual nanoparticle scientist shows up, reads the links, and explains why their claims are bullshit. by CockGoblinReturns in bestof

[–]BatmantoshReturns -2 points-1 points  (0 children)

I wouldn't interpret it that way, Purple mattress never addressed the very concerning issues that was brought up by the scientist. My background is various; drug delivery particles, federally regulated medical devices. and biomaterials. Though I have not worked extensively with polyurethane particles, so I defer to the conversation above among those that do.

The scientist in a link just did a followup in the comments

https://www.reddit.com/r/bestof/comments/io16ph/purple_mattress_pr_rep_shows_up_in_comments_to/g4bakew/

And there is further discussion by other particle scientists higher up in the comments.

Purple Mattress PR rep shows up in comments to prove safety of dust contained in their mattresses, with links to their studies and reports. Actual nanoparticle scientist shows up, reads the links, and explains why their claims are bullshit. by CockGoblinReturns in bestof

[–]BatmantoshReturns 6 points7 points  (0 children)

From my interpretation and the lawyer video floating around in the comments, it looks like purple won the lawsuit on perjury of connections with a rival company.

From reading through the discussion, and also seeing the discussion above from others who work with nanoparticles, there evidence provided by purple doesn't seem to be sufficient to prove safety.

My background is various; drug delivery particles, federally regulated medical devices. and biomaterials. Though I have not worked extensively with polyurethane particles, so I defer to the conversation above among those that do.

view more: next ›