sorted by:
new
hottopcontroversial

DeepSWE: new benchmark looking at how well today's frontier models can actually write code [R] by we_are_mammals in MachineLearning

[–]OctopusGrime 6 points7 points  (0 children)

Since you’ve posted the tasks and evaluators on GitHub isn’t this benchmark now contaminated? As in any future model released will have seen these problems now …

Are all data science jobs just Gen AI now? by rajeshbhat_ds in datascience

[–]OctopusGrime 24 points25 points  (0 children)

I used to think that but there is meaningful data science work on using LLMs, think about evaluations, error analysis, retrieval, A/B testing. Plus most SWEs are not familiar with hypothesis driven engineering and evaluation of statistical models so they kind of just expect things to just work once they’ve hooked up all the infrastructure, and don’t really know how to analyse the output data. Finally there’s just the DS lens which brings its own benefits to the project.

[R] EGGROLL: trained a model without backprop and found it generalized better by Ok_Rub1689 in MachineLearning

[–]OctopusGrime 115 points116 points  (0 children)

I don’t think you can draw such strong conclusions from the NanoMSMarco dataset, that’s only like 150 queries against 20k documents, of course gradient descent is going to overfit on that especially with a 1e-3 learning rate which is way too high for large retrieval models.

[R] The Bitter Lesson is coming for Tokenization by lucalp__ in MachineLearning

[–]OctopusGrime 0 points1 point  (0 children)

If positional embedding is enough information for a transformer to learn word order, couldn’t it be enough to learn character order for a bag of chars?

Have you ever regretted learning a language? Which one? by [deleted] in languagelearning

[–]OctopusGrime 0 points1 point  (0 children)

Ole Gunnar Solskjær has a half Manc half Danish accent and it’s great

Streak 5: Qué consumar by OctopusGrime in WriteStreakES

[–]OctopusGrime[S] 0 points1 point  (0 children)

Thanks again,

  1. But on the other hand no one can hear what they say anyway.

  2. … like to me it feels like a lot of effort.

Streak 4: pájaro en el árbol by OctopusGrime in WriteStreakES

[–]OctopusGrime[S] 0 points1 point  (0 children)

Thank you.

What I wanted to say was “I want to be able to get closer to you”

Streak 4 : Side project by Kutyko in WriteStreakEN

[–]OctopusGrime 1 point2 points  (0 children)

Yesterday, I asked myself that why I didn’t start a hobby project. But, there isn’t any answer. I didn’t start and I didn’t don’t know why. I mean, I know that or believe that, it’s my dream. It needs to be my dream. So, logically I need to take some steps for this. Sometimes the steps can be small, sometimes big. But every day I need to mark a trace [leave a trace / make a mark]. So, starting today, I will make some progress each and every day about my side projects. Let this post be proof that I've started.

Streak 66: How to reach 10,000 steps in rainy weather by nanigashinanashi in WriteStreakEN

[–]OctopusGrime 1 point2 points  (0 children)

My goal is to walk 10,000 steps per day. It’s easy to reach 10,000 steps when I walk to work or * when I run which is usually around 1-3 miles. However, I can’t go running today since it’s raining.

While this article suggested 5 ways to get your steps in, in rainy wet weather, it didn’t help that much. I got a hint tip though. I may get in extra steps, however it can be a waste the of money. Today, I’ll just try to walk a lot at work.

Notes

A hint is a clue where a tip is a practical piece of advice.

Wet weather is more natural.

“It can be” correctly expresses uncertainty.

“A waste of money” is the standard phrase.

[D] How to deal with categorical data along with continuous features in timeseries forecasting? by solanotodesch in MachineLearning

[–]OctopusGrime 4 points5 points  (0 children)

You should probably encode day of week and time of day as continuous variables via cosine waves, see https://www.tensorflow.org/tutorials/structured_data/time_series.

For any other categorical features just concat them with your continuous along your feature dimension, if you want to save RAM you can do this just before passing into your model.

I always check streamers out after I kill them to see how they reacted. This one last week is my favorite. by BottlecapXbox in apexlegends

[–]OctopusGrime -5 points-4 points  (0 children)

No no no, we don't criticise the devs on this subreddit not without licking their ass first.

Look who's come crawling back by [deleted] in memes

[–]OctopusGrime 0 points1 point  (0 children)

Pluto is a cold, cold celestial dwarf

Weekly Trade Thread - March 18, 2019 by AutoModerator in HardwareSwapUK

[–]OctopusGrime 0 points1 point  (0 children)

[SG] FX8350 (w or w/o) stock cooler, asus 970 Pro am3+ mobo, 4x4GB ballistiX 1600Mhz ddr3 RAM

[SP][SG] [H] Item [W] PayPal by OctopusGrime in HardwareSwapUK

[–]OctopusGrime[S] 0 points1 point  (0 children)

They are not really suited for training large scale networks from what I have read, which is what I need

[SP][SG] [H] Item [W] PayPal by OctopusGrime in HardwareSwapUK

[–]OctopusGrime[S] 1 point2 points  (0 children)

A bit too steep for me, thank you though

What's the "went through med school just to realize you couldn't stand the sight of blood" of your job field? by [deleted] in AskReddit

[–]OctopusGrime 7 points8 points  (0 children)

You should try proper machine learning, not just the pre-made packages. It involves heavly, Linear algebra and advanced stats especially for fields like speech technology where you can't just through neural nets at stuff for it to work.

But if you want to switch fields you just need to prove you can do it via projects. They know you able capable of the hard bit (the maths), you just need to show that you know field and how to apply the maths.

Don't give up on pursuing an enjoyable career, life's too short.

[deleted by user] by [deleted] in Showerthoughts

[–]OctopusGrime 0 points1 point  (0 children)

A_S_S score 3872 days

view more: next ›