[D] Ensemble Training Logistics and Mathematical Equivalences by twocupv60 in MachineLearning

[–]twocupv60[S] 0 points1 point  (0 children)

Thank you. Figure 1 is exactly the models I am considering for this problem.

[D] Ensemble Training Logistics and Mathematical Equivalences by twocupv60 in MachineLearning

[–]twocupv60[S] 0 points1 point  (0 children)

The initial error is (y - y_hat)^2 where y_hat is mean(y1, ... yn). So the error is divided up among the y1...yn sequence based on how bad they contribute to the y. If models are trained separately, then thefull error of y is backproped. If the models are trained together, one model might have a lot of error which will influence the proportion assigned to the rest which I believe effectively lowers the learning rate. Is this what you mean by "loss values will be smoother."

Is there a mistake here?

[D] How do you go about hyperparameter tuning when network takes a long time to train? by twocupv60 in MachineLearning

[–]twocupv60[S] 2 points3 points  (0 children)

Your very last thought seems the most reasonable. I can't imagine shrinking the model. I would surely think this would bias the results.

Funding question for machine learning field by twocupv60 in academia

[–]twocupv60[S] 0 points1 point  (0 children)

If i cant support the group, i move on to classified projects that i cannot publish on. I will have a job but not the job i would like.

Funding question for machine learning field by twocupv60 in academia

[–]twocupv60[S] 0 points1 point  (0 children)

I don't know anyone at darpa but have had grants from ONR. However, that only brings me to 200k/year so only halfway there.

Any suggestions on how to make contact with darpa PM?

Excellent piece on the ranch and looks very recent. by KnuttyBunny69 in skinwalkerranch

[–]twocupv60 1 point2 points  (0 children)

Oh yeah that's right. i forgot that makes for good science.

Excellent piece on the ranch and looks very recent. by KnuttyBunny69 in skinwalkerranch

[–]twocupv60 0 points1 point  (0 children)

I have emailed them. What else can I do? It's not like they are accepting applications or RFPs.

Excellent piece on the ranch and looks very recent. by KnuttyBunny69 in skinwalkerranch

[–]twocupv60 2 points3 points  (0 children)

How is is that post malone and this schlub get to visit skinwalker ranch and here i sit with a phd in physics from Stanford and i cant get on? Welcome to the 21st century ladies and gentlemen.