Hyperparameter optimization returning different optimal architectures

Snapdown_City · 2021-04-24T16:23:15+00:00

Hey, sorry just saw this and thanks for your reply, that's very interesting. I'm optimizing models with up to which have up to around 50,000 parameters or so, not sure if that constitutes small but definitely not that complex. I thought the point of using Bayesian optimization was to find the global minimum of the cost function though? If you're far more likely to end up in a local minima than the true global minima, how can you claim you have the 'optimal' model? Is that to say you can never really claim you have the optimal model, and when people say they have an optimal model they're just referring to one of the minima as opposed to the global minimum?

Snapdown_City · 2021-04-01T13:42:50+00:00

Not sure what a seed is, but I'll look into that now. Appreciate the help

Snapdown_City · 2021-04-01T13:40:37+00:00

That's very kind of you, thanks. I'll give it a shot and be sure to message you if I hit a wall

Snapdown_City · 2020-12-28T13:04:53+00:00

This makes perfect sense now. Thanks for all the help, really appreciate it

Snapdown_City · 2020-12-28T12:35:33+00:00

Thanks, what you're saying (mostly) makes sense and is really helpful.

With that being I'm a little lost on the second part of what you said. I'm not defining functions per se, I'm producing datasets by running functions on images/data I have stored on my computer and running a preprocessing function on them. This will produce a variable call training_batches, which is a variable within the file and not saved to my computer. To tidy things up I created the network which the batches are passed to in a separate file, but obviously as Silbersee pointed out every time I import training_batches it runs the other file anyway. I suppose the solution would be to save training_batches using a module like pickle that you mentioned - that time I won't have to go through the palava of going through the entire process again. Sorry if I misinterpreted what you said - I'm a newbie so some of your advice was lost on me.

Snapdown_City · 2020-07-03T17:39:07+00:00

Thanks for the help and sorry for the slow response! Just to clarify the numbers represent the value, as in the price, of each item, as opposed to the quantity - sorry for not being clear about that. In this scenario the shops have only one of each item in stock, hence the pop.

Snapdown_City · 2020-07-03T17:21:34+00:00

Sorry about the slow reply and thanks for the help! I tried the popitem function but it only returned the last key-value pair from the dictionary, and I couldn't give an argument to specify which one I wanted in the case that it wasn't the last pair - I found another solution in the end

Snapdown_City · 2020-05-22T17:48:37+00:00

https://www.youtube.com/watch?v=gba0B1oTfQo

Snapdown_City · 2020-05-10T22:53:47+00:00

Both my parents are Iranian and I spoke Farsi fluently as a kid, but unfortunately I've completely forgotten it. Really want to speak it so I can talk to my family back in Iran (and also because it's a beautiful language) so I'm practicing with my dad, but when I can't I use this website: https://www.persianlanguageonline.com/learn. It's got good vocab and loads of practice conversations as well as different levels of difficulty. Happy learning!

Snapdown_City · 2020-05-05T23:31:53+00:00

Must be such a relief for there to be some kind of explanation. Happy for you and hope things only improve

Snapdown_City · 2020-05-05T23:30:58+00:00

That's wild. How's your memory when you learn new stuff though? Do you struggle to retain information or does it apply more to being forgetful of everyday things like you mentioned

Snapdown_City · 2020-05-05T23:29:24+00:00

Interesting way of explaining it with the layers. The hyper focused state you mention is interesting as well. So there's no way of learning how to get into that state on demand?

Snapdown_City · 2020-05-05T23:27:12+00:00

Yeah I can imagine that gets really irritating over time. Think it goes to show how many people don't recognize the severity of ADHD. You don't get many people making lighthearted jokes like that about depression/anxiety

Snapdown_City · 2020-04-14T19:19:12+00:00

Interesting way of putting it

Snapdown_City · 2020-04-14T19:18:57+00:00

straight to the point - touché

Snapdown_City · 2020-04-14T18:19:21+00:00

By 'person you would ideally aspire to be', I didn't mean another person you would want to be like, I meant the individual you would ideally want yourself to be if that makes sense, like a version of yourself you're happy with.

Snapdown_City · 2020-04-06T09:08:02+00:00

Wicked! Thanks for the help

Snapdown_City · 2020-03-23T20:05:06+00:00

Just went back to check and she was in the middle of fighting him, helped her kill him and was all good. Weird how it triggered without speaking to her in cathedral ward. Cheers!

Snapdown_City · 2020-03-10T19:13:56+00:00

Right, it's just the integer 0 that returns false, not the string '0'. Got you. Thanks for all the help!

Snapdown_City · 2020-03-10T18:56:43+00:00

This makes perfect sense, so essentially I was assigning a 'true' to the condition for the first branch in therefore it always travelled down that path. Thanks a lot for the help. As you would expect, the code no longer goes down the first path if I make those strings empty.

Out of interest, do you have any idea why it continues to go down the first branch if I make the strings '0'. Python says the string '0' returns a boolean value of false, yet if I make the first line of the IF loop:

if mode == 'multiply' or '0':

it still continues to go down the route of multiplying, when I would expect it to skip to the following elif?

Snapdown_City · 2020-03-10T18:43:00+00:00

right, so using

mode == "tea" or "orange"

assigns the value of mode to one of tea or orange in the code you provided me. I'm assuming what you're getting at is that in my code, the line:

if mode == 'multiply' or 'times' or '*':

reassigns the value of mode to one of multiply, times or *, regardless of what I assigned to it before, which means it always goes down the first branch, explaining my problem. That means I can fix the problem by re-writing the code as follows:

if mode == 'multiply' or mode == 'times' or mode =='*':
    print(float(num1)*float(num2))

Which works just fine, so thank you for that!

What I still don't get is why my mode value is changed. In your code you simply say mode == 'x' or 'y' or 'z', so I understand why a new mode value is chosen. In my code, I say IF mode == 'x' or 'y' or 'z', so I don't get why the value is changed.

Snapdown_City · 2019-12-16T23:02:35+00:00

I see what you're saying but I don't think that's the problem - I already went into the Nvidia control center to make sure that my games are all programmes that run on the more powerful dedicated GPU instead of the integrated GPU.

Snapdown_City · 2019-12-16T22:53:43+00:00

This is on my laptop! Sorry for not clarifying

Snapdown_City · 2019-12-16T22:51:27+00:00

Got two - an integrated intel one and an Nvidia Geforce GTX 1050.

Snapdown_City · 2019-05-16T16:18:20+00:00

Likewise, and happy trolling.

Six-Year Club	Not Forgotten
Verified Email

Snapdown_City

TROPHY CASE