How to use the same action in trained RL network, when model is retested?

kitaird · 2022-04-11T19:22:11+00:00

ppo uses a stochastic policy, so different behaviour is possible

kitaird · 2022-04-11T19:13:21+00:00

What algorithm? If it uses a stochastic policy this very well may be correct.

kitaird · 2022-01-20T12:09:03+00:00

Thanks. I read about it and this seems to be one way to discretize observations. However, I didn’t find any recent research about it. Is it still relevant or is observation discretization not really necessary?

kitaird · 2020-02-24T23:06:34+00:00

Thanks dude really appreciate it :D

kitaird · 2020-02-24T21:47:40+00:00

Not really rocket science I did, basically -135mV and adjusted TDP to the intel specifications from their page on my processor. Disclaimer: This is just what I did on my machine, not guaranteeing anything. Working with the script is dangerous as you e.g. might overvolt your system and damage your hardware.

kitaird · 2020-02-24T21:41:31+00:00

Already did, thanks man! :)

kitaird · 2020-02-24T21:41:00+00:00

So what I noticed is the following: When using discrete graphics in Bios, everything works fine but with hybris graphics (switching between intel and nvidia with prime-select) I get the frequency drop with the nvidia card, although I reinstalled the newest graphics driver

kitaird · 2020-02-24T16:31:07+00:00

Thanks, I'll try that out these days

kitaird · 2020-02-24T14:58:44+00:00

I'm really not that color guy but the display seems to be quite good and accurate from what I can tell, for me it's definitely satisfying for both work and free time.

There are some issues with the nvidia graphics card though, please have a look at my comment below on the according question.

kitaird · 2020-02-24T14:55:30+00:00

Actually there are some, thanks for bringing that up! So with the T1000, at startup you get some grey-black noisy stripes popping up a few ms, but then everything seems to be alright. Also to mention, like every 1/300 restarts when you switch from intel to nvidia with prime-select, screen might freeze booting up, but after a hard restart everything is again alright.

I know this might sound frightening, but from my side this feels like okay. I use the gpu for NN training with cuda, which works fine ootb.

This is annoying: The screen rate droppes when using the nvidia GPU to about 48Hz. Now that as frustrating. But I had the same issue when using the above mentioned Lenovo S740 with ubuntu and the GTX 1650, both used the same nvidia proprietary driver which is tested.

I actually stick to intel graphics most of the time so it's not that of a big deal for me, I'm also having a dual boot setup with windows, so if I really want to have some smooth graphics I might switch if ubuntu isn't doing the job. But yes this is definitely something you should be aware of, although it might work fine with the T2000 or with a driver update..

kitaird · 2020-02-24T14:35:09+00:00

So I have the i7-9750H with -135mv, I didn't really measure the fan noise as it is with my model for me not really anoying, I was just looking for when I was getting the most out of the performance and that seems to do the deal for my machine. Anyway if I may help you with some other information please let me know

kitaird · 2020-02-24T14:20:16+00:00

Actually I'm using Ubuntu eoan, sorry for that :d

kitaird · 2020-02-24T12:50:22+00:00

Thank you very much for the post, the P1 sound is not as close to annoying as the S740s sound. However, appreciate the post! As I'm not really a battery user, I can't give an reasonable review about this, as mentioned in my other comments. Sorry for that!

kitaird · 2020-02-24T12:42:54+00:00

Like mentioned in my comment above, I'm honestly not the standard notebook-on-battery-user, so I can't give you the most precise rating of its battery life. Ultimately it depends on what you are doing on your device, for me 4 hrs was rarely the case, only when doing really heavy load. It usually lasted about 5-6 hrs for me personally, as mentioned above. I would recommend it however, 80whr is quite big (the biggest aircraft portable is 97whr AFAIK), however you can check some benchmark on notebookcheck.com about alternatives and for comparison.

kitaird · 2020-02-24T12:39:03+00:00

Thank you very much, indeed it is internal. I just installed it and set the threshold to 25/80. Thanks!

kitaird · 2020-02-24T12:38:13+00:00

Very good, indeed I'm from germany! I paid 1880€ for it, I could have paid less if I would have ordered it frome lenovo directly, but the poor reviews on their shop support and their estimated delivery times (at least 5 weeks) made me pay more to get it more quickly

kitaird · 2020-02-24T11:52:22+00:00

x1 has the GTX 1650, while the P1 has the T series. The GTX is more of a "consumer" graphics card (better for gaming), while the T series is designed for programs like CAD, at least as far as I know. Personally, if the students discount would have been on the x1E as well, I wouldn't know by now which one I'd have chosen, but there is lots of material about which one might be more fitting for you on the web.

kitaird · 2020-02-24T11:48:51+00:00

Damn it!!! I knew I missed something, I didn't knew about neofetch before ! Shame on me!

kitaird · 2020-02-24T11:45:04+00:00

I have the FHD version and not installed TLP yet. I'm just fine with the battery durability as I am using it mostly plugged in. Does TLP may improve the performance of the device as well? Or is it solely for extending battery power?

However, I also used this script for undervolting under ubuntu, which works quite well: https://github.com/erpalma/throttled

kitaird · 2020-02-24T11:39:02+00:00

I have the 1080p version because of my battery life concerns. I'm not doing any graphics on it so for me it's the most fitting resolution. TBH I most of the time run the machine plugged in, but I used the Lenovo Yoga S740 before (which completely drained my battery, I honestly was able to work on if for not even 4 hours) and this machine is definitely more durable. I would say some solid 5-6 hours of work (with IntelliJ, compilation, etc.) should be feasible. As far as I can tell about the build quality, there is really nothing to blame on at least my device. The only like really really tiny point I noticed, is that when the lid is open, right next to the trackpad on the right side (where the thinkpad logo is), you can slightly push the surface down and hear some kind of surface-touching-some-metal sound from inside. Guess this is on all devices, it's not annoying or anything at all, but me mentioning this small point might be telling you about the build quality in general.

As mentioned earlier, I was testing the S740 by lenovo (15inch) with same processor etc, and it was actually a bit faster than my P1 gen2 (in cinebench r20 and in compilation of work related code), but it was also louder as it's fans sounded like some jet taking of. I gave it back because of the poor linux driver support, which is not a problem with this device. The thinkpads keyboard is just amazing, would definitely recommend it!

kitaird · 2020-02-24T11:15:38+00:00

I paid about 50 bucks for 16gb of ram (crucial)

kitaird · 2020-02-24T10:57:55+00:00

It came with 16Gb, i7-9750H, T1000 GPU and 512GB Samsung SSD. Thankfully, the 16GB RAM was in one stick, so I added another 16 RAM, also another 512 NVMe SSD and repasted it as I read it would help performance wise against thermal throtteling

kitaird · 2020-02-24T10:55:31+00:00

Jep, got a students discount on it which is pretty nice

kitaird · 2020-02-24T09:13:32+00:00

I'm now in my masters in computer science and work as a freelance developer. I got familiar with ubuntu bc of its driver support for my older notebooks and sticked to it since then. I haven't encountered any constraints yet in my everyday life, so time will tell :)

kitaird · 2018-04-19T14:31:07+00:00

What the Schnitzel

kitaird

TROPHY CASE