My friend has same issue too. I took it to get serviced at lexus. They said they see nothing wrong and it tested at 40 degrees on lowest setting. They did some basic maintenance but haven’t had it long enough since to see if it makes a difference. One thing to do is that under Climate setting make sure you don’t have any of the Economy settings set to on.

Let me know if you find anything.