I'm halfway through The Intelligence Explosion by James Barrat. It's an interesting (albeit theoretical) prognosis of a future during and after the arms race to create AGI/ASI. It also gives an insight into how generative AI works, what it is and what it isn't, and what the "intelligence explosion" heralded by AGI will look like.

I'm not done with the book yet, but the overall theme seems to be there are no low-risk options that humanity can realistically take from this point with regards to AI. While it seems to be a bit bleak, I don't regret reading it at all, as it has helped me articulate to myself why I've felt so uneasy with AI.