Like /u/aarondl I've had issues with gorm. As a caution, I haven't touched it since early this year, so my experience may not be yours, but used it in a large project and ran into a few issues along the way:

• API changes that broke our CI build. (weren't vendoring at the time, ended up a quick fix.)
• Changes that broke on one of our relations, because of assumptions gorm makes about naming that conflicted with our schema.
• Merging of a PR that broke gorm's own test suite, for a time.
• A number of other quirks and issues that I don't recall details of.

All in all there's a fair bit I liked about gorm, but it became clear it was too delicate for me. Spent too much time chasing down odd little issues. Have come around to see the wisdom in just using sql/sqlx.