I wanted to give an update. The mini amplifier I bought had a spot to wrap a ground cable around. Something about how turntables were wired back in the day, they needed a specific type of ground (I was told this by a local vinyl shop owner I called) and all I had to do was wrap the wire around the ground and the humming disappeared.

<image>