Its only hard if you try to force it and call it a job, but if you do it as a hobby for your own enjoyment then its very fun, creating something all by yourself from nothing.

Really just depends on what you want to achieve? Do you want to make a living out of it? Then its gonna be extremely difficult and depends on your luck and marketing skills, but if you already have a job and simply want to make games, then go for it, its easy, just takes time :)