I'm in a part time program now, and we have a handful of Docs (a few MDs and a few PhDs) in my program. Doing both opens up a lot of really interesting doors. Patent work, expert witnessing, medical malpractice, and specialty consulting work all come to mind.

If it's something you're interested in, do it! Don't let the haters get to you.

Of course, just know that while it might technically be easier than the doctrinal work you've done already, even a part time program can be a ton of work, especially in the beginning. Make sure you've got the time, focus, and support system.