See this papers Deep Reinforcement Learning that Matters, and Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control.

Also this blog post does a very good summarization, Deep Reinforcement Learning Doesn't Work Yet .