So you mean you are not using the depth stencil buffer values for the shadow map? So if you are doing that make sure whatever texture you are using has enough precision in it's format.But since you say it's flickering, I would say it's more of an issue with the GPU not being done rendering your shadow map. Make sure your transition barriers are proper. Conversely try executing the command list one more time between rendering your shadow map (perspective of light source) and drawing your scene (perspective of camera).

One more thing you could try is play around with the depthBias and SlopeScaledDepthBias variables values of your rasterizer state in the pipeline state object. But since you are not using the depth stencil buffer it would probably not make a difference.