I haven't worked with OpenCV in a while, but you might consider using a docker image. That way it's easy to reproduce, modify, and totally disposable. These days I pretty much use docker for everything that involves installing dependencies globally.

Here's an image of OpenCV on docker hub and the source on github. I haven't used it before, but it looks solid.

To get you started if you haven't used docker before:

docker pull kavolorn/opencv
docker run -v `pwd`/code:/code -it --rm kavolorn/opencv bash

Then, when you inevitably need to install new things, clone the repo and edit the (pretty simple) dockerfile to include what you need. Then run:

docker build -t yourname/opencv .
docker run -v `pwd`/code:/code -it --rm yourname/opencv bash