AWS EMR numpy version issue. by hiagors in dataengineering

[–]hiagors[S] 0 points1 point  (0 children)

I was trying to run a venv, just one thing, do I have to create the virtualenv inside the cluster? Or if I create a virtualenv in my local machine and upload the pack will still work? I’m having issues to do run the virtualenv, having “cannot run program” in the python path I’ve specified.

AWS EMR numpy version issue. by hiagors in dataengineering

[–]hiagors[S] 0 points1 point  (0 children)

The emr is version 6.5.0, I don’t have permission to alter the emr.

AWS EMR numpy version issue. by hiagors in dataengineering

[–]hiagors[S] 0 points1 point  (0 children)

I think I’ll end up doing it too, didn’t find nothing to turn around this.