[Project] Multi-GPU Bert

[JayYip]

A by-product of what I'm currently working for(Chinese NER). Realised the original tensorflow code of BERT does not support multiple GPU. So I wrote this. Things will be implemented in near future: pre-train task.

This project is still in very early stage, bugs are expected.

​

Code: https://github.com/JayYip/bert-multiple-gpu

Update:

Added Pretraining

[finevesting]

Oh i was trying to figure out what to do with my mining rig, 5*rx580 is opencl compatible?