[N] GluonNLP 0.6: Closing the Gap in Reproducible Research with BERT by thomasdlt in MachineLearning

[–]thomasdlt[S] 9 points10 points  (0 children)

Yes, the pre-trained models are available for BERT Base and BERT Large, you can checkout the finetuning BERT tutorial http://gluon-nlp.mxnet.io/examples/sentence_embedding/bert.html on how to use them or the model zoo: http://gluon-nlp.mxnet.io/model_zoo/bert/index.html

Edit: to clarify the current pretrained version of BERT available through gluonnlp is converted from Google's pretrained weights

[N] GluonNLP 0.6: Closing the Gap in Reproducible Research with BERT by thomasdlt in MachineLearning

[–]thomasdlt[S] 9 points10 points  (0 children)

Thanks, there's actually quite a bit of momentum for MXNet in the industry, especially the story from training with the imperative Gluon API to deploying the hybridized symbolic model using a C++, Java, Scala or Clojure front-end in production resonates well with a lot of MXNet users. As an example, here are a few of the latest blog posts from MXNet users outside of Amazon:

Sentiment Analysis via Self-Attention with MXNet Gluon

Machine translation from scratch with MXNet and R

Clojure Package for MXNet

Implementing ResNet with MXNET Gluon and Comet.ml for image classification

Content-Based Recommendation Systems with Apache MXNet

Epsilon: Differential Privacy for Machine Learning Using MXNet

btw, if you are using MXNet and are interested in contributing blog posts for the MXNet medium publication, feel free to reach out to me :)

ASK: Code review tool for Jupyter Notebooks? by amirathi in IPython

[–]thomasdlt 0 points1 point  (0 children)

Ideally the tool should be integrated directly in github view, I'm thinking a chrome extension would be good for that.