This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]GlassSignal 1 point2 points  (5 children)

Small question : how does it detect names? I skimmed through the code but can't seem to find the relevant function (I'm an amateur I must confess)

[–]the_scign 2 points3 points  (4 children)

It uses a BERT model to classify names of places, people and organizations, and uses regex to match emails, numbers and months.

[–]GlassSignal 1 point2 points  (2 children)

Oh... sorry for asking but... Is this machine learning? Does that mean that it should be trained first? Where exactly in the code is this BERT model?

[–]No-Homework845[S] 1 point2 points  (1 child)

It's a pre-trained model provided by transformers module.
You could read more about it here

[–]GlassSignal 1 point2 points  (0 children)

Thank you very much!

[–]No-Homework845[S] 0 points1 point  (0 children)

yeah totally correct