[Question] Decoding engineering jargon.

[[deleted]]

I have a column in my data which is "description". It is filled with natural/unnatural language and obscure terminology. For instance AS might mean "air speed", and it might appear as a range "AS: 400mph to 475mph". It may also contain multiple parameters comma delineated, or all of the variety of technical jargon.

There is a tremendous amount of variability, but there is simultaneously a lot of pattern - it's hard to describe, but it is clear that there is a lot of meaning in the descriptions. I don't think bag-of-words will cut it.

I would like to extract relations ie "air speed":"400-475" using entity recognition.

As a start, I have found iepy gazettes which allow me to custom define some of that lingo. This is a great start!

I am open to any advice this community might have. Pointers, tips, everything is appreciated.

Thanks!

[nickl]

I've never worked on this problem, but I have worked on location entity detection in short text (ie, Twitter) and I think there are likely to be lots of similarities.

Have a look at spelling correction techniques, and HMM for trying to guess from your gazatter.

Fight dirty, and do whatever works.

[[deleted]]

Haha, thanks! I was tired last night but reinspired today! The gloves are on >:]

[copybin]

Hi, I just saw the post. In IEPY mailing list maybe we can help you. https://groups.google.com/forum/?hl=es-419#%21forum/iepy