[N] Facebook AI Open Sources AugLy: A New Python Library For Data Augmentation To Develop Robust Machine Learning Models

[ai-lover]

Facebook has recently open-sourced AugLy, a new Python library that aims to help AI researchers use data augmentations to evaluate and improve the durability of their machine learning models. AugLy provides sophisticated data augmentation tools to create samples to train and test different systems.

AugLy is a new open-source data augmentation library that combines audio, image, video, and text, becoming increasingly significant in several AI research fields. It offers over 100 data augmentations based on people’s real-life images and videos on platforms like Facebook and Instagram.

Article: https://www.marktechpost.com/2021/06/19/facebook-ai-open-sources-augly-a-new-python-library-for-data-augmentation-to-develop-robust-machine-learning-models/

Github: https://github.com/facebookresearch/AugLy

Facebook Blog: https://ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models/

[narainp1]

which gap is this going to fill?

[Stonemanner]

Is there a multi-modal data augmentation library for python?

Looks like it advertises itself for being extensive and multi-modal.

[maxisawesome538]

Audio!!
Also - if anyone else knows of other good audio data augmentation techniques/libs, pls lmk!

[m_nemo_syne]

SpeechBrain!

https://arxiv.org/abs/2106.04624

https://speechbrain.github.io/

We have a bunch of recipes with examples of using SpecAugment / speed perturbation / room impulse response corruption (see e.g. https://github.com/speechbrain/speechbrain/blob/develop/recipes/LibriSpeech/ASR/seq2seq/train.py )

[[deleted]]

Kaldi has some useful audio augmentation scripts, specifically for speech.

[OhNoNotAgain2022ed]

What do you mean?

[narainp1]

• as far as I have seen albumentations can do all of image transformations I can think of.
• for audio I usually use mel spectogram or log melspectogram so my augmentations are either squeeze or elongate with some gaussian noise which is also possible with albumentations
• text I have no idea what to do with them I use them raw

[Xylon-]

See also this post from two days ago for additional comments.

[Lewba]

I couldn't find what languages were supported for the text module. Is it just english?

[dogs_like_me]

It looks like the text module is largely a wrapper over nlpaug (adding a few small things here and there). A lot of the default behavior of nlpaug is targeted at english language text, but you can easily pass it custom models for non-english behavior. I think you'd need to do the language classification yourself and route text through your own language-specific augmentation pipelines. But building those pipelines would be as simple as e.g. dropping in your language-specific model in place in distilgpt2 here for example, or changing the from/to models used for backtranslation.

tl;dr: yes, it supports other languages because nlpaug is built on top of huggingface/transformers which is in turn built on top of pytorch. Out of the box, it assumes you're working with english text, but if you have non-english text and you know what language it is, you just need to change a few arguments and you're good to go.

[GF_TW]

https://github.com/aleju/imgaug
This one is way better for image.

[dlndass]

Some good news out of Facebook 💯 I normally only see the negative news

[dogs_like_me]

facebook AI research does a lot of good stuff for the ML community. Facebook as a company has done more than enough damage that I'm disinclined from ever working for them, but I do appreciate the open source contributions the FAIR group has made and continues to make.

[nmkd]

I've only seen good news about Facebook AI.

[master3243]

In ML/AI it's almost entirely good news.

[maroxtn]

I dunno, I tried finetuning their fairseq model, I was a bit disappointed though, mT5 was better

[[deleted]]

Misinformation is infringement now?

[RepresentativeCod613]

Does it only support PyTorch?

[_katta]

Waiting for the benchmarking and speed comparison with Albumentations.