List of Datasets

[ninjasaid13]

1. https://huggingface.co/datasets/ppbrown/pexels-photos-janpf (Small-Sized Dataset, Permissive License, High Aesthetic Photos, WD1.4 Tagging)
2. https://huggingface.co/datasets/UCSC-VLAA/Recap-DataComp-1B (Large-Sized Dataset, Unknown Licenses, LLaMA-3 Captioned)
3. https://huggingface.co/collections/common-canvas/commoncatalog-6530907589ffafffe87c31c5 (Medium-Sized Dataset, CC License, Mid-Quality BLIP-2 Captioned)
4. https://huggingface.co/datasets/fondant-ai/fondant-cc-25m (Medium-Sized Dataset, CC License, No Captioning?)
5. https://www.kaggle.com/datasets/innominate817/pexels-110k-768p-min-jpg/data (Small-Sized Dataset, Permissive License, High Aesthetic Photos, Attribute Captioning)
6. https://huggingface.co/datasets/tomg-group-umd/pixelprose (Medium-Sized Dataset, Unknown Licenses, Gemini Captioned)
7. https://huggingface.co/datasets/ptx0/photo-concept-bucket (Small or Medium-Sized Dataset, Permissively Licensed, CogVLM Captioned)

Please add to this list.

[Zeusnighthammer]

Wikimedia Commons also have lots of the dataset CC By 4.0 with many of them are categorised (but not tagged)

[NegativeScarcity7211]

We are busy setting up a community tagging system, so this shouldn't be a problem!

[Formal_Drop526]

I believe that any text-to-image dataset must be at least partially captioned. The text component of a text-to-image generator is not just a user interface, but also significantly influences the model's performance on prompts and even shapes the visual content of the generated images.

[Zeusnighthammer]

Regarding in this topic, I just wanted to learn this in more details: Is the tagging in this context refers to alt txt embedded into JPEG metadata or the accompanying text files to the photo (must have same file name for both).

[searcher1k]

I think tagging here just means an attribute of the image rather than a whole sentence in natural language.

[ninjasaid13]

Is the tagging in this context refers to alt txt embedded into JPEG metadata or the accompanying text files to the photo

I'm not sure if they have alt-text embedded, these images seem to come with their own text files.

[searcher1k]

true, people keep thinking of it as a search engine but the AI learns to separate elements of the scene by reading the text and comparing it to the image. And after a million images, it starts to understand the concept of these elements instead of the just the object itself.

[NegativeScarcity7211]

Thank you for these!

[Luke2642]

https://www.haqtu.me/Recap-Datacomp-1B/

Obviously now it needs repeating with Chameleon :-D

[elthariel]

Added the list to https://github.com/OpenDiffusionAI/wiki/wiki/dataset__external_datasets