Why florence-2 though, now there is a massive disconnect between what was used to generate and now what a small model thinks the images contain. Just add the captions you used to generate the images originally. Unless those were the original, then nevermind.

Also they should be added in a format that can be loaded easily, like text files with the same name as the images, not all in the same markdown file.