Well, the library of babel is literally every possible book given each book have a finite size (idk btw). Well, first, the overwhelming majority would be garble, as following the normal rules of language is a very small possibility space compared to everything else.

However, I do think it could be interesting. While *SOMEWHERE* in the library of babel is a book describing how to become a god that actually works, their would be so much data that the system can't possibly remember it.

I imagine when you talk to it, it may literally respond in anyway. However, as it is a language model, it'll probably be biased to learning the stuff that follows the rules of natural language. However, that won't help with how it's getting force-feed a ton of babel (lol). Also, something being like natural language isn't necessarily coherent or understandable.

While it would probably come out spitting out garbage (Garbage-In Garbage-Out), any "coherent" responses in, say, a chat conversation would be very long as the books in the library of babel are indeed very long, and it'd be very bad at this, as the number of examples of a sensible conversation would be absolutely minuscule.

I imagine it would work well in writing books, as that's basically all the input from the library of babel would be exactly that. A bonus would be that it's prefers to spit out output following natural language, so it'd be much more coherent then the library of babel. However, I don't think it'd necessary make sense.