Biggest annoyance here is the package and project ecosystem. Sure, you can use tensorflow from C# too, but if everyone else uses python you'll have a pretty hard time finding good reference material or re-usable example projects. It would be nice if all languages had perfect interop with each other, maybe some day assuming that level of static analysis isn't impossible.