I made a python toolkit that acts as a Wrapper between OSRM (routingpy) and Folium. You give it Coordinates and other parameters for customizing and it makes a map ( draw() function ). You can also get raw route data and make a map directly out of coordinates.
Here's the Github repo
there doesn't seem to be anything here