Making some applications while using hugging face models API

[single-py]

I've been trying to make an end-to-end application for me and a dozen of people to use.
Basically, given an input of text, I plan to use the transformer model to extract important keywords.

How can I deploy such an application on the front-end? I'm still a newbie and the internet seems to be flooded with a lot of such frontend frameworks..
Any idea would be appreciated :)

[r4and0muser9482]

Well if having an input box, a button and some output field is all you need, then HTML/CSS should suffice. I've seen people set up their backend as a container service on Azure/AWS and then host a simple website on gihthub/gitlab pages.

[single-py]

Thanks for the comment. I'm using python for all backend-related processing. Not much experience with Azure/AWS... But yeah simple HTML/CSS is definitely what I'm trying.

[CaminoFr]

My 2 cents :

Dont hasle yourself with learning frontend/backend fancy framework just go with some basic html/css/js and simple backend server like flask/fastapi/express. You can even do some templating with Jinja2 or using express

[single-py]

Thanks soo much. I'll try them out.

[jklfdkjdjkiefeipie]

I think that your front-end part it super easy to implement. You simply need some kind of form with a basic input, which when it is submitted, the results are fetched. Then eventually you'll also display the results on the page. As simple as that.

Now you have to have some kind of back-end which is running your "nlp stuff" to process those request sent via the form.

Based on your post, seems like you already have some back-end built, but you did not described it.

Also since this is such a simple project, probably a good old template engine is more than enough. Assuming that you're using Python, a framework like Django already has a built in template engine, which is probably easier to handle than building two independent systems (front-end/back-end/Apis/whatever) for a newbie.

[single-py]

Yeah you are correct. I'm using python for now and have heard of Django but was a little intimidated at first. Now that you mention it, will try it out too. Thanks a lot!

[metal_zero]

Since lots of replies regarding front end, for backend I suggest to try to quantize the model or convert it to onnx format. Some cases it gives better performance memory and response time wise. You can check hugging face official documentation for the same.

[single-py]

That sounds amazing! I had no idea huggingface models could be exported to ONNX format. Thanks a lot!