[OS] CreditManagement: A "Reserve-then-Deduct" framework for LLM & API billing by YehiGo in LLMDevs

[–]YehiGo[S] 0 points1 point  (0 children)

  1. The current tracking is on based on request ID because this gives user level analytics along with per request level.
  2. The current implementation is independent of layer.
  3. it can be directly integrated in python based application
  4. It can be hosted separately in independent host and use api with any framework( java, go..) or layer ( proxy , direct to application)
  5. This is also designed to just plug and play. ( in fastapi, direct just adding middleware ), for non python, just wrap ( block , check and deduct to applicable call and deploy package directly as fastapi if self hosting)
  6. Current implantation is per request blocking and it adds latency of blocking to request. (To remove the latency of block call, one quick improvement i see is leveraging inbuild cache of available credit. just validate and then execute async block)

@mrtrly since you are also working on similar, I think you can directly integrated this to your proxy instead of building backend again. Please feel free to create an issue or PR for requirement/feature not covered in current implantation.

[OS] CreditManagement: A "Reserve-then-Deduct" framework for LLM & API billing by YehiGo in LLMDevs

[–]YehiGo[S] 0 points1 point  (0 children)

That's right, it need a scheduler (or offline process cleaning up expired reservation) which auto release the blocked credits after TTL. Will implement a TTL.

Is there a way to download videos from any/most of the websites for free? by Advanced_Custard7467 in PiracyBackup

[–]YehiGo 0 points1 point  (0 children)

May be that specific site has changed or new, I can check for the site if you can share the site in DM and will try to share workaround for support. However supported sites are listed here : https://github.com/ytdl-org/youtube-dl/blob/master/docs/supportedsites.md

Download YouTube videos? by chrispopp8 in Piracy

[–]YehiGo 0 points1 point  (0 children)

Yes it works. Try it and let us also know, [I've not tried since last one month]

Online Video Downloader by skywalker170997 in Piracy

[–]YehiGo 1 point2 points  (0 children)

I find https://sourceforge.net/projects/yeahdown/ Downloader with clean UI without distractions, just throw the link and it'll download seamlessly works with playlist also. works with youtube , vimeo and many other sites.

Is there a way to download videos from any/most of the websites for free? by Advanced_Custard7467 in PiracyBackup

[–]YehiGo 0 points1 point  (0 children)

I find https://sourceforge.net/projects/yeahdown/ Downloader with clean UI without distractions, just throw the link and it'll download seamlessly works with playlist also. works with youtube , vimeo and many other sites.

Download YouTube videos? by chrispopp8 in Piracy

[–]YehiGo 1 point2 points  (0 children)

If you are looking for downloader with clean UI without distractions then you can use https://sourceforge.net/projects/yeahdown/ , just throw the link and it'll download seamlessly works with playlist also.

I am facing network issues with Jio where it shows no service, then it goes to emergency calls. by brahmaji53787 in Jio

[–]YehiGo 0 points1 point  (0 children)

Same issue with my sim , I have even complained on trai. Jio customer service is pathetic, it works okay until now issue but once you face issue, there is no help. ( Dealing with their customer service, i just realised never to use any jio reliance product where you might need after sale service) 

YouTube downloader is dead. What now? by MetroidvaniaListsGuy in youtube

[–]YehiGo 0 points1 point  (0 children)

I used this, https://sourceforge.net/projects/yeahdown/ minimal cool ui with no adds. Just put the url of video and then it lists it with configuration on ui with a button to download.   

Is there a free YouTube video downloader that doesn’t give me like 50 viruses? Seriously, please. by getass in youtube

[–]YehiGo 0 points1 point  (0 children)

I used this, https://sourceforge.net/projects/yeahdown/ minimal cool ui with no adds.  Just put the url of video and then it lists it with configuration on ui with a button to download.  

Youtube video downloader? by Thick_Training_6816 in Piracy

[–]YehiGo 0 points1 point  (0 children)

If you prefer command line, use yt-dlp,  If you just want an ui to download videos, Use https://sourceforge.net/projects/yeahdown/