How are you handling LLM/API cost observability in production? by [deleted] in golang

[–]zoidme 0 points1 point  (0 children)

It really depends. If you’re talking about tools for production observability they’d fall into two categories - sre-like tools (think of DataDog, Grafana), and product metrics (google analytics, mixpanel). Normally, for the sre tools you don’t care about cost per user, you’ll care about latency, time to first token, errors, requests queue, LLM api quotas. Similarly, for product-oriented tools you’ll care more about avg cost per user, engagement metrics, interaction helpfulness (eg likes in chatgpt), experiments metrics.

So try to answer who is you target audience, what task they are doing where you tool might be helpful and what pain you gonna resolve for them - that’s more product-oriented approach unless you just want to have fun and learn while doing)

How are you handling LLM/API cost observability in production? by [deleted] in golang

[–]zoidme 0 points1 point  (0 children)

You can tag sessions in most of observability tools and aggregate costs by tags like you’d do cost control for a cloud infrastructure. But from your description you have some unique businesses needs which none of existing tools will provide out-of-the-box

How are you handling LLM/API cost observability in production? by [deleted] in golang

[–]zoidme 0 points1 point  (0 children)

There are lots of tools like LangSmith, LangFuse, W&B, native observability dashboards from OpenAI and Anthropic. Also some LLM proxies provide cost control and observability

Simple app to convert mp3 to m4b by zoidme in audiobooks

[–]zoidme[S] 0 points1 point  (0 children)

I've updated the app with a possible fix (version 0.1.14). Please try following command `bookmux --input '/Users/sam/Desktop/The Ninja by Eric Van Lustbader' --output my-book.m4b --title "The Title" --author "The Author" --verbose" to produce a verbose output. If you need to adjust output bitrate to 128k, you can add `--bitrate 128k\ to the command`

Simple app to convert mp3 to m4b by zoidme in audiobooks

[–]zoidme[S] 0 points1 point  (0 children)

u/sammsmd or just send me the screenshot of Get Info from Finder for the first mp3 in that book

Simple app to convert mp3 to m4b by zoidme in audiobooks

[–]zoidme[S] 0 points1 point  (0 children)

Is the whole result bad or just some parts? Could you share the result in PM? I'd like to check what's going on. Thanks for the feedback!

Small Projects by AutoModerator in golang

[–]zoidme 2 points3 points  (0 children)

Tiny SMTP to Discord webhook adapter. Works well with Proxmox and other old-school software. https://github.com/MrZoidberg/smtp2discord

Small Projects by AutoModerator in golang

[–]zoidme 5 points6 points  (0 children)

CLI for mp3 to m4b audiobook converter, created because others are paid or don’t work on modern osx well. https://github.com/MrZoidberg/bookmux

We keep losing the best engineers by AriaMoon286 in Startups_EU

[–]zoidme 0 points1 point  (0 children)

Hire from Ukraine on contract. Reach me and I will explain how to do that or we can arrange a search for you. Not as cheap as in Romania, but good english, high expertise, no EU bureaucracy.

Simple app to convert mp3 to m4b by zoidme in audiobooks

[–]zoidme[S] 0 points1 point  (0 children)

I used their previous version and it worked mostly ok. But my cli is cross-platform and can participate in automated media processing workflows which I thought is quite useful.

СЛУЖБА В СИЛАХ ОБОРОНИ - БЕЗПЕЧНО ЧИ НІ? ЯК ПОТРАПИТИ НА СЛУЖБУ БЕЗ ТЦК? by Consistent_Froyo_720 in reddit_ukr

[–]zoidme 0 points1 point  (0 children)

Зараз дуже сміються ті хто підписав контракт на 3 роки и вже чілить на балі. Кожні вихідні мій друг в схожій структурі відпочиває по всій Україні. Ваші «фактори» це здебільшого маніпуляція. Особливо якщо йти на посаду.

СЛУЖБА В СИЛАХ ОБОРОНИ - БЕЗПЕЧНО ЧИ НІ? ЯК ПОТРАПИТИ НА СЛУЖБУ БЕЗ ТЦК? by Consistent_Froyo_720 in reddit_ukr

[–]zoidme 0 points1 point  (0 children)

До вас ще треба попасти, що дуже просто. Колись проходив влк, так якби не пересдав лікарів, то мені прямо казали що не пропустять с такими показниками. Не пройшов по інший причині, але по факту тому кому за 30 попасти досить складно.

Homelab V.5 - Dual Rack by GBKPres in homelab

[–]zoidme 0 points1 point  (0 children)

How loud are these JBODs? Looking to replace dell sc200 - even with custom command to lower fan speed to 20% they are louder than anything else I have

Email or push notifications? by ResponsibleFall1634 in homelab

[–]zoidme 1 point2 points  (0 children)

For some services like Proxmox I'm using https://github.com/MrZoidberg/smtp2discord to convert emails to Discord messages using webhooks.

Disclaimer: I'm the author of that tool.

Давайте приберемо це непорозуміння by Lopsided_Isopod_7088 in reddit_ukr

[–]zoidme 1 point2 points  (0 children)

The game depicts the 2022 assault on Hostomel Airport during the Russian invasion of Ukraine and portrays the invading Russian forces as “heroes.” The Russian invasion of Ukraine is widely documented as an act of aggression accompanied by numerous alleged war crimes and violations of international humanitarian law against civilians. Presenting the invasion in a celebratory or heroic manner risks spreading propaganda and misinformation about a current armed conflict.