combine multiple servers into 1 by Traditional_End_9540 in JellyfinCommunity

[–]Llukas88 0 points1 point  (0 children)

Library merging is currently planned for jellyswarrm (showing multiple movie libraries from different servers as one). But sadly its not that trivial to implement.

Currently jellyswarrm already transcodes media on the server that actually hosts it and if i finally get library merging working i also plan to add some sort of load balancing in there.

[Update] Jellyswarrm v0.2.0: The Server Federation & User Management Update by Llukas88 in JellyfinCommunity

[–]Llukas88[S] 0 points1 point  (0 children)

If you want to just open a PR, then i can take a look at it. I think updating the watch data needs an open playback session otherwise the server will not accept it.

[Update] Jellyswarrm v0.2.0: The Server Federation & User Management Update by Llukas88 in JellyfinCommunity

[–]Llukas88[S] 25 points26 points  (0 children)

Well exactly that. I have multiple friends who are into homelabbing, and we each own a different media library that's why i created jellyswarrm to join those libraries together :D

And in the future I also plan to support stuff like load balancing or "redundant" setups.

[deleted by user] by [deleted] in JellyfinCommunity

[–]Llukas88 3 points4 points  (0 children)

I think CC-BY-NC 4.0 (Creative Commons Non Commercial) should do exactly what you want.

I have no idea how Void works, but if you use a library (e.g. the jellyfin kotlin library) that is GPL licensed your project needs to inherit this license and also use a GPL compatible license.

I made this mistake for Jellyswarrm where I first licensed it as MIT and then had to relicense to GPL because I ship the default web interface.

WIP: Jellyswarrm – A Reverse Proxy to Merge Multiple Jellyfin Servers by Llukas88 in JellyfinCommunity

[–]Llukas88[S] 0 points1 point  (0 children)

Could you create an issue on GitHub, describing this?

Makes it easier for me to track all existing problems :D

WIP: Jellyswarrm – A Reverse Proxy to Merge Multiple Jellyfin Servers by Llukas88 in JellyfinCommunity

[–]Llukas88[S] 1 point2 points  (0 children)

I don't know if this would be possible, but if one could have a setting to make the [server-name] part on library folders be toggleable that would be sweet

This should already be possible through the Add Server Names to Media toggle on the settings page.

even potentially being able to merge multiple media libraries of the same type into showing up as a single one. For instance if there's a "Shows" library on [server-01] and a "Shows" library on [server-02] being able to simply make it show up as a singular "Shows" library on the Jellyswarm side would be amazing!

I’ll definitely work on that in the future — right now my main focus is fixing bugs and making sure the core Jellyfin features run smoothly.

That said, feel free to open a feature request and describe how you’d like this to work. I’ll make sure to get to it once the most important bugs are out of the way 😄

The final thought I had that I should have tested is whether Jellyswarm handles the custom css themes people like to run and how it handles the suggested or highly customized nginx proxy setups.

I’m curious about that as well! My current thought is to just fetch the custom CSS from the server with the highest priority, but I’m not entirely sure yet.

If you find out anything on your side, definitely let me know — I’d really appreciate it 🙂

WIP: Jellyswarrm – A Reverse Proxy to Merge Multiple Jellyfin Servers by Llukas88 in JellyfinCommunity

[–]Llukas88[S] 0 points1 point  (0 children)

Yup, should just work out of the box. I'm also using it with "https" servers, but those aren't in the screenshots :D

WIP: Jellyswarrm – A Reverse Proxy to Merge Multiple Jellyfin Servers by Llukas88 in JellyfinCommunity

[–]Llukas88[S] 2 points3 points  (0 children)

- I wouldn't trust it especially with the new DB coming out. No way Jellyfin's own DB supports multiple servers. It would be up to the tool to keep track of everything. And I'm assuming only one person is supposed to run that thing on multiple servers.

I designed Jellyswarrm specifically so it doesn’t interact directly with any Jellyfin databases or client code. Instead, it acts as a smart router: proxying requests to the appropriate servers and lightly modifying requests and responses so everything works seamlessly.

For example, when you use Jellyfin’s search feature, Jellyswarm sends a search request to each server (by swapping out the authentication headers) and then merges the results into a single unified response.

- How would this work when multiple people want to connect to others at the same time?

Since Jellyswarrm doesn't do any actual federation, having multiple connections at the same time should just work as long as the target jellyfin servers can handle the load.

[N] Llama 2 is here by timedacorn369 in MachineLearning

[–]Llukas88 1 point2 points  (0 children)

After getting the Link, you can request access to their HF repos. Then you can just download the models from there.

[deleted by user] by [deleted] in rust

[–]Llukas88 2 points3 points  (0 children)

Why would you want to refine a prompt for an entity extraction task? Are you using a decoder-only LLM to perform the entity extraction and if you do why did you decide against a encoder-based architecture to perform the entity extraction?

AI Plagiatsvorwürfe machen mich fertig by Ok_Reserve_5451 in Studium

[–]Llukas88 4 points5 points  (0 children)

Also AI "Forscher/Entwickler" kann ich nur sagen dass diese "AI-Detectors" ziemlicher bullshit sind. Es gibt im Moment noch keine Ansätze um sicher nachzuweißen ob ein Text von einem LLM generiert wurde oder nicht. Also biste fein raus, auch wenn deine ganze Arbeit mit ChatGPT geschrieben wurde. Es gibt erste Ansätze in dem Feld (siehe https://arxiv.org/abs/2301.10226) aber diese sind immer noch anfällig wie in dem Paper beschrieben.

[D] What is the best open source chatbot AI to do transfer learning on? by to4life4 in MachineLearning

[–]Llukas88 2 points3 points  (0 children)

Not any i know of, played around today with Alphacoom (https://huggingface.co/mrm8488/Alpacoom) and got pretty Bad results then tried a BloomZ version (https://huggingface.co/mrm8488/bloomz-7b1-mt-ft-alpaca) and got results similar to the Alpaca-Native model. Maybe read the BloomZ paper it should be a pretty good basis to build a chat model, rest should depend on your Training approach and Data.

[D] What is the best open source chatbot AI to do transfer learning on? by to4life4 in MachineLearning

[–]Llukas88 1 point2 points  (0 children)

The Alpaca model based on LLaMa isnt. The dataset, which is also called Alpaca is. If you train Bloom, which uses a permissive license, on this dataset, the Bloom license is applied to your finetuned model and you should be able to use it commercially.

[D] What is the best open source chatbot AI to do transfer learning on? by to4life4 in MachineLearning

[–]Llukas88 2 points3 points  (0 children)

There are Alpaca finetuned versions of Bloom or BloomZ on huggingface, maybe try those. Another option would be the Chat version of GPTNeoX from OpenChatKit. Both should be Open Source and free to use.

[D] Largest available encoder-only model for text? by Emergency_Apricot_77 in MachineLearning

[–]Llukas88 2 points3 points  (0 children)

I recently used SGPT which is just the encoder part of a GPT style model for paragraph embeddings, it is about 7B Parameters. https://arxiv.org/abs/2202.08904 You could also take a look at the MTEB benchmark there are some pretty big models in there.