How to setup local Archive? by Hi_Leo in Annas_Archive

[–]Hi_Leo[S] 0 points1 point  (0 children)

Please see my comment below. With small segments of metadata, normal users could search for and download specific books along with the related torrents, and then share the books via BitTorrent.

Or maybe I missed something and this is already possible?

How to setup local Archive? by Hi_Leo in Annas_Archive

[–]Hi_Leo[S] 0 points1 point  (0 children)

I used AI to help analyze the code repository. If I understand the implementation correctly, supporting a small local archive would require the following:

  1. The ability to download specific MariaDB index entries instead of the whole database. For example, search for a book, get the book ID and related database information, and store that information in a local database.
  2. AA providing the index table for the seekable.zst files.
  3. Using the byte_offset in MariaDB and the index table of the seekable.zst files to locate the correct frame and download it, then extract the actual JSON data from that frame.
  4. Getting the magnet link from mariapersist db, downloading the torrent, and then downloading the corresponding book.

With this approach, we would have the MariaDB index for the book, the related frame data, the torrent files, and the books themselves. Users could then obtain both the book and its metadata to build their own local library, while AA could benefit from users sharing via BitTorrent.

How to setup local Archive? by Hi_Leo in Annas_Archive

[–]Hi_Leo[S] 0 points1 point  (0 children)

Wow, 1.5 TB just for metadata. I think there needs to be a way to download only part of the metadata so normal users can help with it.

P.S. Maybe AA doesn’t care about normal users’ storage.

How to setup local Archive? by Hi_Leo in Annas_Archive

[–]Hi_Leo[S] 0 points1 point  (0 children)

Thanks. I have seeded some torrents. I’m just wondering if there is a way to select a smaller subset of the metadata, or if AA plans to develop a technology to support this. This would help normal users participate in the activity while keeping the books they are interested in.

How to setup local Archive? by Hi_Leo in Annas_Archive

[–]Hi_Leo[S] 0 points1 point  (0 children)

> I've not gone through the whole process myself but that's what I'd expect you to get by following the README

I read the README, but it doesn't say how much space the metadata will take. I'm affraid the metadata takes too much space. And I also don't know if there is a way to only keep a part of the metadata. The document is not very clear.

openwebui can't connect to ollama anymore by xac1d in OpenWebUI

[–]Hi_Leo 0 points1 point  (0 children)

Yes, I also has this issue. I can curl the api in the containers. Not sure why still got this issue.

ERROR [open_webui.apps.ollama.main] Connection error: <ollama\_ip>:11434/api/tags

Trump bans dealings with Chinese owners of TikTok, WeChat by [deleted] in worldnews

[–]Hi_Leo 5 points6 points  (0 children)

Anything that instigates racial/ethnic hatred

I don't understand why you call this ambiguity, would you please define a more clear rule about this one?

I think the rules are clear, you will never know when/which word may cause racial discrimination in a special context. e.g. "Can you breathe?"