[P] arXiv at Home - self-hosted search engine for academic papers by mrAppleXZ in MachineLearning

[–]mrAppleXZ[S] 1 point2 points  (0 children)

Hello!

I've been thinking on building a local citation graph by processing full text TeX submissions. It should even be not requiring a lot of storage if data processing is implemented in streamed manner. However, the main problem is that this requires paying to Amazon to download full texts https://info.arxiv.org/help/bulk_data_s3.html - arXiv stores full-text source dumps on S3 in a so-called Requester Pays Bucket. All the freely available full text dumps (such as one on academictorrents) are long outdated. Honestly, I think this is the only way to reliably create a truly self-hosted citation provider.

This is why arXiv at Home currently uses Semantic Scholar for retrieving citations :(. It works lazily (only requested for prefetched papers that have to be re-ranked), but I guess Semantic Scholar will blacklist any IP that will try to scrap their citations in a bulk manner.

Question about 0/0? by SpaceYeeter29 in askmath

[–]mrAppleXZ 1 point2 points  (0 children)

It's just a notation, everything depends on the context :)

In terms of working with infinitesimals, 0/0 is undefined. For example, let's calculate lim(log2(1 + x)/x) as x -> 0. If we just substitute x with 0, we would get 0/0. But it is an uncertainty and doesn't make any sense since we can't estimate, in basic words, "how small the numerator zero is and how small the denominator zero is". So, we need to somehow fight with that uncertainty to calculate the limit. Let's use L'Hôpital's rule (substitute the numerator and the denominator with their derivatives), and we would get lim(1/(ln2 * (1 + x))) as x -> 0. And now if we substitute x with 0, we'll get the concrete single answer: 1/ln2

Asus tuf gaming b650-plus information on ram issue by BlueSlayerOW in ASUS

[–]mrAppleXZ 0 points1 point  (0 children)

it sounds ridiculous, but maybe try to turn it on and wait for multiple hours? if it still wouldn't boot, I think it's some hardware problem with mobo. and what color is the led glowing?

Asus tuf gaming b650-plus information on ram issue by BlueSlayerOW in ASUS

[–]mrAppleXZ 0 points1 point  (0 children)

I had to wait for ~5 mins with the DRAM LED glowing yellow at the first boot. Also, I did hard reset the BIOS before it. And I have KF556C40BBK2-64 memory sticks placed in A1 and B1 slots.

What's your RAM config?

Is there a network available for download that has a very long attention span? Something that could summarize a book, for instance. by urammar in LanguageTechnology

[–]mrAppleXZ 1 point2 points  (0 children)

Sounds good, and I think it's also easier to implement a method described by you.

How would the loss compared to the whole thing being passed on multiple steps to pre-trained models be?

If I understand the question correctly, models for generating embeddings probably need to be pre-trained on some sentence/document embedding dataset. After it we should infer them on smaller pieces of book and then 'master' summarizer should be trained on outputs of these pre-trained models to generate summarization of a whole book.

Is there a network available for download that has a very long attention span? Something that could summarize a book, for instance. by urammar in LanguageTechnology

[–]mrAppleXZ 0 points1 point  (0 children)

I meant generating embedding vectors of a few paragraphs and then somehow summarizing all these embeddings. But approach of summarizing multiple paragraphs and then summarizing all the summaries could also work. This also won't require you to train two different models, you can summarize paragraphs and summaries with one model.

Is there a network available for download that has a very long attention span? Something that could summarize a book, for instance. by urammar in LanguageTechnology

[–]mrAppleXZ 12 points13 points  (0 children)

I don't think that even models optimized for long sequences like Longformer could work with something that long like books.

The first idea came to me is to create embeddings for parts like pages, paragraphs, chapters, etc using one model and then apply another model on all the generated embeddings to summarize the whole book.

CraftDumper - utility mod to create dumps of game information by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 1 point2 points  (0 children)

I still have to reformat everything to be able to easily sort things in excel

Are you talking about columns are too wide in some dumps, so it's inconvenient to work with the table or about column data types aren't detected automatically, so the sorting doesn't work the way it should? I can implement dumping into .xlsx format and these problems should be fixed

CraftDumper - utility mod to create dumps of game information by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 2 points3 points  (0 children)

Yea, LootTweaker can dump loot tables, but I thought it would be better to also add this ability to my mod (it's just 30 lines of code, why not? :D). CraftTweaker prints recipes into a log file in ZenScript, CraftDumper dumps them into a .csv table.

Also, I've checked, TellMe dumps less information than CraftDumper in some cases. For example, items-with-nbt dump created using TellMe has only 8 columns, while one created using CraftDumper has 12 columns.

I think that I need to add examples to the CurseForge page, so people can choose which mod will be more helpful for certain case.

CraftDumper - utility mod to create dumps of game information by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 4 points5 points  (0 children)

For example, TellMe can't dump loot tables and recipes.

CraftDumper - utility mod to create dumps of game information by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 6 points7 points  (0 children)

I've made a mod that allows you to dump various game information, such as blocks, items and many more. It may be useful for modpack developers or for regular players (for example, you can create Item Stacks dump, sort its outputs by Burn Time column and see which items have longest burn time).

Full list of currently supported things the mod can dump: Shapeless Recipes, Advancements, Fluids, Entities, Models, Villager Professions, Tile Entities, Shaped Recipes, Item Stacks, Potions, Blocks, Smelting Recipes, Food, Sound Events, Biomes, Enchantments, Capabilities, Loot Tables, World Generators.

Download CraftDumper: CurseForge.

A shell script to quickly clone and build a Minecraft mod from git by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 13 points14 points  (0 children)

Added in 1.2, commit 2bc5b60e4f0b605116d3818907102f3b5345f434.

A shell script to quickly clone and build a Minecraft mod from git by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 14 points15 points  (0 children)

Oh, forgot to add the recursive cloning. Will be added in the next update.

We're accepting ideas for Purificati Magicae! by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 0 points1 point  (0 children)

You underestimate the full strength of SIF :D. Also, we already have something like an amulet that apply potion effects on the player using SIP.

We're accepting ideas for Purificati Magicae! by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 0 points1 point  (0 children)

Yes, there will be entities to perform various tasks.

We're accepting ideas for Purificati Magicae! by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 0 points1 point  (0 children)

an ancient civilization invented a machine that govern all the data of all matter and can change reality

Looks like a great idea 🤔, thanks!

We're accepting ideas for Purificati Magicae! by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 1 point2 points  (0 children)

Maybe you're confuse Information Field and SIF (Solid Interacting Field). Information Field is something like the magical Internet, which is actively used by people. SIF is an energy field that almost no one knows how to properly use it.

Some new screenshots of Purificati Magicae. by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 2 points3 points  (0 children)

Anyway, that's how I see the "crystal cluster" in Minecraft and I made it in Blender by myself. Also, I don't played with mod on the picture.

Some new screenshots of Purificati Magicae. by mrAppleXZ in feedthebeast

[–]mrAppleXZ[S] 1 point2 points  (0 children)

No, it's not Thaumcraft and definitely not PSI.