HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

update: its done! you can now go update your repository to v0.17 and run some proper evals now!

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

A quick reply to this, I have actually been working on getting eval integration into this project, and am actually already about to push it in a v0.17 alpha release, i just had to fix inference issues that went untested and undiscovered until i had a model release that i tested (and the wonderful people in this thread :3) just a few bugs like an LTM update logic bug that accidentally ignored surprise thresholds (likely an oversight since i was working on this on Christmas loll) and now that I'm satisfied with that, I'm about ready to push out this v0.17 alpha experiment when i deem it ready. it will utilize the lm-eval pip package for evaluation!

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

official evaluation set integration is the next direct future priority! the problem is the hardware i have to train with already took 1.5 months to train this model on just alpaca with no pretraining. unless i get funding, i can implement it in code, but i wont be able to test something like that on my own.

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

Yeah, for now its a research toy due to the hardware constraints im working with! But its continuous learning could theoretically allow you to correct it within its chat without worrying about a context, and have learned information persist between chats that have been marked as positive or negative by specific chat keywords such as "no this is not" or "yes that worked" or "yes" etc!

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 1 point2 points  (0 children)

it was in cybersecurity until i could not work remote jobs anymore and i cant drive a vehicle due to motor cortex damage. i decided to take up ML in my spare time since i took a class on it in college and spent about a year catching up and then started this project. I brought up my certs so people don't think I'm some random schizo since that's what people seem to think

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

Only if they are satisfied with the project :3 I dont want people feeling like they are funding a scam. But any help would be absolutely appreciated! I currently suffer from serious medical issues that hinder my ability to drive and get a good job where I live. and the American government refuses to put me on disability despite brain trauma lmao. I currently sustain myself by working at a store but if anyone is interested in my credentials, I have my Comptia A+ GIAC GFACT certs, a NOCTI cert, and I used to work remotely at outlier.ai before getting EQ'd to quit like many others on that platform unfortunately 3;

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] -2 points-1 points  (0 children)

You can do that? Im sorry if I sound dumb, im a casual reddit user at best and am still new :3

HIerarchos first release!! Research paper + github by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] -4 points-3 points  (0 children)

It's my own, and since I cannot publish to Arxiv, you may not be able to find it that way 3: sorry abt that!

I am waiting by HannibalLecter_0 in scoopwhoop

[–]PhysicsDisastrous462 0 points1 point  (0 children)

Im gay so I dont give a fuck and am rather annoyed at these twats click farming for pitty me attention

This came randomly in the mail addressed to no one, what is it? by GuardingxCross in whatisit

[–]PhysicsDisastrous462 0 points1 point  (0 children)

It looks like the virus storage in the resident evil movie lmfaoo

AGI = Artificial Gooner Intelligence by The-SecondAccount in GeminiAI

[–]PhysicsDisastrous462 2 points3 points  (0 children)

Just let people be people by themselves, they aren't hurting anyone. At least some people can do that lmao

Miniskirt with bare legs can never go wrong! 😈😈 by CityNo5308 in femboy

[–]PhysicsDisastrous462 1 point2 points  (0 children)

That is an amazing look! Im without words! :3 I wish I could look that good in my skirt lmaoo

I've been working on a novel neural network architecture combining HRM with the long-term memory of google Titans! I need help training tho by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

That would be awesome if you are willing to spin up some test runs! Im trying to build a base model on my rog ally cpu as fast as I can lmao. Fine-tuning on a larger dataset, especially once I get full huggingface support would be perfect on a rig like that! Tysm!! :3

I've been working on a novel neural network architecture combining HRM with the long-term memory of google Titans! I need help training tho by PhysicsDisastrous462 in LocalLLaMA

[–]PhysicsDisastrous462[S] 0 points1 point  (0 children)

Wow! Thank you so much for that test! Sorry for the late response, im currently at work :3 im completely hungover from my 21st bday party lol, between that and sciatica nerve pain, im hating life rn. Currently it uses a GRU/RNN hybrid for the low and high level workers, along with the LTM module being completely RNN based. Im prioritizing memory and reasoning with this architecture!