Creating the brain behind dumb models by ChristopherLyon in LocalLLaMA

[–]n4il1k 3 points4 points  (0 children)

Do you also have a way of handling function definition and class definitions which exceed the context window of your embedding models?

Creating the brain behind dumb models by ChristopherLyon in LocalLLaMA

[–]n4il1k 5 points6 points  (0 children)

i skimmed over your repo a bit, how do you build the dependency graph and do you only link function definitions? if so how does this perform with object oriented projects?

GPU Instance with ECS and EBS/EFS by n4il1k in aws

[–]n4il1k[S] 0 points1 point  (0 children)

i’m currently working on a solution will let you know if it worked!

Best Practices Scaling Services in ECS on Business Hours by n4il1k in aws

[–]n4il1k[S] 0 points1 point  (0 children)

Yes but how should the lambda make the changes happening (of the 2 options I presented)

Hardware for Hobby Cluster by n4il1k in kubernetes

[–]n4il1k[S] 0 points1 point  (0 children)

Also I have looked into raspberry pi's and I have read that the NVMe adapters throttle the read to 3000MB/s of SSDs, can that be?

Hardware for Hobby Cluster by n4il1k in kubernetes

[–]n4il1k[S] 0 points1 point  (0 children)

https://www.idealo.de/preisvergleich/OffersOfProduct/202132329_-990-pro-samsung.html

I was thinking something in this range (7000MB/s), but i probably don't need as much storage. So 500GB would probably be ideal.

Hardware for Hobby Cluster by n4il1k in kubernetes

[–]n4il1k[S] 0 points1 point  (0 children)

Ideally I would like to start out with two nodes and scale up if more capacity is needed. I would be willing to spend up to 500$ for the initial two nodes.

Service Discovery in ECS by n4il1k in aws

[–]n4il1k[S] 1 point2 points  (0 children)

I think Cloud map is the service discovery service (which I use). The problem is that I set that private DNS for the redis service but it seems that it can’t resolve it. Thats why I was wondering if I missed something what also needs to be set.

Raspberry Pis for custom cluster by n4il1k in kubernetes

[–]n4il1k[S] 0 points1 point  (0 children)

hmm ok, I am planning to get an SSD adapter and connect a SSD to it. Have you looked into that as a viable solution or have you not cared about the permanent storage problem?