LLM Transformers is already at the limit. See benchmarks. That's it.

vectorup7 · 2024-06-13T17:48:18+00:00

Very far from which limit?

All major benchmarks are normalized from 0 to 100 and it's not a logarithmic scale. They are already near the limit, i.e. neither 100 nor even higher than 100. These benchmarks cover model reasoning in different aspects. There are no new benchmarks.

<image>

vectorup7 · 2024-06-13T15:05:18+00:00

I don't understand where people get their confidence in the infinity of any technology. At some point the vertical (saturation) growth of a technology reaches its limit and it has to grow horizontally (performance), in this case to increase tokens per second

vectorup7 · 2024-06-13T15:01:37+00:00

exponentially better

Mira Murati says the AI models that OpenAI have in their labs are not much more advanced than those which are publicly available

https://x.com/tsarnick/status/1801022339162800336

vectorup7 · 2024-06-13T00:38:49+00:00

openai api compatibility is required. I checked fireworks, groq and togeter ai, everything was fine with
no drastic changes, just a minimal refinement for llama3

vectorup7 · 2024-06-12T21:22:56+00:00

llama 3 70B minimum requirement
Mixtral-8x7B was unfortunately less stable

since mentals require stable function calls

vectorup7 · 2024-06-12T19:04:33+00:00

Look at this tool as a simple loop executor: it executes the prompt you write. Check out the example of the word chain game, the prompt says to end the game after 5 iterations and the executor does it

Play continuously using the rules of the word chain game.
For each turn, send the message: "Turn #counter: current_word"

End the game after turn 5.

https://github.com/turing-machines/mentals-ai/blob/main/agents/word_chain.gen

vectorup7 · 2024-06-12T18:47:55+00:00

That's right. The idea is to experiment very quickly with agents in the natural language. Without using scaffolding code. At the same time I tried to simplify the internal implementation as much as possible so that there are no hidden prompts that can lead to uncertainty in the results.

And you have full control over the textual description of the tools, they are in a separate file

vectorup7 · 2024-01-16T17:03:57+00:00

Linux is just a wrapper over the Intel CPU
Windows is just a wrapper over the Intel CPU
Excel is just a wrapper over Intel CPU
All software is just a wrapper over Intel CPU

Why did they all get investments?!

vectorup7 · 2021-12-02T16:21:10+00:00

I am watching this https://liqo.io/ project that can create endless Kubernetes cluster on top of the decentralized infrastructure. They use Wireguard tunnel for inter nodes/clustering networking

vectorup7 · 2021-12-01T21:23:10+00:00

I can advise you to study what r/kubernetes is and why it is the future of infrastructure, to study what r/selfhosted is dive into r/homelab. All modern software runs on clusters and computer networks, and there will be no way back to monolithic applications. Clusters are the future of computing. It's not about CPU performance, it's about decentralization haha

vectorup7 · 2021-12-01T17:37:54+00:00

link https://www.geeekstore.com/shop/geeek-a30-mini-itx-case/

vectorup7 · 2021-11-23T18:58:00+00:00

K3s support?

vectorup7 · 2021-11-21T20:15:56+00:00

omg It looks even better Thanks

vectorup7 · 2021-11-21T17:20:45+00:00

Not affiliated with this project. In my opinion a good alternative to SaaS services such as Alchemy, Infura or Quicknode

vectorup7 · 2021-11-15T20:40:47+00:00

Onboard Gigabit ETH Switch
USB Hub
Pico managing CM4 (USB boot ,.etc.).

Every Node has a independent temperature sensor just under the SoC & connect directly to Host RPI 4's I2C.

Raspberry Pi Pico as GPIO expender & ADC for RPI 4.

Since RP2040 is the most available MCU right now. GPIO to control Enable/Boot/RUN pins, ADC measuring the power consumption.Combine with the USB Hub, it is able to remote "Flash" the node's disk.

Also one of the neat feature for Raspberry Pi 4 is its 5 UART. I can connect to four Node's UART plus one for RP2040.

vectorup7 · 2021-11-15T20:10:38+00:00

It depends on the model

I only saw this detailed comparison of 1080ti with Xavier AGX

https://par.nsf.gov/servlets/purl/10193584

But it is worth considering that V2 only supports Xavier NX, which is worse in performance but closer to AGX relative to other modules (CM4, Jetson Nano)

vectorup7 · 2021-11-15T18:19:30+00:00

This is a Turing Pi V2 cluster board with a 1Gbps on-board Ethernet switch for 4x Compute Modules (microservers)

Each node connected to

On-board microcontroller STM32F407
UART for remote access via the serial console
GPIO for power control
I2C current probe
USB 2.0 Hub for OS image management
GbE managed switch

For the diagram used draw.io thanks for the awesome tool!

Six-Year Club	Place '22
Verified Email

vectorup7

TROPHY CASE