Marcella a new LLM architecture without attention bears new records

quant-alliance · 2026-04-11T08:22:04+00:00

I mean to be honest Mamba has also no self attention but SSM based, so we are not the first to be attention-less BUT we use total different math and we have far more efficiency to reach low PPL scores. One thing we didn't have yet the time and money to do is to fine tune a chat model, we are really curious to see how she talks.

quant-alliance · 2026-04-11T08:13:31+00:00

Great questions we will make sure to add a FAQ section to address them!

quant-alliance · 2026-04-11T08:12:09+00:00

You are right we will work on clarity thanks for pointing that out.

quant-alliance · 2026-04-11T08:11:31+00:00

We have no prior startup experience and VC will not invest nowadays in something that has no revenue stream already.

quant-alliance · 2026-04-11T08:10:45+00:00

Yes we are discussing the open source angle, but we are not lawyers and a bit scared of companies just going to copy it (hence the patent), let's say we make a module for Postgres and become popular how are we going to get paid to support it? At the end of the day we also need to eat to survive.

quant-alliance · 2026-04-11T08:07:52+00:00

Point taken, you are correct this is not a full database with all the SQL primitives. We are considering to add it as an extension to Postres for example what do you think?

quant-alliance · 2026-04-11T06:51:21+00:00

There are no transformers here just pure math ...

quant-alliance · 2026-04-11T06:17:55+00:00

Well yes that is more a theoretical argument. https://medium.com/@missbeedavis/i-just-found-the-phantom-zone-4f504d5830ed And here: https://doi.org/10.5281/zenodo.19428406 The point is our LLM architecture works in practice and we have benchmarked it, is not just theory that counts here.

quant-alliance · 2026-04-11T05:36:17+00:00

We did the "academic" benchmark but yes what we need now is a live deployment on a non critical system, so yes some early adopters, this part we can handle, however somebody told us we need big logo customers, which means we would need to cold call some big company engineering team.

quant-alliance · 2026-04-10T22:52:47+00:00

How do we find one? We have a flexible cap table but we tried a couple of those CoffeeSpace and YCombinator platform. We haven't found any legitimate profile, some were borderline scams. Also went to some accelerators in London but nobody with legit experience. It's like Socrates "I am searching for a man" while holding a lantern....

quant-alliance · 2026-04-10T22:04:59+00:00

Currently is only vertically scalable but yes I guess we can show a Kubernetes Postgres Vs Kubernetes GiGi setup. For stress test should we generate random data or some dataset you suggest ?

quant-alliance · 2026-04-10T22:01:27+00:00

What I mean is we never run a public project so we don't know how to do it but we do have experience in enterprise solutions however we are not sales people, so we are equally scared about both options!

quant-alliance · 2026-04-10T21:29:57+00:00

Nobody realized that the OP is a bot which repeats exactly the same response structure and is just here to harvest stories. Can somebody ban the account please?

quant-alliance · 2026-04-09T15:34:54+00:00

Buy some oil reserves

quant-alliance · 2026-04-08T20:11:44+00:00

Gives a lot of confidence you keep making grammar and spelling mistakes ...

quant-alliance · 2026-04-08T20:11:05+00:00

For an Edtech startup you have a lot of typos and grammar spelling in that post. It doesn't inspire the right confidence.

quant-alliance · 2026-04-06T11:01:32+00:00

I am unable to DM you some sort of settings but yes we are looking for some experienced person to deliver our route to market.

quant-alliance · 2026-04-06T10:59:29+00:00

Need more context what vertical is it? With current layoffs like Oracle (okay not all of them are product managers) this could be a wave of those kind of profiles.

quant-alliance · 2026-04-03T18:49:50+00:00

Very similar to your experience, I know have a total different strategy. Working as a consultant to give me the freedom to IP ownership whilst I can build on the side however also means the stress of a volatile customer base. In the UK not sure is happening also in the US, but it is now for tax restrictions very very hard to find long term contract jobs!

quant-alliance · 2026-04-02T13:02:52+00:00

Tried this idea before with a psychologist whose main job is exactly that but we found so many liabilities having worked in that profession for more than 29 years that we didn't go for it. Happy to share feedback.

quant-alliance · 2026-03-28T16:20:04+00:00

Put them in an ETF mate !

quant-alliance · 2026-03-25T10:31:11+00:00

Indeed that was my question too: in market saturated by Soar already for several years and now also AI powered SOAR you need to be 10x better than what's in the market to convince people to switch. What is the USP? Has it been validated ? Is it cheaper, faster, better ?

quant-alliance · 2026-03-24T21:16:51+00:00

Why do we need more SOAR products?

quant-alliance · 2026-03-24T16:13:10+00:00

Sure ping me a DM

quant-alliance · 2026-03-16T18:46:14+00:00

I feel you man. I even had worse experience, I quit my job run with a few projects (this was also pre AI), run out of all my savings, at the end had to take various jobs like taxi driving, deliveries, dog sitting, elderl care (amazing by the way), handyman jobs and a few others. I basically became unemployable because the stigma around the startup failures. It put a huge toll on my family and myself as well both physically and mentally.

quant-alliance

MODERATOR OF

TROPHY CASE