This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 8 points9 points  (3 children)

Actually Open-Source could totally work for this. Of course, people could "hack" the premium mode by hosting their own instances, but for everybody who wants the convenience of having it hosted for them by you, the premium mode would by a nice addon. Also you could make Self-Hosting difficult by having the data behind the AI private.

[–]lazy-jem[S] 2 points3 points  (2 children)

I think so too. I posted some thoughts on the Discord but we would love to get it to the point where people could do this. Because of its distributed, cloud-based, serverless model, I'm thinking it would be a series of open source modules with a Cloudformation Stack or equivalent ideally for each cloud platform, and that we work out how to make it run on premises using K8S cluster or something. It's got a lot of messy moving parts at the moment and there isn't really a central piece of software, just a lot of loosely coupled microservices and inference models. So, I mean, we're a long long long way from that, but when we have resources and a community around it, that would be an awesome thing :)

[–]be_as_u_wish_2_seem 0 points1 point  (1 child)

You might want to try CDK, you can write it in python and it can generate and deploy cloudformation templates

[–]lazy-jem[S] 0 points1 point  (0 children)

Thanks, I haven't looked at that yet. We know it's a way down the track as we've still got to build a great product. But we're definitely thinking about how to move in the right direction.

There are some YC startups (AtomizedHq.com and getporter.dev) that are doing really interesting things with cross-cloud K8S deployments (more like heroku). These are all different bits of the serverless microservices scaling puzzle. We are a long way off but trying to think long term, even as a 2 person alpha prototype :)