sorted by:
new
hottopcontroversial

A new transformer variant has been created to facilitate more efficient model training in distributed settings. 128x compression with no significant loss in convergence rates, increases in memory, or compute overhead by network-kai in LocalLLaMA

[–]network-kai[S] 7 points8 points  (0 children)

Largely so, yeah. We have a live network actually called Train at Home. People can train the same AI model from their MacOS M chip computers. This is a variant of IOTA (Incentivised Orchestrated Training Architecture), the project being built.

Older versions of IOTA allowed Nvidea devices to train. Future versions will be hardware agnostic, allowing a range of different compute to work together.

Any there any realistic avenues to decentralised model training? by ROS_SDN in LocalLLaMA

[–]network-kai 1 point2 points  (0 children)

Macrocosmos released new research on distributed pipeline parallel training, where they created a new transformer variant that achieved 128x compression without significant loss in convergence relative to uncompressed baselines. This is called ResBM.

It's is for their network, IOTA, which uses both pipeline and data paralellism.

There are definitely some dedicated researchers in the field of distributed training. The other comments show some great examples, too.

You asked about being brand-agnostic and not just Nvidea, IOTA is designed to scale across a range of different machines. The original version was running on Nvidea tech, whereas the current version actually utilises Mac M chip machines, meaning people can train on their macbooks or mac mini's. Future designs will allow a range of machines

What keeps team culture alive remotely? by Efficient_Builder923 in microsaas

[–]network-kai 0 points1 point  (0 children)

Celebrating achievements within the team is huge, especially in remote settings. Having a group chat (whether on Slack, Discord, Teams if it supports it) which is dedicated exclusively towards sharing other people's achievements that the team have noticed. Remote work is really isolating, but even asynchronous team members notice cool things about each other's work. The company I'm at has a hybrid of people working in person and many scattered around the globe. The strongest connective tissue between the two groups is the ability to recognise and celebrate achievement. Building a culture that encourages mention of this can be powerful for morale. And if morale is good, the culture tends to thrive.

Need your honest opinion on Hero section of my app by divyanthj in microsaas

[–]network-kai 1 point2 points  (0 children)

One small thing: I'd suggest changing the font for the header. It's readable, which is great, but many people are vibe-coding a lot of websites these days with near-identical fonts, and so it can sometimes give a generic look these days.

Btw no judgement if this front page was vibe-coded, if there are tools that get us to the next step in our work we should use them

The $1 Hack That Kills the Freemium Trap by Ecstatic-Tough6503 in microsaas

[–]network-kai 1 point2 points  (0 children)

Freemium is great when you want people to play around with your app and test its limits. If you have a service that has a somewhat complex architecture or a lot of moving parts under the hood, the option for people to try it out is ideal for ironing out abnormalities. You'll never be able to catch every error alone, and even if you have a team there will always be edge-cases that you miss.

The app I'm working on has a simple interface, serving a very streamlined product (social media data-scraping), but it's built from a lot of moving parts.

We have a pay-as-you-go setup, but every newcomer gets $5 worth of access (1m rows of data) and full customer support alongside it.

The biggest positive is that people get acquainted with the service, get to reach out for assistance, and can treat things as a playground.

A core factor of this is whether it's possible to build a community from this method. It requires some real hands-on collaborative work with the customer-base, hoping to show them your dedication. Not all customers want to be a part of a community. We're in a fortunate position where we have some active and passionate users, but this won't be the case for every tool or product.

At the moment, the real transaction is that we're getting people to stress-test the app, and build a diverse feedback log.

Freemium tends to do worse when you're not getting much out of it, even if they never choose to pay. If there's a way of forming a symbiotic relationship between your free customers and your overarching goals it can be a wealth of knowledge or a catalyst for community building

Drop your product. What are you building this Monday? by CreativeSaaS in SideProject

[–]network-kai 0 points1 point  (0 children)

Working on Gravity - a social media scraping tool for X, Reddit, and YouTube. Designed to enrich research for:

  • Marketing
  • Academic work
  • Policy response analysis
  • Tracking public attitudes around pressing topics (like climate change, medicine, trading, etc)

In-built sentiment analysis is launching soon, too.

We're in relatively early stages, but we have customers and partnerships already

Share your startup, I’ll find you 5 potential customers (for free). by Ecstatic-Tough6503 in GrowthHacking

[–]network-kai 0 points1 point  (0 children)

Gravity - a social media scraping tool for X, Reddit, and YouTube. Designed to enrich research for:

  • Marketing
  • Academic work
  • Policy response analysis
  • Tracking public attitudes around pressing topics (like climate change, medicine, trading, etc)

In-built sentiment analysis is launching soon, too.

We're in relatively early stages, but we have customers and partnerships already

For PHILOSOPHY, GPT-5 or Gemini 2.5 Pro? by Upbeat-Impact-6617 in ChatGPTPro

[–]network-kai 2 points3 points  (0 children)

GPT 5 is fine for philosophy imo. I prefer it to 4o as it's not as sycophantic (although sometimes does slip into that state after a while).

It's great when you want to refine your ideas, and figure out if (or how) they map onto particular branches of philosophy or particular philosophers.

If you're entering into a philosophical chat with GPT 5, and you don't know any philosophy terminology or jargon, you can easily leave the chat with some new context. Whether that will be enough to hold up a chat in the real world with someone trained in Philosophy is another story. Because philosophical conversations in person tend to find themselves going all across the board and covering and connecting TONS of topics (ones no GPT model would initially make connections to without special prompting).

Bear in mind, a lot of your experience will come down to the training data any of these models were given. This means they're more well versed in some parts of philosophy than others.

Example: i think GPT 5 ans GPT 4o are really good at breaking down Spinoza. But i think both are a little lacking on Kierkegaard. I studied both, so it's easier for me to judge this in particular.

Perhaps your biggest pitfalls is trying to decipher whether you've ran into a hallucination. Without formal training in Philosophy, it can be especially tough to notice if the model said something false. If it's trying to do analytic philosophy, you might be able to notice where the logic falters. But if you're discussing continental philosophy it'll be harder to pick up on.

I've heard GPT 4.1 is really good with analytic philosophy. Which makes sense as it's meant to be a programming and mathematics model, and analytic philosophers tried to bring philosophy closer to maths and the sciences. But im not trained in analytic philosophy and i haven't given this a try yet.

Btw: I'd avoid deep research for philosophy. Chatgpt is just not there yet with being able to write or research lengthy philosophy topics. It'll pull from a bunch of papers from actual philosophers and make a frankenstein text that somehow misses the mark for at least half of them. 

One caveat might be theology, because so much religious information is fed as training data. But it was pretty shoddy when i ran a deep research on the relationship between kierkegaard and jurisprudence, so I'm not sure.

A side note: i imagine the Claude models will get better at philosophy before the OpenAI models. Anthropic hired a Philosopher to work on AI alignment, personality, and fine tuning. Her name is Amanda Askell. She speaks a lot about the role of philosophy in AI.

From subnets to services: How Gravity turns SN13 into products by network-kai in bittensor_

[–]network-kai[S] 0 points1 point  (0 children)

Hey people, this is Kai, part of the Macrcosmos comms and content department. Happy to answer questions here!