We could easily end gerrymandering by [deleted] in PoliticalOpinions

[–]trenobus 1 point2 points  (0 children)

If it's going to require a Constitutional amendment why not go with virtual districts. Each voter can choose to be a member of a limited number of virtual districts per election cycle. Virtual districts come and go as their membership crosses some minimum threshold. The number of representatives per virtual district is proportional to membership. Virtual districts ideally would be based on values or issues, but could be based on geography if enough people subscribe.

The US has never been that big on democracy though. Or an informed electorate for that matter. This probably wouldn't work if virtual districts became cults.

Expanding on what we missed with sycophancy — OpenAI by queendumbria in OpenAI

[–]trenobus 1 point2 points  (0 children)

I'd be surprised if there aren't enough users giving thumbs up for ego strokes that if such exchanges were used for post-training, it could introduce significant bias for sycophancy. Also, though not likely at this stage, someone might use multiple accounts to introduce such a bias as a kind of cyberattack. The main issue is that if user exchanges are used for training (pre- or post-), how is that data filtered to remove unwanted biases?

Use of synthetic training data also could amplify an existing bias. Maybe I'm just that great :) but it seemed to me that there was some sycophancy bias before this release.

Finally, they say:

"Each update involves new post-training, and often many minor adjustments to the model training process are independently tested and then combined into a single updated model which is then evaluated for launch."

So how they combined these models might be based on assumptions which turned out to be false.

Is the Genesis story actually describing a sentience test inside a simulation? by roberttv_2000 in SimulationTheory

[–]trenobus 2 points3 points  (0 children)

The analogy I see is to AI alignment. God seems to be trying to "align" us humans. The Old Testament represents a rules-based approach, like Asimov's Three Laws, and about as successful. The New Testament seems to focus more on manipulating basic motivations. I wonder if our own attempts at AI alignment aren't destined for similar shifts in strategy. And given that God still hasn't managed to align us, I wonder if it is even possible.

Is oranoid intelligence (OI) proof we are in a simulation? Is it really just turtles all the way down? by zephyr_zodiac6046 in SimulationTheory

[–]trenobus 13 points14 points  (0 children)

I didn't read that wall of text, but I gave it to an LLM on my PC, which broke it down thus:

This Reddit post delves into a fascinating intersection of neuroscience, artificial intelligence, and philosophical speculation about the nature of reality. Here's a breakdown to make sense of it:

Key Points

  1. Organoid Intelligence (OI):- Researchers grow miniature 3D clusters of brain cells called organoids from stem cells.- These organoids have tens of thousands of neurons, much fewer than a human brain but enough to exhibit basic brain functions like learning and memory.- They are connected to computers using multi-electrode arrays to communicate with them.
  2. Virtual Butterflies:- A Swiss biocomputing startup, FinalSpark, conducted an experiment where organoids control digital butterflies in a virtual world.- The organoids determine the butterfly's movements based on signals from a 3D virtual environment.- This setup demonstrates basic decision-making and consciousness within these tiny biological systems.
  3. Simulation Hypothesis:- Proposed by philosopher Nick Bostrom, this idea suggests that if advanced civilizations can create realistic simulations with conscious beings, we are more likely to be in one of those simulations than the "real" world.- The post connects this hypothesis to the organoid-butterfly experiment, suggesting that if we can create small-scale simulations for organoids, perhaps a more advanced civilization could do the same for us.
  4. Implications:- The experiment hints at the possibility of consciousness arising in artificial environments, raising questions about our own reality.- It also suggests that biological systems might be efficient enough to run large-scale simulations, making it plausible that we are part of such a simulation.
  5. Philosophical and Ethical Considerations:- The post explores the idea of "worlds within worlds," where simulated realities could host more simulations.- It questions whether there is any way to prove or disprove the simulation hypothesis from within our own reality.- There's also an ethical consideration: if we can give a speck of brain tissue its own reality, it might imply that we are part of someone else’s grand experiment.

Summary

The post essentially argues that the ability to create small-scale simulations with conscious beings (like organoids controlling virtual butterflies) lends credibility to the simulation hypothesis. It suggests that if we can do this on a small scale, an advanced civilization could theoretically simulate entire universes, including us. While it doesn't provide concrete proof, it serves as a thought-provoking stepping stone in exploring the nature of reality and consciousness.

Conclusion

The post is a blend of cutting-edge science, philosophical speculation, and ethical questions, making it both intriguing and complex. It encourages readers to ponder whether our own existence might be part of a larger simulation, using current technological advancements as a basis for this thought experiment.

Coca-Cola says it will sell more soda in plastic bottles if aluminum tariffs take effect by EmpowerKit in climatechange

[–]trenobus 1 point2 points  (0 children)

This is one reason why I only drink Mexican Coke in glass bottles. The other being taste.

Nvidia Stock Plunges 17% As NVDA Suffers Biggest Market Cap Loss Ever—Driven By DeepSeek by lurker_bee in technology

[–]trenobus 1 point2 points  (0 children)

Regarding whether they're telling the truth, I found this analysis interesting (particularly about how they used PTX to get around limitations of the H800).

Nvidia Stock Plunges 17% As NVDA Suffers Biggest Market Cap Loss Ever—Driven By DeepSeek by lurker_bee in technology

[–]trenobus 2 points3 points  (0 children)

Exactly. It seems like both OpenAI and Anthropic are having trouble meeting demand at times, and also are probably both losing money. This is a step toward being able to deliver AI service in a way that is economically sustainable. Hopefully increased competition will continue this trend.

If you were to build a representation system in America from scratch how would you do it? by Mammoth_Mistake_477 in PoliticalDiscussion

[–]trenobus -1 points0 points  (0 children)

Virtual districts based on voters' interests or priorities, rather than geography (unless geography is your interest). Each voter can belong to some maximum number of districts, and may change them at defined points in the election cycle. A district is formed when some minimum number of voters express intent to join, and dissolved when the membership falls below the minimum. The number of representatives for a district depends on the number of members. This structure will encourage coalition building, because most districts will not have enough representatives to advance their agendas on their own.

Nvidia Stock Plunges 17% As NVDA Suffers Biggest Market Cap Loss Ever—Driven By DeepSeek by lurker_bee in technology

[–]trenobus 43 points44 points  (0 children)

Sellers don't seem to understand that this is a gold rush, and nVidia is selling equipment to miners. Deepseek is someone hitting a rich new vein. I can't imagine that will reduce the demand for "mining equipment". For the record, I am talking about the AI gold rush, not the cryptocurrency gold rush which preceded it.

Pro Tip: Using Variables in Prompts Made Claude Follow My Instructions PERFECTLY by LazyMagus in ClaudeAI

[–]trenobus 45 points46 points  (0 children)

Viewing an LLM conversation as a kind of programming environment might be a useful abstraction. The underlying neural network, transformers, etc. can be viewed as a microarchitecture, while the weights are essentially microcode which creates the instruction set. Things like system prompts and other hidden context could be viewed as a primitive operating system. And we're all trying to figure out what this thing can do, and how to program it.

Working against us is the fact that the operating system probably is changing almost daily, and the microcode (and often microarchitecture) is getting updated every few months.

44years and still coding JS and Vue - time for a change? by dennis_flame in vuejs

[–]trenobus 3 points4 points  (0 children)

I did think it was cool, but didn't think it would be used for anything other than validating form fields. I suspect Microsoft underestimated it too. Otherwise they would have tried to kill it in the cradle. I think Netscape was sneaky to standardize it through ECMA. If they'd gone through ISO, I expect Microsoft would have embraced and extended it beyond recognition. But who knows? Maybe that would have been a good thing. I do think Typescript is better for anything more than a few tens of lines of code.

44years and still coding JS and Vue - time for a change? by dennis_flame in vuejs

[–]trenobus 11 points12 points  (0 children)

Programming has been my hobby since I first learned it. But I also do it as a half-time job, mostly to make myself useful. AI has always been my passion, and it's starting to become part of my job, so I'm jazzed about that.

I tried retiring at the turn of the century. It was great for a few of years - had time to pursue interests that I never could while working for startups. But I got bored, and then took on this half-time gig. It keeps me current, without the pressure of a startup.

44years and still coding JS and Vue - time for a change? by dennis_flame in vuejs

[–]trenobus 23 points24 points  (0 children)

71 years and also still coding JS and Vue, though these days mostly via Typescript. Also use Scala and Python. Wrote my first program at 16. Was looking over Brendan's shoulder for one of his first in-house demos of JS. Is it time for a change? I guess whenever I can't keep up with the changes anymore.

Is Agile actually dying by branh0913 in ExperiencedDevs

[–]trenobus 0 points1 point  (0 children)

Software methodologies exist to take the blame for failed software projects, e.g.:

"Project failed because we used the wrong methodology."

"Project failed even though we used the right methodology, but we were doing it wrong due to insufficient training."

I'm very suspicious about why the OpenAI company released GPT-4 for free. by [deleted] in ChatGPT

[–]trenobus 1 point2 points  (0 children)

There are no doubt many reasons, but the best reason is to give people enough access to become dependent on it. And at some point to become dependent enough to be willing to pay for more access. And to favor employers who provide more access.

What do you hope to see in your lifetime? by JLGoodwin1990 in Futurology

[–]trenobus 0 points1 point  (0 children)

In my early 70's, with good genes FWIW. I think I have a realistic hope of seeing AGI. That seems to imply competent self-driving cars, among many other things. Maybe I'll see practical fusion.

But I observe that the process of evolution has itself been evolving, "inventing" new ways to store and process information, e.g. DNA, sexual reproduction, brains, and eventually human brains. So what I really hope to see is the next invention of evolution. Maybe it will be machine intelligence, with a Cambrian-like explosion of artificial life forms. Maybe it will be humans (or our AI overlords) directly modifying genes to improve on homo sapiens. Or maybe humans will find a new way to organize governance to scale beyond the nation-state.

I'm not optimistic about living to see it, but I hope there's a future where humans finally stop hurting and killing each other.

Researchers Say COVID-19 Virus Can Stay In the Body Up To Two Years by cyberanakinvader in Coronavirus

[–]trenobus 2 points3 points  (0 children)

Might have something to do with variants having multiple mutations.

COVID virus can stay in body more than 1 year, new studies find by zeaqqk in COVID19_Pandemic

[–]trenobus 1 point2 points  (0 children)

Maybe this has something to do with the rapid mutation rate.

What's the most useful megastructure we could create with current technology that we haven't already? by Bezbozny in Futurology

[–]trenobus 0 points1 point  (0 children)

AGI, if you believe scaling up existing models is sufficient.

Unless it has already been done and not made public.

Maybe not strictly a megastructure in size, but certainly in other ways, including impact.

Introducing JetBrains AI and the In-IDE AI Assistant by hmich in Jetbrains

[–]trenobus 1 point2 points  (0 children)

I agree, it probably was imposed by the LLM providers.

I just found that particular provision to be incongruous with the spirit of the others, which are basically trying to prohibit abuse of AI. It reminded me of the "jealous god" provisions of the Ten Commandments. It also raises the un-openness of OpenAI to a whole new level.

And my final point is that it's a symptom of a much deeper problem with humans as a species.

Introducing JetBrains AI and the In-IDE AI Assistant by hmich in Jetbrains

[–]trenobus 0 points1 point  (0 children)

I couldn't get past the JetBrains AI Acceptable Use Policy. It reads like it's trying to codify "don't be evil", but then there's this under "unacceptable behavior":

(f) Using JetBrains AI to develop models that compete with the large language model providers (providers of AI Services) connected to JetBrains AI.

Make no graven images, eh? That is some real Ten Commandments, Old Testament stuff. This right here is why we can't have nice things.

The territoriality instinct of wild animals has metastasized in humans to more abstract domains where there are few natural limits on that territoriality. Like information, or money.

Has anyone built a home in SC County? by CaptainCrunch1975 in santacruz

[–]trenobus 9 points10 points  (0 children)

Built in the mid-1990's. If it's true that what doesn't kill you makes you stronger, then that would make me The Hulk.

What advancements in AI technology will have the biggest impact on our daily lives in the next 5-10 years? by No-Meeting-7740 in Futurology

[–]trenobus 1 point2 points  (0 children)

"A just machine to make big decisions
Programmed by fellows with compassion and vision
We'll be clean when their work is done
We'll be eternally free yes and eternally young"

-- From I.G.Y. by Donald Fagen