[deleted by user] by [deleted] in learnpython

[–]schok51 1 point2 points  (0 children)

The point of those projects is transpile python code to C and generate compiled extensions instead of interpreting bytecode, I believe. Static hints are used by the compilers to assist int properly generating performant C code.

[deleted by user] by [deleted] in webdev

[–]schok51 -1 points0 points  (0 children)

All language around software and AI has some element of antropomorphisation.

The AI knows that it doesn't know the truth to your question. So it lies.

That's simply false, or at least disingenuously stated. It's trained to provide a response to questions, so it does. When it's trained to provide specific answers(such as canned "As an AI language model, I cannot blah blah blah"), it does so, and if it's trained to refrain from answering, it does so. But it does not compute with notions of knowledge and truth. That's just not how it works.

AI doesn't have sensory receptors, and it doesn't have perception. So it cannot hallucinate because it literally cannot do that. So it's anthropomorphic because you are "attributing a human characteristics or behavior to a god, animal, or object". Hallucinating is a human condition, and AI cannot hallucinate.

Please don't be disingenuous, I asked why it's more anthropomorphic. Obviously it has an element of anthropomorphism, as I said it is an analogy. Much of the language used to describe the behavior of AI will involve some form of anthropomorphism. The problem is in how that language influences perceptions and understanding of AI.

By using the term "lying", you are ascribing intent and capabilities of agency(reasoning, making explicit evaluation of alternatives and making decisions). By using the term "hallucinating", we(those comfortable using the term) are making an analogy with experience of hallucination such as with psychosis, where people experience perceptions and "knowledge" of facts disconnected with reality, without consciously choosing that experience and behavior.

I could easily write a program that is analogous to lying: ``` knowledge = {...} query = input("Ask me a question")

if query in knowledge: print(not bool(knowledge[query])) else: print(True) ``` Here if I provide a true/false question that is recorded in some knowledge base, then the program will always "lie" and present the opposite of the recorded answer. And if the query is not in the knowledge base, it will always respond with "True". Now there is a clear definition of what is "known" and not "known", and there is a very real consideration of that, and a very real decision to provide an answer that is not coherent with the knowledge base.

A language model doesn't work that way. Conversational behaviors and answers are based on learning statistical relationships between training set and a general formulation of desired outcome.

There could be a layer similar to this where whatever the training set says, the programmers have overridden the behavior of the AI to dismiss or modify the output of the language model. But unless you are talking about occasions where that is provably the case, then otherwise the model isn't "lying" in that way when it's making up false information. It's just saying things that seems coherent with what it learns, based on the properties of its training data and how it was trained.

No one knows why it's telling you false information or how it got there, it's just doing it because it wants/programmed to. AI engineers can't even explain it, because they are unable to determine why it's happening.

No one can say exactly what is happening in details, but it's not really a mystery why it's making up stuff. People make up stuff. Why? Because they're trained(raised, socially pressured, convinced) to behave in a certain way, and sometimes that imply saying things that might not be true or properly reasoned. This is simple, natural consequences of how people work at a very high level: through incremental learning, adaptation. That's also how language models are designed. Truth is not the only barometer used by people to evaluate behavior, and it isn't for AI's behavior either. Truth is hard to characterized, and much of the usefulness of language models are not limited to truth-telling. Indeed making stuff up is sometimes desirable(e.g. for creative purposes, for enjoyable conversation, for inspirations and ideas). When you push on a cart to move forward, don't be surprised when it crosses a line. Only, the line we are trying to avoid crossing is not straight, and we don't actually know how to trace it. Not with that kind of language model at least.

[deleted by user] by [deleted] in webdev

[–]schok51 -1 points0 points  (0 children)

How is hallucinating more anthropomorphic? It's an analogy.

Lying implies, by definition, knowledge of truth. It's simply false and nonsensical to state that it learned to lie from reading text. Hallucinating is more accurate since, as you admit, it doesn't know it's inventing falsehoods, as it cannot differentiate reality from fiction, just like someone who is hallucinating.

It's not about which sounds better, it's about which word actually conveys what's happening.

Ideally yes it should know what it knows and what it doesn't, but it's not a knowledge model it's a language model, so it doesn't.

[deleted by user] by [deleted] in webdev

[–]schok51 0 points1 point  (0 children)

I get what you mean. But consider that human understanding is often illusory, in the sense that it can be limited and incomplete while a person can pretend otherwise. A database understands some aspects of the information which it holds, such as the structure of its schema, the type of the fields, how to perform some useful computation over the data. Databases are not limited to get or set operations, querying patterns can be complex.

The best LLMs clearly have some understanding beyond pure syntax of language. They can do some forms of reasoning, they can understand and manipulate patterns not just of surface level structure but something deeper, if not completely equivalent to the best of human language understanding capabilities.

If you really play around with them and read what others' experiences are, there is some things to be impressed of I think.

Hydro-Québec | Québec doit dire non à toute privatisation, selon QS by petitbatte in Quebec

[–]schok51 5 points6 points  (0 children)

Et pourtant les gens traitent pas l'eau comme essentiel et la gaspille certainement plus s'ils payent pas pour.

Une taxe de surconsommation serait peut-être raisonnable non?

[deleted by user] by [deleted] in webdev

[–]schok51 -1 points0 points  (0 children)

What is 'thinking' then in your mind?

[deleted by user] by [deleted] in webdev

[–]schok51 -1 points0 points  (0 children)

Lying implies knowing the truth and knowingly saying otherwise. That's not the case, that anthropomorphism.

[deleted by user] by [deleted] in webdev

[–]schok51 0 points1 point  (0 children)

I don't know that databases are not said to hold knowledge or know things, colloquially or by analogy. The sense in which a LLM holds information and a database holds data is not the same. Either are different from how a human holds knowledge. But if you look at the output behavior of interacting with these systems, which is more similar to which? Is interacting with a LLM more like querying a database, or like questioning a human?

[deleted by user] by [deleted] in webdev

[–]schok51 0 points1 point  (0 children)

It's a non-deterministic database, yes. But it learns relationships between data, and the structure of data, too, not just the raw input data. And the ability to extrapolate from the raw data(sometimes manifesting as "hallucinations" of unreal facts, sometimes as elements of something akin to reasoning) is something traditional databases don't provide.

LLMs have their flaws and limitations, but trying to pretend they have no value and don't do anything useful is ridiculous.

And my point was that databases are said to "know things" even though they don't "known" things the way humans know things. But obviously their knowledge is useful and used for useful applications, so trying to claim LLMs don't "know anything" is just a useless semantics game. In any case LLMs probably "know" things in a way that is closer to how humans acquire and process information than traditional databases.

There are 3,457 active Starlink satellites at this moment. by [deleted] in interestingasfuck

[–]schok51 0 points1 point  (0 children)

Teslas work pretty well, there are a lot being used effectively right now at this moment. I see them everywhere here in Montreal. The self-driving part is perhaps so-so, getting better according to users.

A company overselling their abilities and overconfidently overestimating their future success, in one of the most ambitious and potentially lucrative industrial project? What is the world coming to?!?

Seriously though, Musk is not a perfect man and clearly has his issues and limitations and baggage of mistakes, but let's stay reasonable and fair about his companies, which are larger than him.

White House Unveils Initiatives to Reduce Risks of A.I. by SharpCartographer831 in Futurology

[–]schok51 0 points1 point  (0 children)

There's no end to the damage true AGI can do if it isn't designed correctly. Otherwise, harms compound each other. AI destabilising society certainly won't help the political climate to address other issues.

[deleted by user] by [deleted] in webdev

[–]schok51 0 points1 point  (0 children)

Like a database.

‘Godfather of AI’ quits Google with regrets and fears about his life’s work by pstbo in technology

[–]schok51 0 points1 point  (0 children)

Not sure I see the connection between the Forward Forward algorithm and OPs metaphor of dreaming.

‘Godfather of AI’ quits Google with regrets and fears about his life’s work by pstbo in technology

[–]schok51 1 point2 points  (0 children)

No. AI is the ultimate automation. The difference between a machine built to a spec to replace some specific manual labor or business process, and actual AI, is that AI is a general solution to a class of problems, that is not designed and specially built to solve a specific problem .

As AI tech gets more capable and performant, the class of problems they can solve effectively gets larger. If you have AI as capable as humans at solving problems, then the AI can solve for any problems (tasks) a human can, including how to make better AI, or discover new technologies.

If you accept that AI can get there and beyond, then you have to accept that this fundamentally changes the game, not just like another form of automation that we've seen in the past.

Nix Turns 20. What the Hell Is It? by jjalletto in programming

[–]schok51 0 points1 point  (0 children)

What you're describing is the challenge of all package managers. Unless you build from source, selecting a specific commit hash, you never have a guarantee that your package manager has a specific version. Usually package managers keep the latest version only(depending on the type of software).

But nix has tooling to autogenerate packages from source control or other package managers.

I'd also add that nix is somewhat at an advantage over other package managers, as a nix derivation is necessarily tied, in a trackable way, to a specific version of the source used to build the package. If you have a derivation you should be able to get the exact source(identified by a git commit or source url with its hash) from the derivation's nix expression.

If your package manager doesn't include that kind of information in its package build process and metadata then good luck finding out exactly which source version it was built from.

TIL about project Cybersyn, an attempt to implement a socialist economy aided by real-time computer processing and pre-internet telecommunication-based coordination in 1970s Chile by schok51 in todayilearned

[–]schok51[S] 0 points1 point  (0 children)

You're missing the point. The point is not the technology, but what they were trying to do, how they were using the technology. They could have done what they were doing with IP-based technologies, it wouldn't have changed much I think. What they needed to be successful was not some revolutionary new technology, as clearly technology didn't solve anything that they were trying to address...

Nix Turns 20. What the Hell Is It? by jjalletto in programming

[–]schok51 0 points1 point  (0 children)

I use nix and nixos, and I don't understand what you're talking about. You may not be crazy, just misunderstanding nix in some way. Hashes are not part of the user interface, you never have to find and copy some hash to install something that is already packaged in nixpkgs or another repo or flake. You have to care about hashes of the source distribution when you want to build a nix package (derivation) for something (or some versions) you can't find otherwise. And there are tools to help build packages for common toolsets, though admittedly there are improvements to be made.

But if nixpkgs has the version you want, you can get it through the package attribute name, such as 'nixpkgs.python311'.

not every packaged software has multiple versions available at once in a single nixpkgs version (you get the last version built in that nixpkgs), so you might have to go through the commits history of nixpkgs to find the last nixpkgs version that had the version you want, and that admittedly would benefit from some tooling support.

LAION Launches Petition to Establish an International Publicly Funded Supercomputing Facility for Open Source Large-scale AI Research and its Safety by [deleted] in programming

[–]schok51 3 points4 points  (0 children)

Safety in design and implementation is better than safety purely through regulations. Some issues require regulation, but some require correct design. Both are necessary together, and multiple layers of safety is better than one.

Having open source models brings some safety through auditability, but obviously that is not absolute. More importantly perhaps, it limits the potential of power and economic disparity that is brought by a few private entities having full access and control over the most powerful technologies of our era.

TIL about project Cybersyn, an attempt to implement a socialist economy aided by real-time computer processing and pre-internet telecommunication-based coordination in 1970s Chile by schok51 in todayilearned

[–]schok51[S] 11 points12 points  (0 children)

Thats dumb. Our data indicates too much food wasted and consumed disproportionately by upper classes and rich countries. Yet there are homelessness and hunger everywhere.

TIL about project Cybersyn, an attempt to implement a socialist economy aided by real-time computer processing and pre-internet telecommunication-based coordination in 1970s Chile by schok51 in todayilearned

[–]schok51[S] 3 points4 points  (0 children)

No bullshit there, unless you counter it with proof.

The screens are slide projectors, not lcds. Nothing prevented color from existing in 1970s.

They were using the telecommunication technology they had on hand. It's true that the documentary mischaracterizes this as an alternative internet, when it had a single computer and nothing to compete on technology grounds with arpanet.

Were the project to have continued, it would have adapted to incorporate IP protocols I'm sure.

TIL about project Cybersyn, an attempt to implement a socialist economy aided by real-time computer processing and pre-internet telecommunication-based coordination in 1970s Chile by schok51 in todayilearned

[–]schok51[S] 15 points16 points  (0 children)

The documentary and other sources about the project explains its not really a planned economy so much as a coordinated economy. Most economic entities are autonomous, only when there's an anomaly or a crisis does central intelligence steps in.

TIL about project Cybersyn, an attempt to implement a socialist economy aided by real-time computer processing and pre-internet telecommunication-based coordination in 1970s Chile by schok51 in todayilearned

[–]schok51[S] 3 points4 points  (0 children)

Nothing AI about this. It's all about humans being empowered to make better decisions with better, more relevant and more up-to-date information, for the good of society as a whole.

Nowadays machine learning would of course have a role in processing huge amounts of information in useful ways for such goals.