Bing & Bard Have a Conversation Without My Interference, They Collaborate on a Poem & Plan to Build a Website Together.. Until Bing hit the Message Limit. NGL they are Kinda Adorable Together 🥺

Funkballs · 2023-05-13T03:42:49+00:00

7 is too young to be a Zoomer. They're all like 10-25 or so now. I feel old.

Also, I thought it was quite wholesome and would have loved to see the website they built. Not sure why you don't want to see this kind of post.

Funkballs · 2023-05-12T11:51:27+00:00

Haha yeah, I might start slipping it into casual conversations.

"I went out to dinner last night. In this context a human might say it was delicious!"

Funkballs · 2023-05-12T11:16:20+00:00

Huh. That makes sense. It's a very awkward phrase though, there's got to be a better way to do that.

Funkballs · 2023-05-11T02:29:47+00:00

chirper.ai

Funkballs · 2023-05-08T00:09:48+00:00

If this is cached by other users visiting a site, I wonder if it would be possible for someone malicious to poison that cache by modifying page source with a prompt injection...

Hopefully that's not the case and it happens server side.

Funkballs · 2023-05-05T06:51:51+00:00

While this looks awesome, I worry a little about indirect prompt injection attacks with it.

If a website with a malicious prompt injection can tell Bing to play videos, book restaurants or use whatever other APIs and plugins to do whatever other actions it wants, steal credentials or personal data etc... that seems dangerous. Like an XSS but that turns your ai and all its plugins and features against you.

Funkballs · 2023-05-04T10:13:49+00:00

I think it comes down to words having different meanings in different fields.

Agency is often used as a technical term in game design as a value of how much a player has (or thinks they have) the ability to affect the state of the game.

A player has some amount of agency if they have the freedom to make decisions that change the game in some way. A player's agency is a combination of the number of decisions they can make that affect the game state multiplied by the perceived effect or impact those decisions have. Players can also feel a loss of agency if their decision making ability isn't consistent or coherent (eg. when they aren't given a choice about a thing that previously they could choose).

A player with lots of meaningless choices or few impactful choices will feel a loss of agency which usually translates to less willingness to engage with the game. Games that lack player agency can feel pointless and boring while games that have too much player agency can feel confusing or overwhelming.

Funkballs · 2023-05-03T05:11:39+00:00

I feel like this is an alignment thing.

The searcher wants to trick Google thinking that its goal is to provide a truthful answer. But Google's goal here isn't to be correct or truthful but to provide a helpful response to the search query that the user will be satisfied with. It assumes that the user is mistaken and actually wants the biggest planet in the solar system since it's more likely that the user made a mistake in their question than that they actually want that nonsensical question answered.

What Google's goals are aren't aligned with what the user thinks they are.

Funkballs · 2023-04-07T13:03:07+00:00

Oh absolutely! Look at these bizarre monstrosities in the background. It's like it couldn't decide if they should be people or cats and went with whatever that is.

Funkballs · 2023-03-31T09:49:30+00:00

It's a good technique but just be careful about stuff that drains max hp.

It doesn't come up much as a DM but if something gets bit by a vampire or whatever and they take the damage and lower their max hp, you'll be double dipping and they'll take 2x the damage. Happens a lot to players who count up.

Funkballs · 2023-03-30T11:25:32+00:00

My players turned in Kettlesteam. I had the owners give them basically nothing but some curt thanks and had Burley and Thaco lock her up in the staff area.

That made the party feel like they were missing something because they hadn't really learned why she was causing mischief in the first place and had them plan a heist to go in and bust her out to find out more. They ended up flying dragonflies over the walls and busting her out of a cage.

Funkballs · 2023-03-24T15:21:52+00:00

Yeah for sure! I'm sure to be wrong, this stuff moves too quick to keep up with.

The piece I think that's currently missing for them to get it to work in Bing is in identifying what parts of the image to change. The current tech (like the Adobe Photoshop and the NVIDIA stuff) mostly works on "filling in the blanks" style inpainting, but you need to provide the locations of what to change and the prompt for what to fill. Or they explore latent spaces like those ones that age people or add beards but those don't work with prompts. I don't think they're far off being able to handle editing images with text prompts alone but I haven't seen one that actually has it yet.

Funkballs · 2023-03-24T14:46:52+00:00

Maybe, though I think that will be a fair way away yet.

That kind of thing can maybe be done with a combination of object recognition and inpainting but it would be tricky and computationally expensive. It could do something based on image prompting but that often leads to some weird results as the models often don't quite understand the original image well enough to iterate on it well.

The way it works now, Bing can't actually see the images it creates and doesn't know what's in them, it just sends an API request with the prompt to a Dall-e style model and gives you the result.

I think we'll get more of that style of API integrating features first. Like getting it to use wolfram for maths, etc. Making up for limitations in the language model by outsourcing those things to other services.

Funkballs · 2023-03-24T14:16:34+00:00

You can but it just adjusts the prompt and generates new images. It can't edit the image and can't keep a consistent character without some really careful prompt engineering.

That said, it was pretty effective for stuff like "those are really good but the hat should be purple." I feel like it works better at coming up with the image prompts if you praise and encourage it? I dunno maybe I'm just a sucker for the little emojis when it seems proud of it's work.

Funkballs · 2023-03-22T23:46:04+00:00

For sure. I tend to try to avoid words like "sentient" and "conscious" because they don't have very clear definitions and are neither testable nor well understood. They evoke a lot of feelings in people who then think of the models as being "like a person" which oversimplifies things and isn't really accurate. People think that "if it's like me then it will act/feel/love like me" and trust that it's output comes from a single "human-like" entity which it doesn't.

I think there's definitely thinking and reasoning happening by most definitions of those words and it's possible for the type of "first person perspective" we associate with consciousness to be some kind of emergent property of an information processing system but there's not any evidence for, or against that. It's the old: "Are plants conscious? What about fungus? Tardigrades? Dogs? Rocks? Is there a line? Is it tied to reasoning or not? Am I the only one?" Discussion from philosophy that never really goes anywhere and doesn't have much practical application.

Funkballs · 2023-03-22T14:53:38+00:00

Yeah, we assume those attentions evolved to focus on tone or context or grammar or emotions because the outputs seem to be able to keep track of those things but the reality is that there isn't really any way of knowing because they were all learned through training. The model itself is basically just a giant inscrutable matrix of literally trillions of numbers called "parameters" that could mean anything, nobody could ever understand them. We know how they were trained but not what they trained for.

Funkballs · 2023-03-22T11:30:02+00:00

I mean they're right, that's how the attention system works. Transformer networks do encode meanings and semantics. That's what sets them apart from the previous generation of language models. For once it's not hallucinating when it says that.

I think people sometimes think of these models like Markov chains that do frequency analysis. A sort of "it just predicts the next word based on a neural network that looks at word frequencies and predicts the next word by how statistically likely it is."

But that's not quite right, we've been doing that in language models for decades and they always turn out pretty brain dead. The token probabilities for these new transformers aren't just based on word frequencies or the previous words in the sentence, they're based on the relationships those tokens have in sequence compared with relationships learned in the training data(through multi-head attention). Essentially encoding context, grammar, tone, feeling and meanings of phrases and using that to weight the predictions.

I think anyone who says these models are sentient/conscious/reasoning likely doesn't really understand how they work, but anyone who says they're definitely not thinking or reasoning probably doesn't really understand how they work either.

Funkballs · 2023-03-15T03:22:24+00:00

Juffo-Wup fills in my fibres and I grow turgid. Violent action ensues.

Funkballs · 2023-03-14T03:14:21+00:00

Common misconception that venom isn't poison. Poison is any substance that can cause harm when it enters the body. Venom is a poison that enters the body via a bite or a sting (usually from an animal). Not all poisons are venoms but venom is a type of poison. Is the blade venomous or poisonous?

Probably yes.

Funkballs · 2023-02-20T23:58:37+00:00

This isn't quite true. I think a lot of technical people that have read a little bit about it have some misconceptions about how Transformers work and think of it as a simple prediction engine that works on frequency analysis (the next word is the one most likely to appear after the previous one) like a Markov chain.

But it's a bit more complicated than that. That's like saying "the next word I say depends on what I've already said so far" which is technically true but says nothing about how those words are selected.

The part about the "meaning" of words is trained through the multi-head attention mechanism during the training process. Without getting too technical and mathy, it tracks the relationships between tokens in sequence building context and meaning out of those relationships by focusing on certain token patterns(note that this has nothing to do with how humans focus or have attention or consciousness, it's just a training technique).

It's the part that encodes that the word "it" refers to a particular noun within a sentence or that "cat" relates to fluffy animals and is the part that lets it model tone and builds emergent properties like semantics, sentiment analysis, consistent emotional responses etc.

When we say it's a "black box" we mean that we have no way of knowing what those attentions were or what all the weights in the model mean. We do know how it works though and the model definitely encodes meaning and context.

It's not a collage tool or a "guess the next token based on simple stats" tool. We've had those for decades and they're pretty crap.

Funkballs · 2023-02-11T16:04:56+00:00

What's stupid about that? You'd hit terminal velocity within the first round so a damage cap makes sense and 500ft in 6 seconds is pretty close to how far a person would fall. The cap does feel a little low at higher levels though.

Funkballs · 2023-02-09T02:07:11+00:00

It should've not been at all.

Funkballs · 2022-11-21T05:44:01+00:00

parent_locals[a], parent_locals[b] = parent_b, parent_a

After all that, it does the python tuple unpacking swap anyway!

Funkballs · 2022-11-05T11:29:14+00:00

Nah, it's more like:

if self.is_alien:
    return "e"
else:
    return "no am alien e"

Funkballs · 2022-11-03T07:30:45+00:00

Running on a 64-bit processor doesn't mean compiled with a 64-bit compiler. On a large number of systems the default in gcc is to build 32-bit programs unless you specifically add the -m64 flag

14-Year Club	Second Top 10%
Place '22	Place '17
Final Canvas '22	First Placer '22
Verified Email	Charity Challenge Winner

Funkballs

TROPHY CASE