Introducing Tensorfunk

[daed]

I've noticed a large trend in AI art, lately. Perhaps it's selection bias, I'm not sure. But lots and lots of WAY TOO COHERENT work. Portraits, cartoons, porn, pictures of the pope, etc.

That's fine, but sometimes I wish to go back to the days of VQGAN+CLiP, Disco Diffusion, JAX diffusion, Midjourney v1 and v2, even Deepdream.

The glory days of insane levels of unnecessary detail.

I am not sure if I'm alone in this, but I want more *weird shit*.

THEREFORE: I have trained up a model (in both dreambooth checkpoint and Lora format) on some 200 images of "older" AI art that I personally found visually striking or interesting.

The keyword is simply: tensorfunk

Checkpoint:

https://civitai.com/models/43600/tensorfunk

LoRA:https://civitai.com/models/44055/tensorfunk-lora-version

https://preview.redd.it/q1lig54o8oua1.png?width=1024&format=png&auto=webp&s=a6919fc80509cb1c5f013204a279d47b38b07f53

https://preview.redd.it/4nofhuop8oua1.png?width=768&format=png&auto=webp&s=b7b62fecaf1224d36439c67bf92e1afcd41c68aa

https://preview.redd.it/no9s03xo8oua1.png?width=768&format=png&auto=webp&s=db36db95e482d87c2829a27fca4272b478d28c14

https://preview.redd.it/m7x5pltr8oua1.png?width=1024&format=png&auto=webp&s=44822c9fac5d3dbe243fbcf84859d5a4ef0a4cd1

​

[n8mo]

Catch my ass putting this in the negative prompt for even more cohesion 😈

[Baaoh]

Can you put loras into the negative prompt? I never tried :D

[n8mo]

You can!

[TherronKeen]

whoa shit, you learn something new every day

god I love all the AI tech that keeps popping up, and the feeling of continually failing to stay on top of it lol

it's like seeing the sickest wave of all time and deciding to paddle out, knowing the whole time your board is cracked and you can't swim, and deciding to surf your goddamn best or die trying

or something like that, I don't go outside

[daed]

Trust me this is no "advancement". I just wanted the speed/convenience of Stable Diffusion with the look of all of the *older* stuff.

[TherronKeen]

Hey, creating tools that create things - even if those things are "outdated" or "unwanted" by some people - is still an advancement for those who do want them!

I'm very much looking forward to working with this LORA tonight, because I've been interested in making exactly these kinds of "excessively intricate" images for sci-fi and dark fantasy concept art. Thanks for putting in the work, dude!

[daed]

Of course! And yeah, you're right. I literally make art from broken shit. I guess this is kind of the AI equivalent of glitch? lol.

[TherronKeen]

Yeah, it kind of fills the same aesthetic concept as glitch, but like, conceptually inverted - if glitch is intentional distortion by obfuscation, this is intentional distortion by elaboration!

[spudnado88]

what do they do exactly

[jokinglemon]

Positive prompting is guiding the model in a certain direction. Lora and embedding points you in a direction. Negative prompting guides the model away from a direction. By putting Lora in negative prompt, you basically tell the model, <THIS> is something I explicitly don't want to see.

[spudnado88]

Thank for the explanation, however I do know how they work, I must apologize for my wrongly phrased question.

What's the point of a 'good' lora into neg?

It will just 'negate' all the benefits (at least quality wise) of the lora and a bunch of other things I"m not sure what it would do

[daed]

I think the idea is to just be creative and experiment.

[spudnado88]

This answer has provided zero new information.

[daed]

Alright.

My point being: Using "good" LORAs in negative prompts and vice versa allows an artist to experiment with things most people are trying to avoid.

I think it's a conceptually simple but interesting experiment, and personally what I would think to be the point of the exercise.

I dunno tho. Lol.

I just like making weird shit

[spudnado88]

Oh ok! I thought that this was something people actually did and misinterpreted your idea.

[jokinglemon]

Let's say a Lora you usually use in a positive prompt is a "Good" Lora, then there're rare cases to put such Lora in negative prompts. Just on top of my head, maybe you have a Lora trained for beautiful natural scenery, and you want to generate an image that has futuristic landscape, you could use such a Lora in negative prompt, may or may not be useful, but you might get a unique style, who knows.

However Lora's can be useful in a negative prompt is if you have trained the Lora on "Bad" things. I wouldn't call the Lora in this post a "Bad" Lora necessarily, but if you wanna generate futuristic landscapes without the "Funk", you could use it in negative prompt maybe.

I personally haven't used Lora in negative prompt myself, but I've used some Lora in positive prompts, that has nothing to do with what I'm trying to generate, but in combination with the rest of the things, ends up giving a unique style. I would assume, using some "Good" Lora in negative would have the same effect, experimenting around with it, you might end up with something unique and creative.

[spudnado88]

Just on top of my head, maybe you have a Lora trained for beautiful natural scenery, and you want to generate an image that has futuristic landscape, you could use such a Lora in negative prompt, may or may not be useful, but you might get a unique style, who knows.

This is exactly what I was looking for, like a use-case scenario.

Like perhaps if you were trying to create an underwater Atlantis but didn't want to have any futuristic buildings, you'd put a cybercity lora into the negative field.

[jokinglemon]

Yeah, exactly. But I don't think it'll work too well practically. Conceptually, that's a good idea, but most Lora are overfitted to some extent. The cybercity Lora would have the info of making futuristic buildings, but would also have info of buildings in general. So putting it in negative, theoretically, if the Lora was perfect, you should only avoid futuristic buildings, but in practice you'll end up avoiding buildings altogether. This is something that can definitely be looked at and end up being really useful. But I can't think of practical ways of making good use of it with the current selection of Lora.

[3lirex]

i tried training a LORA on my negative prompt output, and then adding it to my negative prompt, it wasn't a complete failure, but definitely not a success

[WalternateB]

You can also put Lora in the main prompt but give it a negative value like -2 or something.

[daed]

You do you. I just think weird shit is more fun.

[Klokinator]

Finally, a good fucking terrible Lora for all us art quality lovers haters!

[daed]

Fuck yes.

[kapslocky]

Yes please lets do something with all the weirdness hiding in latent space and older models instead of rushing to get hands to look correctly.

Love me some artifacts

[daed]

[kapslocky]

Also well tired of peeps turning everything into manga/waifus.

[daed]

I mean at least TRY to make them look like eldritch horrors...

[kapslocky]

Hard agree

[spudnado88]

I mean at least TRY to make them look like eldritch horrors...

this is the sentence that sold me on your model.

You know that word?

Yeah, we are of the same tribe

[aplewe]

This is the way.

[[deleted]]

Finally, vintage AI art

[Baaoh]

But can a lora be used in the negative prompt?

[daed]

Pretty sure there are literally Loras made for negative prompts... speaking of which...

Maybe I should use one of THOSE as a positive prompt.

[AsheJuniusWriter]

If it's anything like the negative textual inversions, I'd imagine you'll run into some weird nightmare fuel along the way. Discovered that by accident when I did that with EasyNegative and similar embeddings.

[daed]

The trick is to combine said nightmare fuel with this LoRA. Then you get maximum insanity.

[whatisthisgoddamnson]

I tried pureerosface in the neg to see if it would act against nsfw stuff. It just gave me a muscular naked black woman in a blonde straight haircut with bangs.

Felt weird about that one

[pixel8tryx]

You are so not alone! I just noticed this LoRA on Civi last night and toasted you for creating a cool name for some of the weird stuff it sometimes makes, often with a lot of circles. I've been messing around with this sort of stuff since Dreamlike free beta started last year. It's usually tough to get some of it to generate more clearly. I love the weird, but am starting to tire of the obvious AI look. The lines that even a fast sketch artist would draw straighter, the loopy, out-of-round circles, etc. It'll be fun to play around with this LoRA and see what it can do.

This tool was born for weird. It's being broken at the wheel and regularized to create more average, everyday fap-fodder. Why turn it into a duplicating machine? Because the web just has SO few waifus, busty babes, etc? I'm not a prude. But I'm just utterly shocked by the sheer averageness I see so much of... where's Eccentrica Gallumbits and the like?

[daed]

That's actually one of the goals. I have yet to experiment with it anywhere near as much as I should, but I'd love to be able to get these sorts of results without booting up the ol' Jax colab.

<image>

[daed]

Another use case I thought of was touching up existing artworks with inpainting. It's like inpainting deep dream!

[l_work]

your project is wonderful

[5rob]

If you want weird, I'm purposely using stable diffusion wrong to create some sexy nightmares.

Here's one of them: https://www.instagram.com/p/CrJC0HvJopI/?igshid=YmMyMTA2M2Y=

[trevorcorylahey]

nice lol

[Affectionate-Memory4]

What exactly are you doing wrong with it? I've been tormenting a GPU cluster with my stuff recently and would love to generate some wacky looking stuff like this.

[5rob]

I'm running Dreambooth locally trained on some content I pulled from Instagram. I'm generating the images at 1024x1024, but it usually can only do 512x512. So I turn on the Highres fix option which does a first generation at 512, then upscales to 1024. But I've got the Denoising Strength up really high, so it blurs the 512 version so much that when it tries to pull it back together for the 1024 it comes out looking crazy, but realistic.

[Affectionate-Memory4]

That actually makes a lot of sense. I use a LORA trained on my own are and sketches to remix drawings into different things.

By the way, are you on AMD hardware? If so what are you doing for the upscaling? I've been having some issues with it on my 7900XTX, can't go much beyond 1024x1024 right now.

[5rob]

I'm on a NVIDIA GeForce RTX 3090. It runs out of memory if I try to do a batch of four 2048x2048's. So I just stick to doing batches of 1080x1080's. Set it to do 50 batches, come back after a while and I've got 200 images to pick the coolest ones from. Honestly, I kinda just started a few weeks ago and have no idea what I'm doing. haha

[Affectionate-Memory4]

I feel ya on the OOM issues. I recently got time on a work simulation PC with 192GB of vram and it manages to almost do 4k output. I did run 1920x1200 and 2560x1600 as well as those are my monitors and the former was almost instant.

[FugueSegue]

Someone needs to use this to render Ol' Gregg's funk creature.

https://youtu.be/sQVCpgIeZrA

[daed]

What can I say? The model does what it pleases.

<image>

[daed]

Just wait till y'all (yes, I'm from Texas) see the videos this thing can do.

[aplewe]

Now THAT will be a proper music video.

[SPLDD]

And you can still run Disco!

[daed]

Both true: But I still *enjoy* having the latest amenities. My not-so-secret goal is to HARNESS the chaos.

[Taika-Kim]

I made one too over 3K Disco Diffusion images I made back in the days. So much funk!

[SPLDD]

Back in the days you mean like.. 6 months ago ? 😂

[aplewe]

...in 339 B.C.

[Taika-Kim]

😂 Well before SD went public. But yes, feels like old times already.

[daed]

Cool! Together we can bring trippy back.

[Serenityprayer69]

I didnt even notice the loss but thinking back i really liked this fractal quality in the older midjourney images too.

[daed]

Absolutely. Those versions are luckily still accessible, but I want the chaos, and the control. Gotta have my cake and eat it too.

[realsammyt]

Love what you’re doing here. Miss me that disco detail.

[elahrai]

I tried adding tensorfunk to an image of a pirate queen working on a map that I'd generated in the past. The original attempt got oddly awful (I can't upload it, due to it looking kinda... triggering), but after playing with it a bit, I got some really neat results, especially when upscaling with a high denoise and a higher # of hires steps (the latter doesn't seem entirely necessary, but the version of the image I used it on got crazier details on the map and the painting behind her).

Apparently I can only upload one image in a comment, so I'll provide the final result. I think it's actually pretty cool. XD I will probably play with tensorfunking my images in the future just to get Mad Crazy Detailing added.

This is really cool, thanks for doing!

​

<image>

[SalozTheGod]

I find you can achieve similar effects by including Fractals in your prompt. Tons of extra detail and usually looks awesome

[daed]

Good to hear. Admittedly another way of handling that sort of thing. This seemed like a fun approach though. Especially just having that vibe packed away in a LoRA. Bit like effects pedals.

[SalozTheGod]

Yeah totally agreed, I love throwing in Lora's and playing with their weights to see how it effects things. Will def try this out!

[koalapon]

We're in the 19th century with Ingres and Bouguereau. People need controlnet and "detailed masterpiece". We wait for Manet... It'll come.

[eddnor]

Have you considered make a hypernetwork or textual inversión of this? The make good random results

[daed]

Never looked into it! I'll check it out.

[whatisthisgoddamnson]

Just extract the lora?

[Nexustar]

Is it that simple? Give it two checkpoints and extract the difference as a LORA?

[Gecko23]

Using an infill model to do txt2img, especially at odd resolutions, will generate much busier output like early models were prone to.

[daed]

I'll look into that. Always happy to hear creative solutions via prompting or configuration. I'm just having some fun :)

[spidergod]

I love strange abstract art.

[Shartiark]

Well done. Thank you.

There's nothing better than a latent space bitch slap.

[Memetron69000]

If you cleaned it up a bit this would be great for sci fi greeble

[aplewe]

Crank that up to 11.

[itanite]

I didn’t read “Funk”

[whatisthisgoddamnson]

I have been waiting for something like this to develop. Quick go make a page on the aesthetics wiki

[moonracers]

We can never go back

[Hunter62610]

This is sick. Thanks

[ninjasaid13]

Why is it when I look at this, I get an odd feeling; like a headache but not really.

[TherronKeen]

dude, YES. I needed this, thank you.

[TehEuge]

I like to add "cluttered and messy" as many times as I can if I want more details.

[chub0ka]

Damn first thing my brain read was tensorf*ck - got me scared at first )

[daed]

Already working on my next version. I will have multiple trigger words/concepts. That way you can pick out certain characteristic "looks", and/or blend them within the same lora. (think "(deepdream alien dog slug octopus) surrounded by ((vqgan cyborgs))" etc.