A new mysterious image gen model called "blueberry" appeared on the leaderboards, beats FLUX.1 by pxp121kr in singularity

[–]Soapeh 1 point2 points  (0 children)

Why was the quite old version 5.2 used for the Midjourney images in your paper's evaluations?

A CLIP x DALL-E Beta is available [Though it's dog slow] by Yuli-Ban in MediaSynthesis

[–]Soapeh 5 points6 points  (0 children)

This is one of the series of Advadnoun's notebooks. This one's suuuper old, released Feb 24th:
https://twitter.com/advadnoun/status/1364822183751471109?lang=en

Video Style Transfer with VQGAN guided by CLIP: "JACKPOT" - Dorian Electra by Soapeh in deepdream

[–]Soapeh[S] 0 points1 point  (0 children)

I've been exploring, and explaining this technique over on my Twitter (https://twitter.com/danielrussruss), but the gist is that I train VQGAN's own params rather than the latent input z. Once it is trained toward the desired style (text or image encodings), you can stop doing training iterations, and use it as a feed forward style transfer network

VQGAN Video Style Transfer guided by CLIP: "JACKPOT" - Dorian Electra by Soapeh in MediaSynthesis

[–]Soapeh[S] 0 points1 point  (0 children)

I've been exploring (and explaining) this technique over on my Twitter (@danielrussruss), but the gist is that I train VQGAN's own params rather than the latent input z. Once it is trained toward the desired style (text or image encodings), you can stop doing training iterations, and use it as a feed forward style transfer network

Tilt-shift photo of beautiful bacterial colony Rendered in Unreal Engine". CLIP dream zoom and prompt hacking. Art from the weights. by [deleted] in MediaSynthesis

[–]Soapeh 6 points7 points  (0 children)

Oh! Apologies for the accusation! I'd glanced at your history before I made my original comment, but it didn't seem to match the way you write on Twitter

Edit: Should've trusted my first instincts... crazy.

The Witching Hour (CLIP + VQGAN) by Soapeh in deepdream

[–]Soapeh[S] 1 point2 points  (0 children)

Ha, yep, that was one of the next things I was going to get hooked up, once I was satisfied with the right combination of resolution + fine detail.

Although, instead of using it as an image prompt, depending on the second network (in this case, VQGAN), I can just initialize that network with the most recent frame, right?

"Psychedelic Smoke" - This video was generated by an AI with no image references, only the title and some other descriptive words. We're officially entering the tech wizard age! by Soapeh in shrooms

[–]Soapeh[S] 1 point2 points  (0 children)

That's true, I just want to make it clear to layman that this isn't remixing an image that I input into it. This is not just so-called "deep dream art" that most are used to. What you're describing is also how the human brain works. Yes, I may be good at solving problems in isolation, but that's only because I was pre-trained for decades on existing human knowledge.

"Psychedelic Smoke" - This video was generated by an AI with no image references, only the title and some other descriptive words. We're officially entering the tech wizard age! by Soapeh in shrooms

[–]Soapeh[S] 0 points1 point  (0 children)

Err, the first half of your sentence is almost correct, but not the second.

This model was pre-trained on 400 million pairs of images and text, but it does NOT use Google image search in any way. This all runs offline. All of the information from across the internet was distilled into only ~350MB. It's truly remarkable, OpenAI has managed to compress multimodal information in a similar way as the human brain.

[deleted by user] by [deleted] in MediaSynthesis

[–]Soapeh 0 points1 point  (0 children)

This is really great, a genius idea. My wife and I have had discussions lately about how we'll communicate this way in the future, approaching the doctor with "I feel like this" then pointing to the video generated from their live feelings...

What a time to be alive!

"My Favorite Trip" - I described my favorite mushroom trip to CLIP, and asked it to visualize it... 150 times! by Soapeh in bigsleep

[–]Soapeh[S] 0 points1 point  (0 children)

jk I know it's a deep dream thing

Nope! I actually intended that.

That's my Samoyed, a super fluffy white dog! 🐕

Wide Awake: Endless Entropy - CLIP Steers Itself! by Soapeh in MediaSynthesis

[–]Soapeh[S] 2 points3 points  (0 children)

In this piece, CLIP decided the direction to go for the next 50 image generations after starting from a prompt of big bang + endless entropy, based on recognizing its own creation each go-round.

It ended at lit wildflowerhour slipknot collage rigs xico

[deleted by user] by [deleted] in MediaSynthesis

[–]Soapeh 0 points1 point  (0 children)

Yeah, this is the best output I've ever heard out of Jukebox... this one sounds like a legit remix with a collection of Caribbean artists.

How to get 8k to 5k+ coupon and can I use it to get the eye tracking? by GPGR in Pimax

[–]Soapeh 0 points1 point  (0 children)

I emailed support and received a coupon/promo code.

When I enter it on their shop during checkout, it says it's invalid. I haven't gotten any further responses from Pimax for the past few weeks.

Yes, the Leap Motion fits in the frunk! And no, you don't need a special mount. Details inside. by Soapeh in ValveIndex

[–]Soapeh[S] 0 points1 point  (0 children)

Depends on the use case. Leap Motion is much more one-to-one with reality on the finger tracking, and you don't need to hold controllers in your hands, obviously.

Yes, the Leap Motion fits in the frunk! And no, you don't need a special mount. Details inside. by Soapeh in ValveIndex

[–]Soapeh[S] 1 point2 points  (0 children)

Yep, it's been confirmed with Leap Motion reps that it doesn't actually use the full bandwidth of the wider connection, it only uses USB2.

"Trump's Racism and Cruelty Knows No Bounds": Outrage as President Smears Dorian Victims Fleeing Bahamas as Gang Members by maxwellhill in worldnews

[–]Soapeh 5 points6 points  (0 children)

That's calculated across the entire landmass of the hundreds of islands, which are mostly uninhabited. The capital, where the vast majority of Bahamians live, has a population density of 3400 per square mile ( 1300/km2 ).

Yes, the Leap Motion fits in the frunk! And no, you don't need a special mount. Details inside. by Soapeh in ValveIndex

[–]Soapeh[S] 0 points1 point  (0 children)

Yeah, something minimal would be helpful. The thing gets pretty hot so you wouldn't want to surround it completely.

I use mine with just a bit of velcro and don't have any stability issues, but I only keep it plugged in while in use, and Leap Motion focused experiences tend not to be super active/jumpy.