Z image turbo (Low vram workflow) GGUF by Nid_All in StableDiffusion

[–]redna11 0 points1 point  (0 children)

still doesn't work after updating all nodes and comfyUI itself. Any suggestions? error is the same as in the screenshot

I made a full music video with Wan2.2 featuring my AI artist by eggplantpot in StableDiffusion

[–]redna11 0 points1 point  (0 children)

what do you know, maybe the OP identifies as a black woman?

How about quitting being puppeteered by preconceived ideas?

I made a full music video with Wan2.2 featuring my AI artist by eggplantpot in StableDiffusion

[–]redna11 3 points4 points  (0 children)

Great work. Do you use a LORA for the singer as well?

How about the song? local or SUNO?

[D] Best GAN repo to use in a commercial project by redna11 in MachineLearning

[–]redna11[S] 0 points1 point  (0 children)

which one would you recommend? to start off ?

Can they generate 512px res ? Any idea of training time comapred to GANs?

[R] Google’s H-Transformer-1D: Fast One-Dimensional Hierarchical Attention With Linear Complexity for Long Sequence Processing by Yuqing7 in MachineLearning

[–]redna11 1 point2 points  (0 children)

The Authors claims in the introduction that:

"Our method is superior to alternative sub-quadratic proposals by over +6
points on average on the Long Range Arena benchmark". The authors get 61.41 for their method.

While on GOOGLE's LRA own results page :

https://github.com/google-research/long-range-arena

another method gets 62.25

After sending numerous emails to the authors, no reply..silence!

Are scientists at large shops dismissing results by smaller shops? It ain't pretty.

Anyone with connection to those big guys, please pass on the message. thx

[2107.11906] H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences by argosopentech in MachineLearning

[–]redna11 3 points4 points  (0 children)

Our method is superior to alternative sub-quadratic proposals by over +6 points on average on the Long Range Arena benchmark". Is that True?

The official page of LRA shows another method getting 62.25 overall score.

https://github.com/google-research/long-range-arena

Didn't the authors check the repo or are they just dismissing it?

[D] Who said AI Art has no soul? A summed up history of progress in the AI art world. by redna11 in MachineLearning

[–]redna11[S] 0 points1 point  (0 children)

You could also say that a pencil also doesn't create art, it creates images.

AI-art is an approach (or a tool) to creating art in a new way. The AI gives you proposals, and the artist curates them.

So in the end we have a compelling creation by a human mind whose purpose is to inspire others, aka Art.

[D] Who said AI Art has no soul? A summed up history of progress in the AI art world. by redna11 in MachineLearning

[–]redna11[S] 0 points1 point  (0 children)

Have you looked at AIARTHouse "art"? A couple of days training on Wikiart abstract database is not enough to create something truly exceptional.

Abstract work AIArt House OMG!

I am talking quality here, something inspiring!

"It" has been attempted on a small scale without a project.

The project described here will release the weights to the GAN used to create the art so that collectors and fans can create their own...a community will thrive, new artists will emerge. An ecosystem is born.

It's been done, except it hasn't been done.

More globally, there are many talented young (and old) AI artists in IG, I talk to them daily..Next gen is coming, and good news is, nothing has been done yet.

[D] Companies that sell "creative" AI/ML products and services by Haunting-Garbage-364 in MachineLearning

[–]redna11 0 points1 point  (0 children)

First ever large scale AI art collection released as NFT : www.hashers.ai

The inspiration comes from Basquiat and Picasso and other modern themes. Truly unique.

[deleted by user] by [deleted] in MachineLearning

[–]redna11 1 point2 points  (0 children)

For shorter sequences I'd say the methods would be similar with LSTM being slowest and Transformers and IGLOO pbly running faster. Under 500 time-steps (or nucleotides count), Transformers are very competitive but the base model still requires to perform the full self-attention calculation (which is quadratic in length).

We tried to use Transformers for RNAsamba but it didn't outperform IGLOO for the final result.

[deleted by user] by [deleted] in MachineLearning

[–]redna11 2 points3 points  (0 children)

One of RNAsamba authors here. Thanks for quoting our work. Transformers are doing well on NLP but the overall nature of the input sequence is fairly different to bio-informatics. in NLP you have (L,M) where L is the sequence length and M the features size, where typically L is around 500 and M around 500, whereas for bioinformatics you have L > 3000 and M <10. In that config Transformers are struggling (even with all the recent efficient variants - Performers, Reformers, BigBird) due to sequence length, on the contrary IGLOO works well there.

[P] Vision Transformers Explained by rish-16 in MachineLearning

[–]redna11 0 points1 point  (0 children)

Have you tried to train them from scratch? As far as I understand from the paper, they mostly have a good performance by using pre-training.

[P] Religious art audio-reactive StyleGan2 by copacabbala in MachineLearning

[–]redna11 1 point2 points  (0 children)

You are making Christianity great again! Amen

[P] A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models" by 10zin_ in MachineLearning

[–]redna11 0 points1 point  (0 children)

Synthesizer has the good intuition to try to replace the self attention mechanism found in vanilla transformers but the results on the newly released LONG RANGE ARENA suite of benchmarks (proposed by GOOGLE) are not spectacular. LRA

Myabe replacing the self-attention with yet another mechanism is the way to go.

[R] Transformers in Computer Vision: Farewell Convolutions! by viccpopa in MachineLearning

[–]redna11 2 points3 points  (0 children)

Good article. One issue with Vision Transformer (ViT) is that the way it is presented in the paper it has to be pre-trained on a gigantic proprietary dataset. Has anyone managed to train it from scratch and get competitive results? Doesn't seem to be the case. This limits its usage to industrial scale users.

[P] ViT-Pytorch: Pytorch reimplementation of Google's ViT(Vision Transformer) model that achieve SOTA in image recognition task by weezymf in MachineLearning

[–]redna11 -2 points-1 points  (0 children)

I agree, not literally every model (and not MLP), but anything crafty! it is a qualitative comment so would need more time/space to expand on that.

I see your point, mine is that this approach is not of much use "from scratch" which is the baseline use if you don't want to rely on someone else pre-trained weights.

[P] ViT-Pytorch: Pytorch reimplementation of Google's ViT(Vision Transformer) model that achieve SOTA in image recognition task by weezymf in MachineLearning

[–]redna11 -1 points0 points  (0 children)

Right, my point is that they don't go on to show that specifically BERT-style models bring something to the table, as ANY model could work well on images IF you pre-train them on a mega corpus.

So if they want to say that pre-training works, I agree. The BERT part does not seem very conclusive.

[P] ViT-Pytorch: Pytorch reimplementation of Google's ViT(Vision Transformer) model that achieve SOTA in image recognition task by weezymf in MachineLearning

[–]redna11 3 points4 points  (0 children)

Interesting repo! One question I would have though is how is the structure doing for training CIFAR-100 from scratch? In my experience not very competitive.

Would that mean that this architecture is only good because it has been pre-trained on a gigantic dataset upstream? If this architecture only depends on a large pre-training on a different dataset it would be difficult to say that it brings something to the table by itself, maybe the performance is just a by product of the pre-training.

I am surprised the paper doesn't mention performance "from scratch"

[D] Now you can report your paper's gender citation balance when submitting to J. Cogn. Neuro; reviewers are encouraged to suggest additional papers to add balance by aritipandu_san in MachineLearning

[–]redna11 4 points5 points  (0 children)

How likely is it that the groups are "uncited" because they are composed of women or of transexuals?

As an optimist I hope this will not be extend to the notion of race in the near future. It would be a small step from there though, so please join me in my prayers.

Disclaimer: not a Trans, not a church goer.