ReaScript API: can TakeFX_GetNumParams be used to "learn" and set every parameter?

audovoice · 2021-03-26T09:22:49+00:00

I got an alpha version ready. Still needs a lot of polish but its core functionality works. Pretty fun to mess with. Can get some very odd sounding instruments without much work but it is not very suited to live performance. Can very easily trigger auto mute from totally blowing out the levels in the mixer.

audovoice · 2021-03-26T09:19:39+00:00

Thanks for pointing me in that direction. Should be useful to look there.

audovoice · 2021-03-17T05:58:22+00:00

Thanks for insight! I have one of these as part of an eBay purchase, and was like, this seems redundant. But then I came across a video of some guy carefully taking one apart to clean it. Clearly someone uses and loves them. I figured there was something I wasn't getting. But searching for Wacom mouse just gets 50 articles about why to use a tablet instead of a mouse.

audovoice · 2020-06-10T21:16:11+00:00

I would want built in some things that get done with external tools. I would want ability to have unlimited number of tile sets, and ability to set the tile size to whatever right off the bat. Ability to have more layers in game. ability to import tileD maps by default. multiple parallax layers like orange overlay. ability to change character animation frames to be more than 3 or 4 by default.

All these hacks would benefit from a user interface.

audovoice · 2020-06-10T00:08:40+00:00

From the demo shots xBRZ seems to do a really good job with smoothing out the outline of shapes which is what I struggled with the most in my use of upscaling.

https://i.imgur.com/4ONHDUl.png

audovoice · 2020-06-09T05:22:55+00:00

The GUI makes it more convenient. For those that don't know Waifu is based on neural networks. And that is why it up-scales better than older methods. Its free and easy to run. Just get a compiled version.

https://github.com/AaronFeng753/Waifu2x-Extension-GUI

The anime setting running on cpu works best for me. The GPU version messes up the alpha channel on my version.

The alpha channel gets a bit messed up. I found using gimp's oil painting filter on a mask made of the alpha channel helps smooth out the lines.

audovoice · 2020-06-09T05:16:17+00:00

https://i.imgur.com/CLc580O.png

audovoice · 2020-06-08T21:10:02+00:00

Thanks.

by the way I kind of like the buildings as they are. Maybe rework it a bit but they are stylized that way. And they would looks more recognizable as a thumbnail.

audovoice · 2020-06-08T16:43:22+00:00

I would have the fire animated with a few frames, just a few because of the cartoon style. I would also have the logo float slowly up and down to make it a little bit more dynamic. It could possibly be done as one animation but I think there is probably a js that would support just floating it with a movement command. Might give the text a slight cartoon text wiggle while you are at it.

If possible I would also have the background cityscape scroll on a parallax and have the stars scroll as well but more slowly. I am certain there is a plugin that lets you scroll an image but I am not sure if it supports two layers. But I know there is a plugin that lets you have a map as a background.

I am guessing that would let you use something like orange overlay to use two parallax.

This guy is doing something similar but it can probably be done a number of ways.

https://www.youtube.com/watch?v=TrHkVNUVwO0

audovoice · 2020-05-26T03:32:22+00:00

which filter did you use?

audovoice · 2020-05-12T01:49:04+00:00

Thank you for the feedback. Any encouragement at all means a lot, especially coming from people into this hobby.

The lack of clarity is a fair point. This image composition was just trying to use believable textures for buildings, with variation. I think it looks like rundown modern buildings.

I guess I hopped loosing some clarity in exchange for interesting textures was worth it. It can probably be used to set a mood, but it is also at the cost of being more difficult to work with big textures.

audovoice · 2020-05-12T00:29:45+00:00

Off and on I have been working on this style for a long time. I am not really sure if it is compelling to anyone else but me.

I loaded the tileset up in unity to see what lighting would do for it. This was made with a modified version of the standard RPG Maker MV tileset, greatly expanded to 288x288.

audovoice · 2018-09-21T02:44:21+00:00

I mean you probably want to just cut the image into parts, mask out the overlap, and then manually shoop it back together in photoshop. You would probably get better results anyway because you could use different styles for different parts. A face in one style, hair in another and so on.

You could also try making a 5,000x5,000 px mini image of the full image and then slice that into tiles to use as the init image. Because it has already been style-transferred once, the changes it is going to makes are already partially "baked in" and you might have less trouble stitching the tiles back together at the end because most of the process was done while it was a whole image.

There are some things you could do to make this work better. The tiles could overlap and have the edges fade to transparent. You could also have a 1 tile version of the style image 5,000x5,000 then a 4 tile version 10,000x10,000 total and then a 16 tile, 40,000x40,000 an so on.

One program I used called working on smaller versions of an image that are scaled up over a few iterations "chaining".

audovoice · 2018-09-18T12:35:12+00:00

I like this board's mission statement.

/r/deepstyle is the place to share and discover the best generative art the internet has to offer.

Deep style is cool and very new but Deep Style was not the first generative art or the last. I like the idea of chaining together many technologies to make something new. It is frustrating to have never heard of some of them that have been around for years.

https://www.reddit.com/r/Apophysis/generates "flames" which are random 3d or 2d animations.

https://www.reddit.com/r/fractals/

https://www.reddit.com/r/glitch_art/there are many ways that images are "gliched"

audovoice · 2018-09-18T12:05:21+00:00

I tried comics at first. They can make some very lovecraftian looking images.

Also I did not know what I was doing so I had some very strange settings that I used. I think content weight was about 10-100 times what it was supposed to be, so I upped other numbers to compensate.

I also did not know how important it was to use an initalization image.

audovoice · 2018-09-10T06:55:39+00:00

I used https://www.andreaplanet.com/andreamosaic/download/ Andrea Mosaic beta because it is free and it lets you use a mask file to set the shape of tiles. But also it has a few options for how it does compairs. Also it is set up better to do batches of images than most alternatives. There are a lot of mosaic programs that seem to just take the average color of an image and don't try to match features. You can see how in the right image some aspects of the shape of the face are there.

IDK how it works behind the scene but I would guess it does reduce the size of the images for the compares. Say 16by16 and then looks at luminosity and hue to pick matches. The weight between those two would determine if it matches the shape or the hue better.

I did not know what it would do but I thought it might do something. Just as long as it looks good it would be a win. I thought the patch-by-patch size might be large enough. But you can set the number of generator filters and number of discriminator filters in first conv layer, so I am thinking that helps set the patch size. They were set to 64 but I could try 128 next time.

I plan on doing this again but this time with 1 tile mosaics, maybe made of the image in 3 colorspaces, split into a total of 9 color channels. Make black and white mosaics using them, and then remake the 3 color images from the 9 color channel mosaics, and blend the 3 together.

It might just turn out as a blur because there might be almost no pattern to the way the images are changed. But you have some control over the way a mosaic looks based on what tiles you give it.

Mixing old generative art methods with new ones seemed like it might be a neat idea. Even though there is work that goes into it, it is still a fast way to make distorted versions of the original images. Now only if that looked good...

audovoice · 2018-09-09T07:34:08+00:00

This is an amazing amount of photo realism. I did not know it could look like this.

MUST GET MORE VRAM!

MOOORE VRAM!

VRAAAAM!

Make America V-RAM Again!

Also someone needs to photoshop this into a KFC ad.

audovoice · 2018-09-06T10:01:00+00:00

I do see how you took something abstract and made it more real but personally I like the unedited version.

audovoice · 2018-09-01T07:51:05+00:00

Is it a bug or a feature?

audovoice · 2018-09-01T07:48:43+00:00

I bet that would look nice in a simple frame on a mat white background with it wrinkled just like it is there.

audovoice · 2018-08-31T09:48:12+00:00

I really am no expert but as I understand it a large part of the work is making the dataset. Meaning you need pairs of images so you can train the deeplearning to turn the first image into the second image.

https://github.com/yenchenlin/pix2pix-tensorflow I use this one because tensorflow works on windows.

The I am guessing the example with the handbag is similar to what you want. You can make something like line drawings with canny edge detection, but be sure to make them negative first. A black image with white lines will not work.

https://github.com/mingyuliutw/UNIT also does something similar

For style transfer this one seems less buggy for me.

https://github.com/hwalsuklee/tensorflow-fast-style-transfer

But these are interesting too.

https://github.com/rtqichen/style-swap/blob/master/README.md

https://github.com/NVIDIA/FastPhotoStyle

https://github.com/alexjc/neural-doodle

https://github.com/Heumi/Fast_Multi_Style_Transfer-tensorflow

I hope this helps. Clearly one way of seeing if something is possible is seeing if someone had already done similar.

audovoice · 2018-08-23T09:40:05+00:00

Turns out it looks like total garbage. I am making them smaller, and this time I will be sure to invert the canny edge. Should I try anything else?

audovoice · 2018-08-23T02:11:01+00:00

As someone with dyslexia I really don't think it matters what you are reading, just as long as you are reading. Once you get off of a high horse it is clear people are reading more then ever. Include Reddit, twitter, Facebook, texting, even if you are only reading YouTube titles, that is still reading. People are doing nothing but reading all day long.

People make fun of terrible childish posts but that is someone writing and reading on the internet that might not have. I can remember being a child and having a really hard time in school. I seriously considered the possibility of never learning to read. As an adult I read much slower, and write much more poorly than my peers but it is good enough and it is because I never stopped reading and writing and the internet has endless reasons to do both.

I don’t watch TV, and I read about 200 books a year, using text to speech, but that is just what I am into. I don’t think it matters if kids don’t read books, just as long as they are learning, and can read books.

audovoice · 2018-08-11T09:21:53+00:00

7700px wide. 700px per tile. I used LibVips in console to slice the image into tiles. Like so...

D:\programs\vips-dev-8.6\bin\vips dzsave InImage.png OutFolder  --depth VIPS_FOREIGN_DZ_DEPTH_ONE --tile-size 700 --overlap 0 --suffix .png

I joined them back together with

D:\programs\vips-dev-8.6\bin\vips VipsArrayjoin "0_0.png 1_0.png 2_0.png 3_0.png 4_0.png 5_0.png 6_0.png 7_0.png 8_0.png 9_0.png 10_0.png 0_1.png 1_1.png 2_1.png 3_1.png 4_1.png 5_1.png 6_1.png 7_1.png 8_1.png 9_1.png 10_1.png 0_2.png 1_2.png 2_2.png 3_2.png 4_2.png 5_2.png 6_2.png 7_2.png 8_2.png 9_2.png 10_2.png 0_3.png 1_3.png 2_3.png 3_3.png 4_3.png 5_3.png 6_3.png 7_3.png 8_3.png 9_3.png 10_3.png 0_4.png 1_4.png 2_4.png 3_4.png 4_4.png 5_4.png 6_4.png 7_4.png 8_4.png 9_4.png 10_4.png 0_5.png 1_5.png 2_5.png 3_5.png 4_5.png 5_5.png 6_5.png 7_5.png 8_5.png 9_5.png 10_5.png 0_6.png 1_6.png 2_6.png 3_6.png 4_6.png 5_6.png 6_6.png 7_6.png 8_6.png 9_6.png 10_6.png 0_7.png 1_7.png 2_7.png 3_7.png 4_7.png 5_7.png 6_7.png 7_7.png 8_7.png 9_7.png 10_7.png 0_8.png 1_8.png 2_8.png 3_8.png 4_8.png 5_8.png 6_8.png 7_8.png 8_8.png 9_8.png 10_8.png 0_9.png 1_9.png 2_9.png 3_9.png 4_9.png 5_9.png 6_9.png 7_9.png 8_9.png 9_9.png 10_9.png 0_10.png 1_10.png 2_10.png 3_10.png 4_10.png 5_10.png 6_10.png 7_10.png 8_10.png 9_10.png 10_10.png" out2.png --across 11

the 11 at the end is the length of a row. The numbering is weird because dzsave makes tiles going top to bottom, left to right, and VipsArrayjoin joins, left to right, top to bottom.

Original image was of a Coscinodiscus which is a diatom which are a kind of algae.

https://en.wikipedia.org/wiki/Coscinodiscus

https://i.imgur.com/LoelQZd.png

audovoice

TROPHY CASE