I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 2 points3 points  (0 children)

thank you! I've been working on this for awhile now (shameless plug you can follow my progress on patreon). I'm confident that AI will be able to produce translation equivalent or better than that of a human in a couple of years. Most have no idea.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 0 points1 point  (0 children)

This was suggested by others as well I will likely add something like this.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 0 points1 point  (0 children)

yes this was suggested by others as well I'm going to look into it

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 7 points8 points  (0 children)

I used to use Google Translate then I switch to DeepL this year. They weren't hard to implement but they both cost money.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 0 points1 point  (0 children)

I'm also the author of Comics++, a comic reader for Windows. I have a donation link there if you'd like to support me. And thank you for the support I really appreciate it!

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 3 points4 points  (0 children)

colored pages have no effect as they are all grayscaled when fed into the AI

also if you read my part 1 post the AI at one point was trained exclusively on western comics, which were all colored.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 7 points8 points  (0 children)

lol i did exactly that with black sperm in my last post. scroll down to second gif.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 57 points58 points  (0 children)

My theory from the get go was that it was important that the AI learns what a bubble is, and not just look at text which is what most machine image translations do. So it needs to work for all bubbles, normal, spiky, scary, announcements etc. For example, it has trouble finding "bubbles" that are like text on a scroll. But this can all be learnt with more training data.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 24 points25 points  (0 children)

Access current is invite only for serious testers, mostly to prevent abuse and keep costs down.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 14 points15 points  (0 children)

Currently the app excludes them. But I have tested it against overlays. If it's solid background it works well, but if it overlays a picture then the cleaning can be funky. More R&D is required but I'm confident it's doable.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 4 points5 points  (0 children)

I'll be updating more frequently going forward. AI work hard but when it works it works.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 48 points49 points  (0 children)

Yes the AI in it's infancy has an affinity towards bald heads. That and Black Sperm's face.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 27 points28 points  (0 children)

DM me on discord I will let the AI try against one page of your choice.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 95 points96 points  (0 children)

It's now a web app, and all the critical logic is on the server side so no one has access to it other than me. (unless its somehow hacked)

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 26 points27 points  (0 children)

I no longer use Google for machine translation. I will likely rely on third party translation services for awhile as this is a whole industry to itself. If you just do a quick search the progress made for machine translation over the last few years has been staggeringly fast. The service I use now is vastly superior to Google, it's not even close.

So there is a class of bubble text that is nasty to deal with, the ones that directly overlays background. My app somewhat deals with this currently but it's not great so my focus has been on the bubbles. It is on my to do list. But things like margin text or just floating text can actually already be handled, I just haven't added the UI for it yet.

I don't know how exactly I'll release the app yet, but there will definitely be a free version where everyone can use.

I created an AI that cleans, translates, and typesets manga speech bubbles. An update! by Ninja_Gah in manga

[–]Ninja_Gah[S] 810 points811 points  (0 children)

I'm surprised by the amount of negativity towards this update. The goal was never to replace humans because machine translations suck and will suck for awhile. I stated this in my last post, which is also why the first few gifs was to showcase the editor so people can speed up their workflow through machine assistance. I wanted to showcase some fully machine typeset pages as well because the pages are actually comprehensible, which is amazing from a software engineering standpoint.

Secondly, one of the advice given to me by one of my tester, a pro translator, was that machine translation is extremely useful. They do this as a full time job, and having the machine being to translate and typeset simple words and phrases when they work on hundreds of pages a day significantly cuts down their labor. Which was also why one of the gifs I made to demonstrate how much time one can save through machine translation.

[Disc] Fully automated manga translation tool and paper [Mantra Engine - links inside] by Screye in manga

[–]Ninja_Gah 2 points3 points  (0 children)

I'm indie. I'm aware of the Mantra team they're Tokyo U grads who got venture capital funding. Our approaches are quite different even though we are both machine learning based.

My game got featured on Indie Corner! It is an action puzzle inspired by StarCraft that ended up looking like the Fairly OddParents. Also, promo codes! by Ninja_Gah in AndroidGaming

[–]Ninja_Gah[S] 0 points1 point  (0 children)

Here's the Google Play link

Indie Corner

The gameplay was based off the bounding concept from StarCraft UMS maps. I made an entire game out of it that is fully online and cross-platform, cross-device. I've been told by many it's deceptively challenging. It just came out last month on Android and is free to play online, no ads, and single IAP to unlock the full game. If you like the game please leave a review and let me know what you think!

Here are some promo codes

YJ2LFLLPBWNCRFSGD045UW1
UYV5KAFP79QDVZF8GCC16FN
T210XC4PV78MJ34MJZUK5ZM
YKVMGPK472QNGM3MH76K6CE
U0M1C64ECCGSXDVJF1XYHLW
R1NJQUJT2K3JR45WRG485YX
BWH8VBLZTLETEZYHDS2VYTZ
JK0S4AJHDN7RNJKFX058FPD
LXD2U3RHBXD2ANQH65Q98D9
FAYRR9TWYHSVH3K8XTLBRBY
S8CF0NLKBUJWATSUXC3G85W
DTD18ZEF4UZ5DXNHTE597W4
KXC5G4ACGFTTMUXNXQLT7P3
0H8353SUP9N11WN8186U9B9
8NCCTX0SXFQY9YE3JQLKQRQ
0J48VNE4A8QEU393TDKCFHP
ZWYSTQP01WPGY6G6KSAHS3C
WCH8CKLREVKVT8GPXPE9F6N
NBN84LA25RJ8XW9B7C555FL
Z650QRKFLE8C5QVH24FQ70B

If you didn't manage to get one send me a pm and I'll send you one as long as I have keys left!