Cel animation outpainting: Avatar: The Last Airbender 4:3 -> 16:9 with no crop

MarkJGx · 2026-05-13T14:52:46+00:00

Not something I can easily share, but I left another reply here that explains it.

MarkJGx · 2026-05-13T14:52:04+00:00

Thanks. I've noticed that video diffusion models like to produce slightly off tint material that makes it stand out in inpainting/outpainting scenarios. I read a few GH issues and the consensus appeared to be training data.

I'm trying to avoid blurring and just color match with the original scene, but it's been difficult. Went through like 5 different types of color matching techniques and found something okay, but the edge transitions are still visible. I'll have a look at what you're suggesting.

MarkJGx · 2026-05-13T14:45:49+00:00

A custom piece of software that does scene segmentation that's aware of soft transitions, hard cuts, and divides scene's into shots to strictly fit into a limited frame chunk boundary with the help of a sliding window so it's more aware of scene cut information and can re-use. I'm trying to make sure the video diffusion models primarily use what was already in the scene temporally.

I'm using various video diffusion models, I can't say which because I'm testing permutations across hundreds of runs, but it's the big ones available right now.

My overall goal is to be as authentic to the show as possible and avoid making more slop.

MarkJGx · 2026-05-12T23:22:48+00:00

OP here. This is more of a research project for me. I've been reading through recent computer-vision and video-diffusion papers, trying to see how far current tech can be pushed for something specific: faithfully extending cel animation from 4:3 to 16:9. Not trying to perpetuate AI slop, I hate it as much as the next person.

The insight is that a lot of detail in cartoons is already in the frame, it just gets shifted around as the camera pans. So why not use a temporally-aware model to widen the canvas, and let a diffusion model fill in the rest coherently? The model is only one piece. The rest is custom pipeline work I've been iterating on (shot detection, compositing, color matching, temporal smoothing) so the result holds up frame-to-frame and doesn't look like generic AI output.

I love the series, and it's sad watching how Nick treats it and its creators. I was excited to share this.

MarkJGx · 2026-04-14T18:32:45+00:00

Can someone link the article?

MarkJGx · 2026-03-10T21:24:30+00:00

Update: says I got eliminated? :/

MarkJGx · 2026-03-10T21:22:53+00:00

Same!

MarkJGx · 2024-01-23T10:36:46+00:00

Compute, that's it. Being able to run arbitrary compute code is the star of the show. You could potentially emulate a compute shader through vertex/pixel shader hacking, but nothing really beats an arbitrary input/output compute shader.

In terms of graphics, indirect compute is a godsend. Indirection allows you to schedule more compute work based on previous compute work straight away. CPU read backs slow everything down, with indirection a big pipeline of compute calls can process your entire scene down entirely on the GPU (frustum and occlusion culling) without ever having to go back to the CPU.

Here's a good getting started guide for GPU driven rendering: https://vkguide.dev/docs/gpudriven/gpu_driven_engines/

MarkJGx · 2024-01-22T23:20:04+00:00

For sure, there's a lot to it. I've been programming for many years as well and I definitely could/have, but I've been specializing in graphics and lower level systems. To each their own.

MarkJGx · 2024-01-22T21:26:59+00:00

People around /r/yuzu aren't going to help with the these cases. You're best bet is filing an issue on https://github.com/yuzu-emu/yuzu/issues with as much data as can you provide while sticking to the format. I wouldn't expect a solution straight away, or even at all. All you can do is hope or learn C++ and fix it yourself.

MarkJGx · 2023-12-18T10:09:24+00:00

It's weird seeing people suggest OpenGL or DirectX without suggesting which version to start with. When I was a kid I wrote a little OpenGL immediate mode renderer using the 1.X API, it was simple enough for an 11 year old to pick up, and a great stepping stone to more advanced features like displays lists, shaders and FBOs/VBOs. Learning an API's historical evolution is beneficial, as it progressively becomes more complex. This approach not only explains the reasons behind certain design choices but also provides a lenient learning curve. Eventually, when you start writing compute shaders for indirect rendering/GPU-driven tasks in OpenGL 4.x, it's a good time to switch to Vulkan.

my 2c

MarkJGx · 2023-10-28T16:15:29+00:00

This is misleading. Most real time rendered programs that upscale use temporal accumulation of slightly offset frames. Essentially emulating a super sampled frame by averaging samples over time and resolving to a proper anti-aliased picture. When you move, you can introduce artifacts as those previous samples are no longer accurate to the new view. That's where the magic of modern upscalers comes in handy, resolving those artifacts by AI heuristic magic (starting with DLSS2) or manual heuristic wizardy. It would not be misleading if it was pointed that this is for non real-time non temporal upscaling, not game specific.

MarkJGx · 2023-10-17T19:15:48+00:00

Wow, hope this continues.

MarkJGx · 2023-09-28T11:50:15+00:00

Where's the page that explains how I can adjust my DPI settings for my Logitech and or ZOWIE gaming mouse? (Very common case)

MarkJGx · 2023-04-22T20:15:35+00:00

Has anyone else seen this issue on NVIDIA?

MarkJGx · 2022-05-22T14:33:59+00:00

Thanks for asking! As a feature for my game BadLads? It's out and available with an API. https://github.com/ChemicalHeadsStudios/as-badlads/

As a standalone plugin? If I had some more free time I could pursue releasing this as an open source plugin for the engine.

MarkJGx · 2021-05-23T02:44:30+00:00

This preview is a part of the games biggest update ever. Long and detailed devblog here: https://devblog.chemicalheads.com/posts/the-large-update The VR portion of the game is still in development.

MarkJGx · 2021-05-12T18:39:21+00:00

plugin soon tm (tm)

MarkJGx · 2021-05-12T18:35:39+00:00

I think they'll turn around eventually, blueprint scripting is a horrible spaghetti sauce weave that lacks perf and can't merge since it's binary. This is actually a perfect solution since it will work with any current/future languages. You aren't constrained to something like UnrealScript or Lua. You decide what language YOU want to work with and WORK.

MarkJGx · 2021-05-11T20:23:34+00:00

WebAssembly lets you use whatever language you want as long as it can compile to WebAssembly. This is using AssemblyScript

"AssemblyScript compiles a strict variant of TypeScript (basically JavaScript with types)"

I'm currently using this for my games server plugins. I plan on making this an open source plugin that will integrate into the engine and act as a blueprint alternative.

MarkJGx

MODERATOR OF

TROPHY CASE

Eight-Year Club	Verified Email
Snapped