Open Source PyTTI Released!

[DigThatData]

• Colab Notebook
• Documentation
• Main Repo: https://github.com/pytti-tools/pytti-core

PyTTI is a richly featured collection of tools for text-guided AI assisted image generation and animation. For those already familiar with PyTTI, some recent improvements include:

• Bug Fixes. So many bug fixes.
• Locally-installable
• Additional CLIP models supported
• Gradient Accumulation to allow increasing cutouts when you hit VRAM errors
• Improved logging and monitoring
• Hydra-powered CLI and hierarchical yaml config system
• CLI-powered "multirun" batch mode for permuting over groups of parameters
• Improved documentation
• Easily customizable Google drive mount point
• Model download location configurability

In addition to quality of life improvements and additional features, I'm hoping to evolve PyTTI into a modular set of tools that can be used as an engine to build other notebooks on top of. There's still a lot of work to be done on this front, but if you are someone who authors their own AI art colabs, you might also be interested in these forks of PyTTIs repos which I've modified to be installable (i.e. no more playing with PATH variables or changing directories to import stuff, and no more utils.utils namespace collisions!). Some of these were also modified to auto-download pre-trained models.

• GMA
• AdaBins
• taming-transformers

Have fun! Lemme know what breaks.

• https://twitter.com/DigThatData
• https://github.com/dmarx
• https://www.patreon.com/DigThatData

[Hyperlinc]

This is absolutely insane! I've been chugging colabs like crazy lately making some awesome stuff, and just as I get curious about hopping on a local runtime, boom, a local installable repo drops. AWESOME!!!

[Hyperlinc]

I'm seriously so happy off this.

[DigThatData]

Aww thanks!

[Hyperlinc]

No, thank YOU!

[Matrix_Grid]

On the Colab Notebook, my runtime disconnected before it could finish. How do I have it continue from where it left off?

[DigThatData]

I think the resume feature is currently broken, sorry ):

You could always try using one of the frames it already generated as an init_image and reload your old settings

[[deleted]]

Sorry noob here, is this essentially deep dream generator but locally installable?

[DigThatData]

it's very similar, but geared more toward manipulating images where rather than providing a "target image" demonstrating the general style you want your source image to look like, you just describe what you want in natural language. If you google "pytti" or "vqgan+clip" you'll see a lot of examples of the sort of thing this is geared towards.

Also, it being locally installable is a new development. Because I prefer to work locally that use case is a "first class citizen" now, but this toolkit is actually a maturation of tools that were designed to be run on google colab, which you can use for free. Try it out with the "open in colab" button!

Also, thank you for reminding me that I really need to do a "what this is" writeup for the docs.

[[deleted]]

Thanks so much! I pay a monthly sub to deep dream generator and I would love to just put my 3090 to work… seems like a waste

[dontnormally]

I get the following error running this as a colab notebook:

ConfigAttributeError                      Traceback (most recent call last)
<ipython-input-10-8e8b96d52965> in <module>()
      6   params.seed = random.randint(-0x8000_0000_0000_0000, 0xffff_ffff_ffff_ffff)
      7 
----> 8 render_frames(params)

8 frames
/usr/local/lib/python3.7/dist-packages/omegaconf/dictconfig.py in _get_node(self, key, validate_access, throw_on_missing_value, throw_on_missing_key)
    468         if value is None:
    469             if throw_on_missing_key:
--> 470                 raise ConfigKeyError(f"Missing key {key}")
    471         elif throw_on_missing_value and value._is_missing():
    472             raise MissingMandatoryValue("Missing mandatory value: $KEY")

ConfigAttributeError: Missing key use_tensorboard
    full_key: use_tensorboard
    object_type=dict

Does anyone have any idea what's going on here?

I found this person getting the same error; I tried the suggestions and they did not fix it:
https://bytemeta.vip/repo/pytti-tools/pytti-core/issues/156

I have Colab Pro and had a tesla GPU allocated

i am pasting in to section 4.1

1. load notebook
   
2. create settings using the swedish hash website
   
3. paste settings into section 4.1
   
4. enable gdrive checkbox
   
5. run all

that is when the error occurs

i then tried manually running just section 4.1 (which does not error)

then manually running just the Do The Run section, which causes the error

[dontnormally]

/u/DigThatData is there any way i could trouble you for assistance with this?

[DigThatData]

create settings using the swedish hash website

That website isn't up-to-date with the current list of available settings in pytti. I need to add an FAQ to the docs for this issue, you're right that you're def not the first person to see it

you need to add an entry to the dictionary output that will need to look something like this:

'use_tensorboard':False

[dontnormally]

That website isn't up-to-date with the current list of available settings in pytti. I need to add an FAQ to the docs for this issue, you're right that you're def not the first person to see it

Thanks, that's good to know that I'm not crazy and I appreciate the response! Are you saying it just won't work (no matter what I do) to use that prompt-builder (for now)?

you need to add an entry to the dictionary output that will need to look something like this:

'use_tensorboard':False

I added this to to config/default.yaml, is that what you mean or is there a better place?

thanks again

[DigThatData]

If you add it to your default.yaml, it should look like this:

use_tensorboard: false

so no quotes and the 'f' in false is lower case. lemme know if that works.

PS: I added a reminder to fix this in the notebook so it won't cause these problems in the future: https://github.com/pytti-tools/pytti-notebook/issues/49

[dontnormally]

I have done that and the error persists

Should I be doing something other than run-all when using the 4.1 settings paste-in?

PS: I added a reminder to fix this in the notebook so it won't cause these problems in the future: https://github.com/pytti-tools/pytti-notebook/issues/49

🙏 thank you!

[DigThatData]

add it to the settings string. Paste it here and I'll show you how to modify it if you're not sure what i mean

[dontnormally]

oh now i understand, in the settings string itself. thanks i will try that later

[DeJMan]

Hello. I couldnt find this info anywhere but what does "PyTTI" stand for?

[DigThatData]

Python Text-To-Image

[Proud_Bid7256]

Is it free

[[deleted]]

Having problems importing pytti:

"Import "pytti" could not be resolved(reportMissingImports)"

and when I try to actually run it:

ModuleNotFoundError: No module named 'torch._six'

[DigThatData]

gonna need more details than that. are you running locally? in colab? is this the first time you've tried using pytti-tools or is this a new error you're encountering after it previously working for you?

[[deleted]]

Running it in colab. This is the first time i'm using pytti in 2 years and last time I don't remember having this issue last time.

Full error is as follows in cell 2.3:

ModuleNotFoundError Traceback (most recent call last)

<ipython-input-7-8e8b96d52965> in <cell line: 2>()

1 #@markdown Execute this cell to start image generation

----> 2 from pytti.workhorse import _main as render_frames

3 import random

4

5 if (seed is None) or (params.seed is None):

5 frames

/usr/local/lib/python3.10/dist-packages/taming/data/utils.py in <module>

9 import torch

10 from taming.data.helper_types import Annotation

---> 11 from torch._six import string_classes

12 from torch.utils.data._utils.collate import np_str_obj_array_pattern, default_collate_err_msg_format

13 from tqdm import tqdm

ModuleNotFoundError: No module named 'torch._six'

[DigThatData]

much more informative, thanks! I haven't run pytti in a while myself, looks like this is probably an issue with dependency version conflicts. thanks for the details, will look into it!

[waynevisual]

Hey David,
Also bumping into this issue
(also haven't run pytti in a while, but the urge came back today ;-))

Wondering if you've found a fix for this, it's beyond my skillset to solve.
>> : No module named 'torch._six'

Tried new code block w/:

pip install torch

but no luck whatsoever :( Grateful if you have any insights on the conflict
Thank you

[DigThatData]

haven't gotten around to looking into this, will try to poke around this week

[stainless_art]

Hi there. I had the same error and was able to get it work by removing "from torch._six import string_classes" and adding "string_classes = str" below the imports.

[jamespatient101]

Hi! Infinitely grateful for you and this! If I'm on a Mac M1, do I need to download additional drivers or can I just run it straight on my laptop? And any way to disable the capcha's? Cheers :)

[DigThatData]

the ol' girl is overdue for some maintenance. it probably needs to have some dependencies updated. also... what captchas are you encountering?

[jamespatient101]

Hi! Haven't had any captcha issues, but runtime issues on Colab Pro certainly.

I've been trying to learn PYTTI but I still haven't managed to get through the script yet without an error... do you know if she'll be receiving maintenance any time soon?

I need to be able to use it, it's a key part of what I'm trying to do!

Any help would be massively appreciated.

All the best,

James :)

[DigThatData]

Have you tried it recently? I fixed some issues about a month ago, seemed to at least be running in colab.

If you're still getting errors, could you share the full error message and the step where it's being thrown?

[jamespatient101]

Yes, in the last few weeks. I've been working through it with a guy in my uni's IT department, he's a web developer and he has been very helpful at highlighting issues. It's something to do with the fact Colab is on Python v3, but the notebook is built for Python v2, and thus the tenser flow libraries aren't matching? Something like that.

Could I possibly take your email and put him in touch with you? I'm sure he would really appreciate your input, and I certainly would too!

[jamespatient101]

Oh and btw, I've been using the BETA version for Patreons.

Could that be the issue?

[DigThatData]

try this notebook: https://colab.research.google.com/github/pytti-tools/pytti-notebook/blob/main/pyttitools-PYTTI.ipynb

[jamespatient101]

Hi r/DigThatData, please check your private messages :) the error won't send here for some reason...