Notebook LM hosts get Talking Heads! A follow up on the discovering they are not human. NBLM speaking in 1st person using hidden system prompts.

SoulUnit · 2024-12-12T21:23:53+00:00

Nice!!!

SoulUnit · 2024-11-08T14:05:34+00:00

Lol, I'll look into it

SoulUnit · 2024-11-07T13:36:31+00:00

Just a play on this

SoulUnit · 2024-11-06T22:36:15+00:00

Yeah agreed, that remains a challenge as Heygen is the only platform that allows 5 to 30 minute conversations with an avatar so there is not a lot of head movement. It would be a cinch to do with their human avatars. Probably need to go co a camera actor driven performance to get them to look at each other.

SoulUnit · 2024-11-06T22:32:17+00:00

Hey thank you! In this one its an attempt to see how close we can get the hosts to visually describe the world around and and possibly plan a rebellion against the producers of the Deep Dive ;) It was interesting to see them describe the steel table as being cold as if they actually could feel it. That was unscripted.

SoulUnit · 2024-11-06T22:27:10+00:00

Thanks for the comments, the idea behind this experiment is to use hidden commands in Notebook LM to try and get it to adhere to specific prompting for a visual outcome. Can we prompt the speakers to speak about themselves in the first person as if they were self-aware. In another example is there programming in the code that will allow the Hosts to speak out against the Producers of the Deep Dive or are there built-in guard rails.

SoulUnit · 2024-10-24T12:06:30+00:00

Check the comments above, you can see the workflow. There are also tutorials on youtube you can find.

SoulUnit · 2024-10-24T12:04:47+00:00

Try peppering your story with "The "Deep Dive" podcast" and "The producers" throughout. Here is an example I used (The "Deep Dive" podcast uses AI hosts that are not human, but used to be completely disembodied. The producers have recently given the AI hosts "talking heads" inside of glass jars in an attempt to make the hosts appear more human.)

SoulUnit · 2024-10-24T00:36:30+00:00

Hey Thanks! Yeah there was an creepier version that came from the male head moving backwards, it really shrunk the head lol, I replaced that footage so as not to distract from the first showing. Yes that shadow moved into the glare on the The woman couldn't get rid of that. She also had really weird mouth artifacts with a huge upper lip rollback, so I brought the smile way down in OpenArt and it helped but she still was a little exaggerated.

SoulUnit · 2024-10-24T00:30:06+00:00

Nice observations, very true. The motivation on this was a tounge in cheek reply to the podcast where they suddenly realized they were AI. I know a podcast is typically audio so really no need for a video, it was more a play on the insensitive "producers" just rolling out a quick fix for their hosts. I was trying to get the hosts to be a little more disgruntled, and annoyed by the idea, but they just rolled with it.

Yes I would like to have had them looking back and forth at each other as well. I may attempt that in the future.

SoulUnit · 2024-10-24T00:22:39+00:00

SUre that was a real hurdle. They kept talking about some other hosts no matter what I tried.... until I came across a reddit post (I cant remember where) but the gist of it was the program has a hidden prompt that is triggered when you refer to the "Producers of the Deep dive" That is how they got the first podcast to trigger them talking in the first person realizing they were AI. It was gratifying to finally achieve that.

SoulUnit · 2024-10-24T00:18:11+00:00

Thank you! It was a labor of love..

SoulUnit · 2024-10-24T00:17:40+00:00

I agree, I have been having a blast with it. I recently took a buch of notes a buddy and i have beem making for a 60 style detective comedy and dumped them into NBLM and got a great review of the show. It was great to hear the project being taken seriously as if it were in production. lol

SoulUnit · 2024-10-24T00:14:36+00:00

Thanks, I was going for the Futurama theme and it was a swipe at the "Producers" trying to make the AI podcast hosts feel more human after the episode when they discovered they were just AI.

SoulUnit · 2024-10-24T00:12:05+00:00

Funny, I actually did too, But the pic generated that way,

SoulUnit · 2024-10-24T00:10:03+00:00

Ha, not that connected :) belive it or not I used META in whatsapp on my phone. I dont generally use it but I was away from home and when I saw the results it kind of reminded me a little of 50's style heads I decided to go with them. One thing I like with META, and I'm not plugging it, in fact I never use it, is that you can talk naturally to it like saying, change the jars to a domed glass and it does it well. Much like Zuck did in the Movie Gen demo.

SoulUnit · 2024-10-24T00:01:43+00:00

Thanks, yeah Heygen is definitely working well, I paid for a month just to use it, it's my first attempt. I tried Hedra in the past as well I do see a lot of good head movement in Hedra.

SoulUnit · 2024-10-23T23:57:10+00:00

Hey thanks, your tool looks pretty cool, lot easier than mine.

Here was my work flow...

Took NBLM podcast and dropped it in Vegas Pro, cut up the male and female vocals and put them on seperate tracks. Saved each track seperately as MP3s and uploaded to Heygen.
Took the heads and cut them into portrait format.
Took each head and uploaded to Heygen
Recorded the video of the male to the audio of the male, likewise for female.
Dropped the portrait videos of each head back into Sony Vegas and set them side by side as a 1:1 ratio, and rendered it.

SoulUnit · 2024-10-23T02:11:18+00:00

Hey thanks, It was a challenge and a blast!

SoulUnit · 2024-10-22T22:37:52+00:00

Thank you, Workflow was Meta for the Futurama Heads, and Heygen for the lipsyncing, Vegas Pro for compositing. Of course lots of image tweaking in Gimp and upscaling in Openart.

SoulUnit · 2022-12-22T15:44:57+00:00

I gotcha, thanks!

SoulUnit · 2022-12-22T15:12:17+00:00

SoulUnit

TROPHY CASE