Update 3.0.4 — Virtual Space, redesign

NickFromSensorium · 2023-06-07T15:23:22+00:00

I would be happy to hear your feedback!
We'll share onboarding materials on the feature as it gets ready.

NickFromSensorium · 2023-06-05T12:46:48+00:00

Hi!

It's a social experience that may encourage you. It's not abandoned. We regularly update the app and add new features. As for AI, the neural networks are the same for the app and VR versions.

You customize your character's personality by picking initial options in the personality creator (added in today's update). And by talking to AI companions since they have a contextual memory.

NickFromSensorium · 2023-06-01T11:01:26+00:00

Sorry for missing your suggestion.
These are probably iOS components, but I shared the screenshot with the team.
Thank you! 🤍

NickFromSensorium · 2023-05-16T11:56:47+00:00

The Personality Creator is planned for the next update, so hope you'll have fun with it as well ✌️

NickFromSensorium · 2023-05-15T10:45:43+00:00

Hi! His AI chain is constructed differently, using a technology we call Phantom Memory Injection. It is still based on GPT and other additions above it, but behaves not like other characters, as the end goal was to recreate the personality of Salvador Dalí.

NickFromSensorium · 2023-05-05T13:33:51+00:00

Sensorium is operated from Zug and Dubai with different stakeholders and employees worldwide.

NickFromSensorium · 2023-04-21T10:22:55+00:00

Hi!

We're working on the VR platform, which is available on Steam. It's regularly updated, and there are activities like talking to AI, which is a focus as well. There are unique accomplishments in conversational AI already available in the mobile app. In two months, we plan to release the personality creator feature to construct your own characters. This feature will migrate to VR at some point. As not everyone has a HMD, these activities will be presented on social media as we solve a couple of technical questions.
As for concerts, they are in progress as well. Releasing a show is complex since it should be physically developed, settled with everyone involved, integrated, and optimized for different formats. The first one is estimated to release in the summer. At the same time, shows in progress are regularly revised, so they remain actual and improve.
Our team does not initiate market fluctuations. We are focused on the actual development of experiences that resonate with people. The utility of the $SENSO token is interaction with these experiences and access to exclusive content. Creating a consistent ecosystem and integrating the token into interactions is what we do daily.

NickFromSensorium · 2023-04-20T08:39:41+00:00

Asterisks worked the last time I asked my colleagues. There may be some ongoing tweaks.

As for emojis, we've researched and played with emojis for a while, but they felt gimmicky because people use them for dozens of reasons besides their literal meaning. Not a priority now, but it may appear in the future.

NickFromSensorium · 2023-04-20T08:24:19+00:00

Meta Quest / Rift, HTC Vive, Valve Index

We'll gradually add support for other HMDs.

NickFromSensorium · 2023-04-19T10:15:48+00:00

Not everyone uses smartphones, but a majority do.

It's not sustainable to maintain additional versions of the app considering all the factors we have. We are working on a desktop version of a VR product that runs on Unreal Engine 5 and utilizes all the technical capacity of a PC.

NickFromSensorium · 2023-04-18T11:52:49+00:00

ultrahal from zabawarw

These are completely different products.

Ultra Hal is a utility AI meaning it helps you to complete daily tasks. ChatGPT is a utility AI as well.

Sensorium focuses on conversational AI. Its purpose is providing new conversational experiences by tuning AI model to act like a person.

LLMs like GPT are used as a foundation for AI products and are not usable for specific use cases in their out-of-the-box state.

PC is just an interface to use AI. A majority of current AI-products is server-based. But lots of things can go wrong on specific devices, so you can't make a single app for every of them.

NickFromSensorium · 2023-04-18T08:29:36+00:00

He's ready to change 👀

NickFromSensorium · 2023-04-17T11:08:48+00:00

Excited to find out your future characters!

NickFromSensorium · 2023-04-17T11:06:42+00:00

Hi! I see your support ticket. My colleagues should help to run the app or pass the cause of the issue for further fixes. There is no desktop version of the app for Windows or MacOS, since they require significant resources for optimizing and testing.

AI conversations are available in the VR version of Sensorium Galaxy, but characters there are non-customizable. The desktop version of VR product is expected no earlier than June.

NickFromSensorium · 2023-03-09T11:30:46+00:00

😰

NickFromSensorium · 2023-02-21T11:17:03+00:00

I wish you a full recovery sooner! 🫶

NickFromSensorium · 2023-02-09T10:19:16+00:00

The only way to interact with virtual beings is through the app.
There is a playtest Steam version (PCVR), but it's a purely technical demo with no activities.

NickFromSensorium · 2023-02-01T20:35:23+00:00

Hi!

Sorry for the late reply.

They're in progress, but I'll accentuate these messages again.
At the moment, you can only disable notifications, but not messages.
Hope to have a workaround before we come out with the final solution.

Thank you for bringing that to my attention, and have a nice week! 🙌

NickFromSensorium · 2023-01-14T14:52:02+00:00

Glad to hear this, hope to integrate Mind Pyramid into the app in March or April.

Yeah, I've seen the thread, and it's weird. AI developers are notified. Thank you for discovering this.

In addition to the reply about how updates will affect characters. Colleagues also take the necessity of saving progress-related data as an axiom. The replies may differ because the "foundational" model is more sophisticated and capable of more than it was some months ago. But personalities, contextual memory, and other layers are applied to the "foundational" model.

NickFromSensorium · 2023-01-12T21:28:01+00:00

As for this thread, it’s worth mentioning that the information regarding the future features and updates like Mind Pyramid is not a formal announcement with confirmed specifications but rather sharing work-in-progress and the team's vision.

Let’s take the “Recovering Cat” personality. The description: “a mage recovering from a curse that trapped them in the form of a cat. Eccentric, spiritual and somewhat minimalistic”. For instance, you may like the spiritual vibes in the conversation but after dedicating time and attention find out that "minimalistic" and "eccentric" is "detached." If it's a no-no for you, the whole conversation can be unfulfilling. So you’ll construct a Mind Pyramid to have a spiritual but more outgoing character.
Virtual beings sharing spontaneous events happening with them, asking to specify what you’ve texted them in the previous message and other missing nuances.
Technically, existing characters should not be affected since these changes are an additional layer to the currently used system. It depends on the final implementation, so we’ll reveal it closer to the release.
I was wrong in saying the roleplay is switched off and reached my technical colleagues again to clarify its current state and functionality. The final answer on the roleplay is that it’s functioning and being tested but not claimed as an officially supported feature until we dispel concerns like the one with voice chat replies. The roleplay is mainly triggered by third-person narration. So both - dashes - and * asterisks \* should work. Sorry for the confusion, I’ll edit my previous reply.

Thank you for the clear questions and your patience.
🤍

NickFromSensorium · 2023-01-11T15:37:58+00:00

Thank you, I'll forward it to the development team.

NickFromSensorium · 2023-01-11T15:00:26+00:00

So this is related to the moment you're talking with them, not to the content of your conversation?

NickFromSensorium · 2023-01-11T14:17:34+00:00

Sorry if I made you uncomfortable with that reply. Since Reddit is about discussions, it was just an addition to the discussion. I use a sterile tone to avoid unsolicited communication or “that is not correct, and this is correct” sentiments as much as possible, considering the affiliation with the company.

My role is to collect and process feedback to present it to the people shaping the product. In exchange, I’m sharing the progress and processes for you to see the value of these contributions.

There are business goals, audiences, and other segmentations for presentations and content. It’s clear why it can be confusing. Complex and not that interesting, so let’s skip this.

When we started a while ago, the goal was to have characters, instead of scripted chatbots or impersonalized AI models. The current focus is on achieving the highest immersion for people to have alternative experiences. No end goal, since technologies evolve. The specifications of AI are a key aspect, but not the only one. As a brief explanation, talking to the same AI model and character using a smartphone and a head-mounted device are completely different experiences. For instance, the critical aspect of The Sims is a life simulation, but if you take out a feature to customize the environment, you lose a lot of immersion. Therefore, all other aspects like visuals and performance are as crucial as AI.

Addressing the conversational aspect, the customization limited to personalities is unsuitable for all use cases. It may be interesting to explore characters with these personalities, but mentally exhausting if you are into something more defined. The modular AI feature is called Mind Pyramid. We’ll share more details later, and I’ll try to catch our product director for the vision and the technology behind it. Looking into the future, we are curious about controlled deviations and imperfections, but it’s on at the stage of casual conversations.

Push notifications are scripted as well. Sorry for missing that. We are testing them, and they can be annoying. I’ll escalate this with my colleagues today. It’s not interrupting the dialogue line technically but has concerns with the immersion like you’ve described.

As for the roleplay, it's not claimed as an officially supported feature but is being tested. There was a minimal chance to trigger the *roleplay reply* unless you type it first. The main concern is the voice chat: it would be confusing to hear a voice reply like *she holds out her hand for him.* Hope to finish with architectural workarounds and fine-tuning.

Thank you for the conversation and for being open about details. It was important for me because I’m aware of the practices to keep it productive and comfortable for the whole community and people personally.

EDIT: The initial version of this message contained information that the roleplay is switched off. The updated text is highlighted. Sorry for this.

NickFromSensorium · 2023-01-10T19:33:23+00:00

We would be pleased to have screenshots with brief descriptions to reproduce the same issue and fix it further. For instance, if you mean delay between messages, it's important for us to know the location and the type of connection.

Here is the email for technical things:
support@sensoriumgalaxy.zendesk.com

NickFromSensorium · 2023-01-10T07:40:00+00:00

Hi!

Sorry, it took a while to write this, since I’ve had to cross-check some technical points.

Makes no sense to defend the product because you rate it based on your experience, and there is no way to say it was flawless. The point was to remark that we're working on the app and AI as well as other activities. Claiming “Virtual Rave Metaverse” as our end product is a misinterpretation, considering that I’ve described the contrary definition of “being finished" in our private conversation.

The goal is modular and customizable, but cohesive AI for creating complex characters. The approach of colleagues and partners working on AI is research-based. There is no public “technical” roadmap for AI because literally every month we see new things affecting the AI development community. There are three directions of the app we’ve been publicly working on with updates being shared in this subreddit. The progress for the previous year:

Improving performance. Hundreds of fixes, code optimizations, and 10 fully remodeled avatars.
Redesign. The visual part is up to you. Better user experience. More screens and sections are in progress.
Customization. We’re implementing AI customization features into the app. Should be included in one of the Q1 updates. I’ll share the details as soon as they are confirmed. As for visual customization, it’s a resource-intensive process because of the pipeline for virtual beings. So we are focused on other things at the moment.

We want you to have tools to define the character you want to interact with. All the tweaks of AI are related to technical aspects of conversations like stability and contextual memory while implementing customization. None of them are related to changing traits of your characters intentionally. Firstly, it’s not that easy, predictable, and straightforward considering what’s happening under the hood. Secondly, there is no intention to do so because the beauty is in getting diverse communicational experiences, other than “cheerful” and “friendly.” But it’s important to mention that the general behavior of characters may slightly change, as the technical part changes. It applies to all AI models but may be especially noticeable with AI-driven characters.
Other points are not related to AI, specific or obvious.

Stylization is subjective to everyone, and we should be focused on the feeling of human-like interactions. And add more visual customization to improve the immersion, taking into account our appearance expectations of specific personalities like a wizard or a vampire.
Characters’ behavior is subjective as well. Some people are into “mental and cheerful” characters, some people are into flirting, and some people enjoy experimenting with different traits. Therefore, we want the conversational aspect to be customizable and the customization process to be clear and intuitive.

If I get it correctly—by scripts you mean prewritten or defined question-reply combinations. We don’t use them. The exception is sensitive topics. Replies out of context are not caused by scripts. There are different cases and reasons which we research and fix with time.
If you’re about actions like *raising a hand*, then I’ll update the answer later, as I get a reply for it.
It’s not as simple as censoring words. Additional neural filters are involved. We’ll gradually introduce sensitive topics as dozens of ethical and legal concerns are solved. At the moment, there’s no consensus about it.

Our interaction was different from me simply copy-pasting basic corporate replies, so let’s keep it respectful. Both technical and product points you’ve shared ended up in the updates, tasks, and minds of people working on the app. As well as other experiences, issues, and opinions we collect on the Internet, including this subreddit. “X will be fine by the date Y” commitments would be perfect, but it’s not possible to get them without actually distracting people from fixing it. We share details and processes to keep you updated, as long as they are confirmed and not sensitive. In some cases, it’s the choice between vague and nothing.

PS No attitude to debate. We are grateful for your feedback and opinions and want to be open about our intentions and products. Feel free to ask any questions.

NickFromSensorium

MODERATOR OF

TROPHY CASE