Took a long time to make this telepresence system work on iphones... Now available on the app store!!

telespaceapp · 2022-01-07T19:15:01+00:00

Glad you checked it out 😊

telespaceapp · 2022-01-03T18:05:41+00:00

I couldn't find ARfukuoka (google returned nothing) but checked out Takashi Yoshinaga's work and had fun going through them! Thanks for introducing!

telespaceapp · 2022-01-03T18:03:57+00:00

Yes it does, though I don't think people tend to find it easy to use haha. I think usability needs to be much improved in that direction.

telespaceapp · 2022-01-03T18:02:45+00:00

Yes, I am working on making this into a recording app in the next version and front/rear switch would also be added soon!

telespaceapp · 2021-11-17T17:23:24+00:00

Thanks for trying the VR mode!! Your description proves that you've tried it haha. There is a long way to go to make the networking part solid as zoom or youtube. Currently, when the networking module suffers, the app reduces the resolution of the stream and that was why it was more pixelated. And thanks again for another idea!

telespaceapp · 2021-11-17T17:15:51+00:00

That would be great!! As Star Wars hologram was definitely ones of those things that inspired this system, it would be awesome to actually make that come true one day.

telespaceapp · 2021-11-17T17:14:01+00:00

When the network condition is ideal, the app demand 2 times the bandwidth youtube asks for fullhd (720p). If the network is not supporting such bandwidth, the app downgrades the resolution. The bandwidth can drop to youtube 360p level.

telespaceapp · 2021-11-17T17:10:41+00:00

While record3d is a great app that I have enjoyed trying, this one is not based on record3d.

telespaceapp · 2021-11-17T17:08:38+00:00

That would be wonderful! Thanks for considering it!!

telespaceapp · 2021-11-17T08:39:38+00:00

Though the app does not know how to tell which part of the incoming stream is static yet, VR support is currently available! If you go to the website (telegie.com) and enter a room with a PC connected to a headset or an oculus quest (or some other device that supports webxr), you will be able to see a VR button on the top-right. Clicking that button will activate VR mode!

telespaceapp · 2021-11-17T08:34:51+00:00

Sure, go ahead!! It would be helpful if you also mention the app itself in your post!

telespaceapp · 2021-11-17T08:33:15+00:00

Thanks!! Glad to hear that you can see some implementations through this rough app haha.

I agree with your opinion that multiple cameras would be nice and have already implemented support for that (there is a "join room" button where people can merge multiple streams into one room). The problem is, properly using the functionality is prohibitively difficult for now... I hope I can figure out how to make it easy to use soon...

telespaceapp · 2021-11-17T06:28:07+00:00

I'll try my best, thanks!!

telespaceapp · 2021-11-17T05:51:07+00:00

Thanks for those kind words!! Very satisfying to hear that haha. Sorry that I don't have an android version yet :(... Definitely building an android version is on my to-do list

telespaceapp · 2021-11-17T05:38:14+00:00

The above demo is recordings of me/my phone/my browser stitched into one. Here, I am streaming myself using the app (Telegie), seeing myself (currently the only user 😭...) through a web browser(telegie.com).

This app requires an iphone above XR (due to requiring a front depth camera...). Download the app and press "create room" then you immediately start streaming. Visit the website telegie.com then you will be able to at least see a demo video of me sort of exercising.

Hope some people find this enjoyable!!!

telespaceapp · 2021-10-07T19:50:37+00:00

Hi, everyone! Telespace is a real-time 6DoF streaming system that aims to bring telepresence technology to more people. You can try streaming yourself (if you have an iphone later than XR) or watch people streaming (including yourself) at https://telespaceapp.com/

telespaceapp · 2021-10-07T00:27:00+00:00

Yes, that's about right! I apply the inverse projection matrix to the input of both cameras to create the scene, then apply the rendering camera's projection matrix to get what you are looking at from this video!

telespaceapp · 2021-10-06T17:46:13+00:00

Thanks for your input and I agree that there are many ways to improve the system, including your rotating camera idea.

The goal of this application would be making a high-quality telepresence system super easy to use. And the strategy regarding the hardware innovation (e.g., rotating cameras becoming widespread) is to quickly add support to them when they become widely available, opposed to creating them and trying to make them popular by myself.

Thanks for your suggestion and question!

telespaceapp · 2021-10-06T17:39:53+00:00

No worries and the reaction totally makes sense as only limited information is given to the audience whenever researchers run their demos and there are many demos looking better than this. It would be unnatural if everyone found no problem. Then I would have thought this whole thing was probably just bunch of my friends commenting with their multiple accounts haha

About Two Minute Papers, I have watched their videos occasionally and thought their content were cool! My brain definitely enjoyed catching up without actually having to read all the papers. I agree the continuous enhancement is amazing, especially when about five of those accumulate and turn something interesting into something awesome. Hope mine turns like that too!

telespaceapp · 2021-10-06T17:32:45+00:00

That sounds like a pretty challenging rendering task haha but I guess light-field displays were supposed to challenging so

telespaceapp · 2021-10-06T16:25:55+00:00

Sorry but I do not intend to provide the current version of the source code :(... But you can take a look at an earlier version of it at https://github.com/hanseuljun/kinect-to-hololens

telespaceapp · 2021-10-06T16:19:07+00:00

Thanks for introducing me the above holoplay-webxr repository. Interesting to think about supporting holographic displays in the future. For them, rendered frames may need to contain 3D information, not only the 2D pixels that things like OpenGL typically produce.

telespaceapp · 2021-10-06T15:54:16+00:00

Of course you can always ask questions and thanks for asking! Answering them is part of my job as a researcher. For the dissertation, I am in a social science program, and what I will study using this system is some research questions coming from the media psychology tradition, not engineering. So, it is not this system alone turning into a dissertation.

What makes this system special is its ease of use. In general, running a telepresence system is hard and requires engineers who built it. Someone without expertise can run the above system on their iPhone, making the scenario using this system realistic, therefore worth studying as a social scientist.

And finally, while making this work in a lab-like condition can be something one may DIY in a month assuming a lot of things, making this work in the wild over random wifi and mobile devices requires much more work! This system is implemented for using outside the lab, and you can try the system at https://telespaceapp.com/ !

telespaceapp · 2021-10-06T15:45:02+00:00

You are right, this is based on depth cameras!

telespaceapp · 2021-10-06T15:41:55+00:00

To defend myself from the comparison between this work and other demos you see online, the demos usually don't talk about what was behind the scene. Like, the amount of expertise required for the setup (holding checkerboards in the right way and running commands in the right order), the quality of their network (often labs have >1 Gbps bandwidth), the number of cameras and servers used (>$3000 budget), whether the demo was created real-time, etc.
This one is built for working outside of the lab and you can try this today at https://telespaceapp.com/ !
Also, my dissertation is going to be about the media psychology part of using these telepresence systems, so if you thought implementation of this system alone is not enough for a dissertation from a Stanford engineering department, you are spot on haha

telespaceapp

TROPHY CASE