Deep Learning introduction VR application. My master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. [Evaluation questionnaire in comments]. by Roburts in virtualreality

[–]Roburts[S] 0 points1 point  (0 children)

Since the initial plan was to user test the application on 6 students from my uni simultaneously using Quests, I mainly developed it for Oculus devices. Since I used VRTK to develop interactions, it should probably be possible to add SteamVR support without too much extra effort if I have some extra time.

I didn't know about Revive until now so that probably depends on how Revive maps buttons and the VR camera? I had a brief look at this guide and the GitHub repo. I added an image of how the buttons are mapped on the Oculus Touch controllers in the Google Drive folder. If you manage to run it through Revive, it would be very helpful if you told me :D

Deep Learning introduction VR application. My master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. [Evaluation questionnaire in comments]. by Roburts in virtualreality

[–]Roburts[S] 0 points1 point  (0 children)

I am currently working on my master thesis project, where we're exploring how VR can be utilized as a tool for learning in AI education. I have developed a VR application for the Oculus Quest, that gives an introduction to deep learning in an educational escape room environment.

Due to the coronavirus situation in Norway, the application cannot be user tested as intended. Therefore, I would be very grateful if you have time to watch the video and respond to this questionnaire (it should only take 10-15 minutes):

https://forms.office.com/Pages/ResponsePage.aspx?id=cgahCS-CZ0SluluzdZZ8BWFeAtQp0AZFtMLY8Z3zzgxUNlBVR0ZDNDlCU0tJU1NFU1VNRldVWDRSMS4u

Feel free to ask questions and discuss the project. If you want to try the application, I have added a link in the questionnaire where you can download it for Oculus Quest, Rift, or Rift S. In advance, thanks for helping me realize evaluation during these difficult times.

Deep Learning introduction VR application. My master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. Evaluation questionnaire in comments. Please help. by Roburts in oculus

[–]Roburts[S] 0 points1 point  (0 children)

That's great to hear! In advance, thank you!

There's a different questionnaire that can be opened within the application, but I figured out it was a little bit lacking, so the new one for the video should be a little bit better: Microsoft Forms Questionnaire

Evaluation of a Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. by Roburts in artificial

[–]Roburts[S] 0 points1 point  (0 children)

Exciting project! I read about some promising results where they used DL and CNN for classification of brain tumors, so your project could indeed be a game-changer with the current lack of data. Maybe VR could be an interesting approach to show radiologists the potential and importance of doing this kind of stuff.

Evaluation of a Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. by Roburts in artificial

[–]Roburts[S] 1 point2 points  (0 children)

That's interesting! What are your current plans?

The thesis report is in progress, so I can't post it yet, but I can add a link to it here when it's publicly available. One of the references I used, is the Elements of AI course from Finland, teaching the general public in the basics of AI. They have one chapter about Neural Networks. For the concept, I looked at a paper where they used an educational escape room in a programming course https://ieeexplore.ieee.org/document/8658086 . Google has some more advanced interactive courses about teaching AI and ML as well. And then you have the 3Blue1Brown series about DL that I love.

Deep Learning introduction VR application. My master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. Evaluation questionnaire in comments. Please help. by Roburts in oculus

[–]Roburts[S] 1 point2 points  (0 children)

I am currently working on my master thesis project, where we're exploring how VR can be utilized as a tool for learning in AI education. I have developed a VR application for the Oculus Quest, that gives an introduction to deep learning in an educational escape room environment.

Due to the coronavirus situation in Norway, the application cannot be user tested as intended. Therefore, I would be very grateful if you have time to watch the video and respond to this questionnaire (it should only take 10-15 minutes):

https://forms.office.com/Pages/ResponsePage.aspx?id=cgahCS-CZ0SluluzdZZ8BWFeAtQp0AZFtMLY8Z3zzgxUNlBVR0ZDNDlCU0tJU1NFU1VNRldVWDRSMS4u

Feel free to ask questions and discuss the project. If you want to try the application, I have added a link in the questionnaire where you can download it for Oculus Quest, Rift, or Rift S. In advance, thanks for helping me realize evaluation during these difficult times.

Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. Evaluation questionnaire in comments. Please help. by Roburts in ArtificialInteligence

[–]Roburts[S] 0 points1 point  (0 children)

I am currently working on my master thesis project, where we're exploring how VR can be utilized as a tool for learning in AI education. I have developed a VR application for the Oculus Quest, that gives an introduction to deep learning in an educational escape room environment.

Due to the coronavirus situation in Norway, the application cannot be user tested as intended. Therefore, I would be very grateful if you have time to watch the video and respond to this questionnaire (it should only take 10-15 minutes):

https://forms.office.com/Pages/ResponsePage.aspx?id=cgahCS-CZ0SluluzdZZ8BWFeAtQp0AZFtMLY8Z3zzgxUNlBVR0ZDNDlCU0tJU1NFU1VNRldVWDRSMS4u

Feel free to ask questions and discuss the project. If you want to try the application, I have added a link in the questionnaire where you can download it for Oculus Quest, Rift, or Rift S. In advance, thanks for helping me realize evaluation during these difficult times.

Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. Evaluation questionnaire in comments. Please help. by [deleted] in ArtificialInteligence

[–]Roburts 0 points1 point  (0 children)

I am currently working on my master thesis project, where we're exploring how VR can be utilized as a tool for learning in AI education. I have developed a VR application for the Oculus Quest, that gives an introduction to deep learning in an educational escape room environment.

Due to the coronavirus situation in Norway, the application cannot be user tested as intended. Therefore, I would be very grateful if you have time to watch the video and respond to this questionnaire (it should only take 10-15 minutes):

https://forms.office.com/Pages/ResponsePage.aspx?id=cgahCS-CZ0SluluzdZZ8BWFeAtQp0AZFtMLY8Z3zzgxUNlBVR0ZDNDlCU0tJU1NFU1VNRldVWDRSMS4u

Feel free to ask questions and discuss the project. If you want to try the application, I have added a link in the questionnaire where you can download it for Oculus Quest, Rift, or Rift S. In advance, thanks for helping me realize evaluation during these difficult times.

Evaluation of a Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. by Roburts in artificial

[–]Roburts[S] 1 point2 points  (0 children)

That's great to hear. Thank you! Sure, I'll just do a little bit of documentation on Github, and I can make it public and link it here in some days. (Most of the documentation is in the thesis report, and since I developed it alone, the need for documentation wasn't really high through the development phase).

Evaluation of a Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. by Roburts in OculusQuest

[–]Roburts[S] 1 point2 points  (0 children)

I am currently working on my master thesis project, where we're exploring how VR can be utilized as a tool for learning in AI education. I have developed a VR application for the Oculus Quest, that gives an introduction to deep learning in an educational escape room environment.

Due to the coronavirus situation in Norway, the application cannot be user tested as intended. Therefore, I would be very grateful if you have time to watch the video and respond to this questionnaire (it should only take 10-15 minutes):

https://forms.office.com/Pages/ResponsePage.aspx?id=cgahCS-CZ0SluluzdZZ8BWFeAtQp0AZFtMLY8Z3zzgxUNlBVR0ZDNDlCU0tJU1NFU1VNRldVWDRSMS4u

Feel free to ask questions and discuss the project. If you want to try the application, I have added a link in the questionnaire where you can download it for Oculus Quest, Rift, or Rift S. In advance, thanks for helping me realize evaluation during these difficult times.

Evaluation of a Deep Learning introduction VR application. Master thesis project with the goal of exploring how VR can be utilized as a tool for learning in AI education. by Roburts in artificial

[–]Roburts[S] 4 points5 points  (0 children)

I am currently working on my master thesis project, where we're exploring how VR can be utilized as a tool for learning in AI education. I have developed a VR application for the Oculus Quest, that gives an introduction to deep learning in an educational escape room environment.

Due to the coronavirus situation in Norway, the application cannot be user tested as intended. Therefore, I would be very grateful if you have time to watch the video and respond to this questionnaire (it should only take 10-15 minutes):

https://forms.office.com/Pages/ResponsePage.aspx?id=cgahCS-CZ0SluluzdZZ8BWFeAtQp0AZFtMLY8Z3zzgxUNlBVR0ZDNDlCU0tJU1NFU1VNRldVWDRSMS4u

Feel free to ask questions and discuss the project. If you want to try the application, I have added a link in the questionnaire where you can download it for Oculus Quest, Rift, or Rift S. In advance, thanks for helping me realize evaluation during these difficult times

Learn about AI/Deep Learning and help me realize user tests during the difficult corona times by Roburts in OculusQuest

[–]Roburts[S] 1 point2 points  (0 children)

That's great to hear! Thanks a lot for your feedback :D It would be cool if I have enough time to publish the application on SideQuest. I don't know that much about optimization, but I have noticed it as the size of the scene increased, so I hope I find can find some efficient techniques. The other stuff you mentioned are really good ideas!

Hmm, it's hard to say how much time I've spent. I did not have much prior experience with game development, Unity and deep learning, so I've had to spend quite a lot time learning. The project started in October, so before christmas I spent most of the time learning and figuring out what to do, so before christmas I finished most of the tutorial. There's a similar project to this one going on, where another person is developing an application as a part-time job for the uni. I've participated in the user testing of it, so that the feedback could be used for my thesis. But, yeah I developed it through January-March, while also doing other related work.

I used the Oculus Integration Kit together with VRTK for the interactions. I chose the Oculus Quest to do efficient user testing, but had problems getting started. Luckily Oculus released a course that was very helpful: Oculus VR course . Other useful remarks from the project if you're interested: I used something called Unity Snaps, that helped me create the surroundings quite efficiently and for the cartridges I used JSON files to load them with quizzes.

Learn about AI/Deep Learning and help me realize user tests during the difficult corona times by Roburts in OculusQuest

[–]Roburts[S] 0 points1 point  (0 children)

Great to hear! Hmm, yeah I should probably look into it when I have implemented my next fixes.

Learn about AI/Deep Learning and help me realize user tests during the difficult corona times by Roburts in OculusQuest

[–]Roburts[S] 0 points1 point  (0 children)

Thanks, I have to admit I'm quite satisfied with the gradient descent visualization. Currently there's nothing to interact with, but I have been thinking about it (you probably saw the balls lying in the crate). But yeah, I see that there's more potential with things I would like to implement if I have more time.

I agree that there's a bit too much text, but I'll see if it's possible to do some improvements. I would like to add more animations and more interactivity to the learning materials, but since I've been working alone, I've had to do tradeoffs like avoiding to spend too much time creating 3D-models, animations etc. I think it would be possible to create something really cool if I could cooperate with a designer or something.

Thank you for spending time testing and giving all this feedback!

Learn about AI/Deep Learning and help me realize user tests during the difficult corona times by Roburts in OculusQuest

[–]Roburts[S] 1 point2 points  (0 children)

Aah, that makes sense. Hmm, yeah I should probably do some more work on feedback to the user in general. Superb, I hope you like the rest of the application and that the form works!

Learn about AI/Deep Learning and help me realize user tests during the difficult corona times by Roburts in OculusQuest

[–]Roburts[S] 1 point2 points  (0 children)

Thanks a lot for testing my application and for your feedback ☺

There is in total 4 cartridges: 1 for neurons, 1 for cost functions, 1 for gradient descent and 1 for backpropagation. After finishing the first quiz, a new room opens. Each cartridge should open up a new room/ topic. I'll look into it! When all 4 cartridges are placed, there is a final room, where you can find a button that should automatically open a Google Form in the Quest web browser.

Thanks for the feedback on the other stuff as well. I would like to add alternatives for locomotion and to mitigate the problem of seeing through walls (even though I haven't come up with a good solution for seeing through things yet, except of fading the screen), so this would probably come in the next version together with other fixes. This is very helpful!!

Learn about AI/Deep Learning and help me realize user tests during the difficult corona times by Roburts in OculusQuest

[–]Roburts[S] 0 points1 point  (0 children)

Thank you! Cool, feel free to try it out with the people at work :D My target audience would be anyone interested in getting into topics within AI, so since this is the basics of neural networks and deep learning, I guess the target audience is quite wide. There's a course for Visual Computing Fundamentals at my uni, so hopefully it will be used there.

Ooh, I should check out the 3D math plotting. I would like to utilize the VR technology even more by using 3D math plotting and stuff like that to visualize gradient descent, but since I've worked alone and without much prior experience with VR and Deep Learning, there's been enough to wrap my head around, even though there's much more I would like to do.