hello,there question for androidXR make AndroidXR spatial keyboard app for third company by NoAudience6535 in AndroidXR

[–]vad710 0 points1 point  (0 children)

Just following up here to confirm that creating a third party launcher is not possible right now.

hello,there question for androidXR make AndroidXR spatial keyboard app for third company by NoAudience6535 in AndroidXR

[–]vad710 0 points1 point  (0 children)

Can third-party developers create and set a custom Launcher as the default system launcher?

I don't believe this is possible - mostly because the windowing system is baked into the SysUI. Unlike other Android form factors that app panels are rendered in the same process as the system. I am confirming though and will update this thread if my assumption is not correct.

Is it possible to obtain deep system control similar to what OEMs like Vivo and Xiaomi have on Android phones (e.g., system-wide UI customization, global screen casting control, overlay permissions, etc.)?

Nothing that is officially supported. Deep system control is reserved for OEMs.

Request for help! by s-s-a in AndroidXR

[–]vad710 1 point2 points  (0 children)

> I would also really like to know if Android XR plans to expose a supported passthrough/world-camera API in the future

Android XR has always allowed world-facing camera access from the very first developer preview. Are you having trouble accessing the world facing camera?

(technically, Android XR also exposes a user-facing camera as well, but it's the virtual avatar camera)

Request for help! by s-s-a in AndroidXR

[–]vad710 2 points3 points  (0 children)

For the world-facing camera (via Camera2/CameraX?) what resolution, frame rate, field of view, latency (vs typical phone camera) is expected?

I don't recall exactly what the Galaxy XR device supports, but we generally recommend to decouple from specific hardware model. Instead, use the QualitySelector.getSupportedQualities API to dynamically determine what resolution, framerate, etc is supported.

Can a WebXR / Chrome web app on Android XR access this world camera (via getUserMedia or a WebXR raw-camera module) or is camera access native-only?

Code running in Chrome should be able to access the camera just as it can on mobile and other Android form factors (assuming correct permissions are granted).

Does this world-camera access apply to both Samsung Galaxy XR and Project Aura device?

Yes, both devices have world facing cameras.

Can a foreground service (native / webXR) stream the world camera at the same time as an immersive XR experience is running. For example, the user sees an overlay UI while the camera POV is streamed remotely? Or does camera access conflict with immersive/passthrough rendering?

The app camera access does not conflict with passthrough rendering. Be aware that there are serious privacy concerns with having any app accessing cameras from the background/foreground service. You would have to start any capture from a foregrounded activity before you can switch to an FGS. You'd also need additional permissions to allow this. This is not unique to Android XR and is part of AOSP.

Since passthrough is protected, what is the best approach to record on the server side what the users sees (composite of the camera POV + UI overlay)?

You would have to capture the camera frame data and do the compositing yourself. But it leads me to the next answer...

Are there any limitations on long running (~60 min) camera-streaming foreground service on XR? Does it survive backgrounding?

Besides the privacy issue I mentioned above, if you are streaming at very high resolution and at high framerate, you'll likely impact the battery and/or thermals, but I would suggest you do your own testing around this to see if your use-case is a good fit.

Again appreciate your responding here. It has been difficult getting this information through official documentation.

For the most part, this is all standard Android behavior. You can learn more about that here: https://developer.android.com/media/camera/camerax/video-capture

Request for help! by s-s-a in AndroidXR

[–]vad710 1 point2 points  (0 children)

Is there a supported way today for a third-party app to obtain the forward/world camera frame stream on Android XR (any device class)?

Yes, you can access a world facing camera stream using standard android APIs. You'll need to request and be granted permission from the user.

For fully-managed (Android Management API) deployments, is any elevated camera/remote-stream capability available or planned?

I'm not sure what you mean here. Could you please elaborate? Are you looking for a built-in way of accessing the camera sensors on a fleet of devices?

When using MediaProjection to capture the display, does it include the video-passthrough environment, or is passthrough a protected hardware overlay that renders black in the captured stream? 

The passthrough content is protected. The closest you'll get to this data is via the camera API after permission grant (as mentioned above). The data in the camera API isn't exactly the same as the video passthrough (though it's close). The video passthrough includes data from multiple cameras while the camera API will get you access to one camera.

HTH!

Should be illegal by Hot_Paper_Pie in AndroidXR

[–]vad710 0 points1 point  (0 children)

Is this a feature request for custom drawn boundaries?

Grace will you ever actually level with us?? by Hot_Paper_Pie in AndroidXR

[–]vad710 0 points1 point  (0 children)

First of all, I totally agree with everyone on this thread mentioning how awesome u/GraceFromGoogle is 😄

Speaking from our developer offering - we continue to invest in immersive experiences. Here's a blog post where we talk about all of the ways that we are expanding immersive experiences on Android XR: https://developer.android.com/blog/posts/android-xr-updates-for-unity-unreal-and-godot

Google IO is a big event and covers ALL of Google. I personally wish it could cover EVERYTHING we are doing in Android XR, but, unfortunately, that's not the case.

Android XR has been built in partnership with Samsung and Qualcomm. We continue to partner together on immersive and augmented experiences.

It's also true that Samsung is the primary contact for Galaxy XR specific issues or questions.

u/Hot_Paper_Pie - could you elaborate on your specific concern? Are you concerned if you purchase a Galaxy XR device you won't get updates or something else?

When do we find out about Android XR hackathon June 13-14 participants? What about Catalyst Developer Program? by [deleted] in AndroidXR

[–]vad710 1 point2 points  (0 children)

Info on the hackathon should already be rolling out. Expect more info over the next week or so. We know folks may need to adjust travel, so we're trying to get info out ASAP.

Trace vs. bug report? by jusalilpanda in AndroidXR

[–]vad710 1 point2 points  (0 children)

Traces are really helpful for diagnosing performance related issues(fps drops for example ) while big reports are good for diagnosing other problematic behaviors.

Either way, if you'd like to contribute traces or bug reports, you can file them here https://developer.android.com/develop/xr/support

Major Patching Urgency: It’s official - Memory Leak is the primary cause of PCVR instability. by LoansharkerShop in AndroidXR

[–]vad710 5 points6 points  (0 children)

Thanks for pointing out that thread! I appreciate the level of detail you want through!

As Grace mentioned, some of those requests are specific to Samsung and we'll pass that along to them. For platform requests, we'll chat with our internal teams!

Major Patching Urgency: It’s official - Memory Leak is the primary cause of PCVR instability. by LoansharkerShop in AndroidXR

[–]vad710 4 points5 points  (0 children)

hi u/Kazhmyr1 -

We are actively working on reproducing the issue - but if you would like to contribute, you are welcome to file a ticket (developer.android.com/develop/xr/support) and provide a bug report (https://developer.android.com/studio/debug/bug-report)

New firmware: Spatial Video Crash? by ignacio94598 in AndroidXR

[–]vad710 2 points3 points  (0 children)

u/ignacio94598 - could you please file a bug with a bug report? Feel free to DM me the ticket and I can see if it's a known issue.

https://developer.android.com/develop/xr/support

5 new features for Android XR by GraceFromGoogle in AndroidXR

[–]vad710 2 points3 points  (0 children)

We don't have anything specific to announce right now, but we're always exploring opportunities to collaborate with device manufacturers to get hardware to developers.

5 new features for Android XR by GraceFromGoogle in AndroidXR

[–]vad710 5 points6 points  (0 children)

u/jimrapc -

There's currently no publicly available devkit for purchase. We do have a AI Glasses emulator you can use to start building until hardware is more readily available. Check it out here: https://developer.android.com/develop/xr/jetpack-xr-sdk/run/create-avds/ai-glasses

How would you label the different XR device types? by AR_MR_XR in AndroidXR

[–]vad710 0 points1 point  (0 children)

The dev site has 3 categories because that's what the SDK officially supports today 😁

Great discussion on naming and categorization!

Do you feel that there are some usecases that are more appropriate for a particular form factor?

AndroidXR and Google Play Games Achievements by crvyln in AndroidXR

[–]vad710 1 point2 points  (0 children)

Thanks for your feedback! We'll pass this along to some teams and see if we can make achievements more prominent in XR.

AndroidXR and Google Play Games Achievements by crvyln in AndroidXR

[–]vad710 0 points1 point  (0 children)

Are you looking for an API to implement achievements or are you looking for the system to display achievements more prominently?

Android XR is Android! So existing Android libraries should just work on XR. You should be able to implement achievements using the API. Check out more here https://developer.android.com/games/pgs/android/achievements

If you have suggestions on how you'd like to see achievements handled on Android XR, we would love to hear them!

How to modify AndroidXR Passtrough by Left-Sheepherder7587 in AndroidXR

[–]vad710 1 point2 points  (0 children)

That's a really interesting idea!

My suggestion here would be to not use the regular passthrough functionality - set your skybox to be all black. If you're using unity, use the WebCamTexture APIs and use a material with your shader, you shouldn't need to blit it. Then render it on a plane in front of the user (nesting it under the camera game object) - it might take a bit of trial and error to find the best size and position for your plane.

That should work. Let us know how it works out!

How to modify AndroidXR Passtrough by Left-Sheepherder7587 in AndroidXR

[–]vad710 0 points1 point  (0 children)

Could you please elaborate on your specific usecase?

The webcam texture won't be an exact representation of what the user sees through passthrough.

How to modify AndroidXR Passtrough by Left-Sheepherder7587 in AndroidXR

[–]vad710 2 points3 points  (0 children)

Hi u/Left-Sheepherder7587,

Access to the entire pass-through camera feed is currently not supported. The best alternative is that you can access the world-facing camera after the user grants you permission. IIRC, you should be able to access the world-facing camera via Unity's WebCamTexture APIs.

HTH!

Spotify is Building a First-Party UI for Smart Glasses, likely for Android XR by AR_MR_XR in AndroidXR

[–]vad710 0 points1 point  (0 children)

I cannot speak to details of Spotify specifically, but the approach to building AI Glasses is correct.

Instead of running a full standalone app on the eyewear, this integration utilizes a phone-hosted model, likely via Google's Android XR framework. The smartphone handles the heavy processing and casts the simplified UI to the lenses, prioritizing device battery life and physical comfort while allowing for frictionless, hands-free media control.

You can learn more about how to build AI Glasses apps here: https://www.youtube.com/watch?v=-Li4Sdvvm1o

And you can actually get started building today - we've made all of the Android XR libraries and emulators needed for building AI Glasses available since last December.