Reality Composer Pro - Audio not working for .USDZ

Question

Created 6d

Replies 3

Boosts 0

Participants 2

Based on info online I'm under the impression we can add spatial audio to USDZ files using Reality Composer Pro, however I've been unable to hear this audio outside of the preview audio in the scene inspector. Attached is a screenshot with how I've laid out the scene.

I see the 3D object fine on mobile and Vision Pro, but can't get audio to loop. I have ensured the audio file is in the scene linked as the resource for the spatial audio node. Am I off on setting this up, it's broken or this simply isn't a feature to save back to USDZ? In the following link they note their USDZ could "play an audio track while viewing the model", but the model isn't there anymore.

Can someone confirm where I might be off please? Screenshot 2024-07-10 at 4.17.23 PM.png

Boost

Answer 1

Vision Pro Engineer OP

Apple

5d

Hi CaliDave!

(Apologies for the delete and repost. I had an account kerfuffle on my end.)

You are on the right track. You can configure the playback of your audio using the Timeline, Triggers, and PlayAudioAction.

Check out the WWDC24 Session "Compose interactive 3D content in Reality Composer Pro": https://developer.apple.com/videos/play/wwdc2024/10102.

At 11:27, Marin walks you through adding audio playback to your scene with the PlayAudio action on a Timeline.

At 14:13, Marin shows you how you can configure how the Timeline starts. You can use either the RealityKit API in code, or Reality Composer Pro.

Check out the BOT-anist sample code to see how this all fits together in the project: https://developer.apple.com/documentation/visionos/bot-anist

Depending on your workflow, there are some other ways to go about this, but this should get you going on your current path.

Please keep us posted if this works for you or if you are still feeling stuck.

Most cordially,

James

1

Answer 2

CaliDave OP

5d

Thanks James. I see the Timeline feature is available in XCode 16 Beta (I was using XCode 15). Unfortunately when I try to install XCode 16 Beta I get this error,

"Loading a plug-in failed. The plug-in or one of its prerequisite plug-ins may be missing or damaged and may need to be reinstalled.". I guess that's an issue for a new post. I'll report back once I can get the software working. Screenshot 2024-07-11 at 1.42.37 PM.png

0

Answer 3

CaliDave OP

5d

Thanks James for the tips. I watched the video and we have a slight difference in behaviors, but cool to see a potential code less option for a quick test. When I try the timeline it plays audio as expected, but when I send to my Vision Pro I never hear any audio. Can you spot where I'm off?

Screenshot 2024-07-11 at 4.08.43 PM.png

0