Positional audio from an SKVideoNode

Question

Created Nov ’15

Replies 1

Boosts 0

Participants 2

My SceneKit app includes a SpriteKit scene which renders video via an SKVideoNode. The SpriteKit scene is assigned as a material on a SceneKit node, so the 3D scene has a video, along with its audio, playing in it. Very cool. Thanks Apple for such great integration between SpriteKit and SceneKit!

I'm wondering if its possible to do positional audio here. Lets say the AV file offers 5.1 sound. I'd like to take the 6 audio tracks and assign them to SceneKit nodes (as 6 loudspeakers in the scene). This way, as the user rotates they'll hear the audio rotating with them.

SpriteKit offers a listener node - but it only knows about 2D, rotation can't be specified for it.
SceneKit offers an audioListener node, which'd be great; but I can't see a way to tell it about the audio playing via SpriteKit. I have the AVPlayer/AVPlayerItem.

Any ideas on if this is possible?

Boost

Answer 1

SlashAndBurn OP

Aug ’16

Did you ever figure out anything? I also want to take the audio mix from an AvPlayerItem and stick them onto 3d objects and have them play in the scene.

0