Blender Geometry Nodes to Reality Composer Pro

Hello!

Back from last week's amazing visit to Cupertino for the Game Dev session and diving back into Vision Pro experimentation.

I've exported a simple geometry nodes with animation test from Blender for use in RCP, with intended output to Vision Pro. I've attached a few screenshots showing the node setup and how it animates over time.

I select the Cube mesh and export as .usdc with animation. In the finder via quick look, I can actually see it working! If I try exporting as .usdz, however, i'm not seeing any animation in the finder preview.

Next, I import the .usdc file to RCP and add an Animation Library component to the cube mesh, but am not seeing any animation selectable, even though I see animation playing back in preview.

Next, I import the .usdc into Maya (via proper USD Stage pipeline - i'm learning to be USD compliant for authoring!) to verify if the animation is working, and it does.

What step(s) am I missing to get this working in Reality Composer Pro? My goal is to experiment with animating these geometry node instances - along with color animation if possible - over to Vision Pro for full scale, immersive presentation.

Of particular note, I am not a programmer, so I am trying my best to brute force this the only way I currently know possible, by keyframe animation and importing through Reality Composer Pro. I realize that, ideally, I should be learning how to leverage the code portion so I can start programatically controlling my 3d entities (with animation), but need more hand holding and real-world examples to help me get there. Thx!

Hello @SteveTalkowski ! Thank you for your question.

The root cause of your issue is a bit technical so I hope you'll bear with me. You're seeing an issue related to the different ways USD can be rendered on your system. Different renderers support different feature sets of the USD spec and unfortunately RealityKit's USD renderer does not support vertex animation.

In some contexts, macOS will display USD files using a renderer called Storm (you can search online for "Hydra Storm"), and this is not the same renderer used by Xcode or your app, which uses RealityKit to render USD. Because Storm supports vertex animation while RealityKit does not, you'll see your animation playing in some contexts and not others, and you won't be able to use this particular type of animation in a RealityKit app. This is confusing, but hopefully the link above helps explain everything.

You've authored your asset correctly! Unfortunately, RealityKit does not support this particular type of animation. I recommend sending us feedback using Feedback Assistant and detailing your use case.

RealityKit's renderer does support skeleton animations! Although for your use case of rotating many cubes on a surface, perhaps there's a procedural solution (i.e., coded in Swift, rotating transforms directly in a system) that would work for you?

Let me know if you have any other questions. Thank you!

Blender Geometry Nodes to Reality Composer Pro
 
 
Q