Make program use Neural Engine?

Hello,

Is there any way to make a program run on the Neural Engine? I have a compiled program (not Python/tensorflow/etc) that I would like to speed up; right now, it runs on the GPU but I was told by the developer it doesn’t use the neural engine. I’m running predictions, not training models - I have read that the ANE is especially good for this purpose. Is there a way to speed up my predictions here with the ANE?

Noah

You can use MetalPerformanceShadersGraph framework with optimizationLevel1 and that will use the neuralEngine if it will be faster.

Make program use Neural Engine?
 
 
Q