AVPlayer Network Audio

So I'm using AVSampleBufferDisplayLayer to display a video. I also want to have the accompanying audio with an AVPlayer. Both files come from the network. I'm having an issue with the audio, and it refuses to play because the file on the network does not have a file extension (which is a constraint I have to work with).

I've "solved" the issue by downloading the entire audio file, writing it to the disk and then loading that into the AVPlayer, which works fine. However this creates long loading times because most of the audio files are > 15MB, so the video actually ends up loading before the audio because I'm streaming it in segments. I've tried using a combination of AVAsset and AVPlayerItem to try to solve this already. Any ideas?

AVPlayer Network Audio
 
 
Q