Do loading multiple functions that share model weights multiply memory use?

Machine Learning & AI Core ML
sebamenabar OP
Created 5h
Replies 0
Boosts 0
Views 45
Participants 1

Hi, I have a multifunction model where the functions share the same model weights, and for latency I have multiple functions loaded at the same time.

According to what Codex found this multiplies RAM usage, so if the single model weights 2GB, loading two functions that share the underlying weights still doubles RAM usage to 4GB (seems that it is something like neural wired memory).

Does anyone have any knowledge relating to this?

Replies  0
Boosts  0
Views  45
Participants  1
Do loading multiple functions that share model weights multiply memory use?
First post date Last post date
 
 
Q