Thank you both very much for your quick answers !

I will definitely give a shot at Ross' contrib. I also thought about mounting a sshFS when the container starts and trick Yocto by using the FILE protocol.
I will compare the performances.

Thanks again !