In an ideal scenario for sure, but in implementation you’re going to run into issues like network throughput and resource access distribution optimization (i.e. feynman parallarity). I got out of the house without a whiteboard or a single grad student (you just never remember the important things) so I can’t confirm more than napkin math, but you may indeed be right that it’s at worst quadratic.
Edit history
In an ideal scenario for sure, but in implementation you’re going to run into issues like network throughput and resource distribution optimization (i.e. feynman parallarity). I got out of the house without a whiteboard or a single grad student (you just never remember the important things) so I can’t confirm more than napkin math, but you may indeed be right that it’s at worst quadratic.
In an ideal scenario for sure, but in implementation you’re going to run into issues like network throughput and resource distribution (i.e. feynman parallarity). I got out of the house without a whiteboard or a single grad student (you just never remember the important things) so I can’t confirm more than napkin math, but you may indeed be right that it’s at worst quadratic.