So, does this mean that the GeforceNow app running on Steam Machine will be able to output at 4K 120Hz?

On the Steam Deck (via dock) it is unfortunately limited to 90Hz, and given most (any?) TVs don't support that, in effect limited to 4K 60Hz.