And Nvidia is big enough that they could impose some order on the ecosystem that the ecosystem so far has either been unable or unwilling to impose on itself. The wild west of one-offs can continue to make their application-specific designs while everyone else will presumably benefit from a reasonably standardized platform.
Beyond the significant PCI-e requirements, I'm tickled pink that many of the server platform requirements are "do what x86 does"... ACPI, UEFI, a TPM. I hope they do a better job with standards compliance than some of the shadier Wintel OEMs!
CUDA is proprietary technology, guarded by patents and mostly closed-source. And its originator, NVIDIA, while being a member of the Khronos consortium, and technically supporting OpenCL, makes it much more difficult for you to do anything in OpenCL than in CUDA - even though it is sometimes almosy zero effort to enable some OpenCL equivalent (e.g. : Half-precision types. They exist in CUDA; in OpenCL on NVIDIA - you can't have them).
So, live with CUDA on other hardware? No thank you.
That could end up being a pretty influential de facto server profile for the architecture.
So, live with CUDA on other hardware? No thank you.