They even share many of their pre-training and even post-training datasets for Nemotron on HuggingFace; for example: https://huggingface.co/datasets/nvidia/Nemotron-Post-Trainin...
Which other lab shares this?
Yes, there is no question NVIDIA wants to lock you into CUDA and their hardware. But also, they’ve consistently demonstrated the most openness when it comes to model training, datasets, and research; even before the LLM era (e.g. StyleGAN).
There’s also modelscope.cn (china’s huggingface) which is worth checking out. I would not be surprised if one day, we have to use China VPNs to download open weight models.
Of course they are. They're commoditizing their complement.
I want to own the hardware, not play around in an nvidia fiefdom full of nvidia rules.
If you don't want to use CUDA, they expose the PTX bindings to write your own CUDA alternative too: https://docs.nvidia.com/cuda/parallel-thread-execution/index...
Also, when running OpenCL, NVIDIA hardware disables multiple DMA engines, and allows only one memory transfer at a time to prevent OpenCL running as fast as CUDA.
Did NVIDIA finally allow open source drivers to access all parts and features of the card to allow feature parity? Last time I checked they were considering a plan for planning a solution to that.