Skip to content

Fix disabling NVIDIA driver install on Slurm cluster install#948

Merged
ajdecon merged 1 commit intoNVIDIA:masterfrom
ajdecon:fix-nvidia-driver-disable
Jun 16, 2021
Merged

Fix disabling NVIDIA driver install on Slurm cluster install#948
ajdecon merged 1 commit intoNVIDIA:masterfrom
ajdecon:fix-nvidia-driver-disable

Conversation

@ajdecon
Copy link
Copy Markdown
Contributor

@ajdecon ajdecon commented May 7, 2021

The Slurm cluster playbook provides the var slurm_cluster_install_nvidia_driver to disable installs of the NVIDIA driver. However, the Slurm cluster playbook also sources the CUDA playbook, which installs the driver itself. And the CUDA playbook does not respect the flag in the Slurm cluster playbook.

Aren't dependencies fun?

This commit adds a flag to the CUDA playbook to allow disabling the driver install, and plumbs it through so the user can set the flag in the Slurm cluster playbook.

To test, set slurm_cluster_install_nvidia_driver to false and set up a Slurm cluster, and the driver should not be installed.

The Slurm cluster playbook provides the var slurm_cluster_install_nvidia_driver to disable installs of the NVIDIA driver.
However, the Slurm cluster playbook also sources the CUDA playbook, which installs the driver itself.
And the CUDA playbook does not respect the flag in the Slurm cluster playbook.

Aren't dependencies fun?

This commit adds a flag to the CUDA playbook to allow disabling the driver install, and plumbs it through so the user can set the flag in the Slurm cluster playbook.

To test, set slurm_cluster_install_nvidia_driver to false and set up a Slurm cluster, and the driver should not be installed.
@ajdecon ajdecon requested a review from dholt May 7, 2021 19:50
@dholt
Copy link
Copy Markdown
Contributor

dholt commented Jun 16, 2021

Just a thought, maybe we should remove the driver install from the CUDA playbook? Historically we've tried to make these playbooks work well standalone, but this could be an instance where it's not needed.

@ajdecon
Copy link
Copy Markdown
Contributor Author

ajdecon commented Jun 16, 2021

Just a thought, maybe we should remove the driver install from the CUDA playbook? Historically we've tried to make these playbooks work well standalone, but this could be an instance where it's not needed.

I thought about doing that (and would technically prefer that!)... But I'm aware of users who just run the CUDA playbook directly to set up their GPU hosts, and that would break their workflow in an annoying way. Hence this, which is kinda a hack 😛

@ajdecon ajdecon merged commit d2f22f9 into NVIDIA:master Jun 16, 2021
@ajdecon ajdecon deleted the fix-nvidia-driver-disable branch June 16, 2021 17:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants