Skip to content

Commit 52dcb7b

Browse files
fix: Use go-nvfm (#476)
Signed-off-by: Mike McKiernan <mmckiernan@nvidia.com>
1 parent 187a4a5 commit 52dcb7b

1 file changed

Lines changed: 35 additions & 8 deletions

File tree

‎gpu-operator/gpu-operator-kubevirt-dra.rst‎

Lines changed: 35 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -508,18 +508,45 @@ advertises the required ``partitionN`` attribute.
508508
509509
#. Optional: Verification that relies on additional software.
510510

511-
#. Refer to the `Fabric-Manager-Client <https://github.com/NVIDIA/Fabric-Manager-Client>`__ repository
512-
for information about building the `fmpm` utility.
511+
#. Build and run the ``list-partitions`` binary.
513512

514-
You can use the `fmpm` utility to list the partitions and verify the partition status.
513+
Perform the build on a Linux system with Go 1.24 or later and the same CPU
514+
architecture as the target GPU node.
515515

516-
.. code-block:: console
516+
#. Clone the `go-nvfm <https://github.com/NVIDIA/go-nvfm/tree/main/examples/list-partitions>`__ repository and build the example:
517+
518+
.. code-block:: console
519+
520+
$ git clone --depth 1 https://github.com/NVIDIA/go-nvfm.git
521+
$ cd go-nvfm
522+
$ make example-list-partitions
523+
524+
#. Identify the driver pod on the node that owns the allocated GPUs:
525+
526+
.. code-block:: console
527+
528+
$ kubectl get pods --namespace gpu-operator \
529+
--selector app.kubernetes.io/component=nvidia-driver \
530+
--field-selector spec.nodeName=<node-name>
531+
532+
#. Copy the ``list-partitions`` executable to the driver container:
533+
534+
.. code-block:: console
535+
536+
$ kubectl cp --namespace gpu-operator \
537+
--container nvidia-driver-ctr \
538+
./list-partitions <driver-pod>:/run/nvidia/list-partitions
539+
540+
#. List the Fabric Manager partitions:
541+
542+
.. code-block:: console
517543
518-
$ /run/nvidia/fmpm \
519-
--unix-domain-socket /run/nvidia-fabricmanager/socket \
520-
-l
544+
$ kubectl exec --namespace gpu-operator \
545+
--container nvidia-driver-ctr \
546+
<driver-pod> -- bash -c \
547+
"NVFM_UNIX_SOCKET_PATH=/run/nvidia-fabricmanager/socket /run/nvidia/list-partitions"
521548
522-
Confirm that the partition selected for the claim reports ``isActive: 1``.
549+
Confirm that the partition selected for the claim reports ``"isActive": 1``.
523550

524551
#. For an additional connectivity demonstration, install a guest-compatible build of
525552
`nvbandwidth v0.8 <https://github.com/NVIDIA/nvbandwidth/releases/tag/v0.8>`__ and run:

0 commit comments

Comments
 (0)