Skip to content

Add NVMe-oF driver type#375

Draft
nixpanic wants to merge 4 commits intoceph:mainfrom
nixpanic:deploy/nvmeof
Draft

Add NVMe-oF driver type#375
nixpanic wants to merge 4 commits intoceph:mainfrom
nixpanic:deploy/nvmeof

Conversation

@nixpanic
Copy link
Member

@nixpanic nixpanic commented Jan 9, 2026

Describe what this PR does

The NVMe-oF Ceph-CSI driver is a work in progress, and expected to be ready for testing soon. Because Ceph-CSI will recommend the Ceph-CSI Operator for deploying, it will need to support the new NVMe-oF driver type as well.

Is there anything that requires special attention

Internally the NVMe-oF driver in Ceph-CSI calls the functions of the RBD CSI Controller. That means almost all permissions and requirements that are valid for RBD, are also required for NVMe-oF.

The initial NVMe-oF driver will only support basic functions. Additional features like snapshots, resizing and CSI-Addons procedures will be added later.

The NVMe-oF gateway can not yet be deployed by Rook. This makes testing a manual effort for now.

Related issues

See-also: #304 ceph/ceph-csi#5370 rook/rook#16950

Future concerns

In order to use Ceph-CSI with NVMe-oF, one needs a Ceph Tentacle cluster (for the ceph-nvme gateway) and these current images:

  • quay.io/cephcsi/cephcsi:canary
  • gcr.io/k8s-staging-sig-storage/csi-provisioner:canary
  • gcr.io/k8s-staging-sig-storage/csi-resizer:canary

The Kubernetes CSI images are required for the VolumeAttributeClass support (the ceph-nvme gateway supports QoS, implemented in Ceph-CSI through the new ControllerModifyVolume CSI procedure).

Checklist:

  • Commit Message Formatting: Commit titles and messages follow
    guidelines in the developer
    guide
    .
  • Reviewed the developer guide on Submitting a Pull
    Request
  • Pending release
    notes

    updated with breaking and/or notable changes for the next major release.
  • Documentation has been updated, if necessary.
  • Unit tests have been added, if necessary.
  • Integration tests have been added, if necessary.

@nixpanic nixpanic changed the title Deploy/nvmeof Add NVMe-oF driver type Jan 9, 2026
@nixpanic nixpanic force-pushed the deploy/nvmeof branch 3 times, most recently from 418d06f to f92fd75 Compare January 13, 2026 17:09
The NVMe-oF Ceph-CSI driver is a work in progress, and expected to be
ready for testing soon. Because Ceph-CSI will recommend the Ceph-CSI
Operator for deploying, it will need to support the new NVMe-oF driver
type as well.

Signed-off-by: Niels de Vos <[email protected]>
Signed-off-by: Niels de Vos <[email protected]>
Only the canary image currently supports snapshots with NVMe-oF. Older
releases do not support it, and the csi-snapshotter sidecar gets into an
error state.

Signed-off-by: Niels de Vos <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant