Troubleshooting
Only one NTT BDF is identified in the system
- Verify that PCIe bifurcation is correctly configured on the target PCIe slot. The system will not detect the two devices on the card if x8x8 bifurcation is not properly enabled.
nvme discover
command does not show the target subsystems
- Check the client hostnqn is correctly registered on the target subsystem
- Refer to Section Register hostnqn to a subsystem.
Fio performance is measured lower than expected
- Ensure that target node is configured with the correct NUMA setup. To maximize performance, Adapter and SSDs should reside in the same NUMA node. Also, the CPU core running the NTT service should be located in the same NUMA node.
- You can verify the NUMA status of PCIe devices with the following commands.
(target) ~$ sudo apt install hwloc
...
(target) ~$ lstopo-no-graphics
Machine (504GB total)
Package L#0
NUMANode L#0 (P#0 252GB)
...
HostBridge
PCIBridge
PCI 2a:00.0 (NVMExp)
Block(Disk) "nvme1n1"
PCIBridge
PCI 2b:00.0 (NVMExp)
Block(Disk) "nvme2n1"
PCIBridge
PCI 2c:00.0 (NVMExp)
Block(Disk) "nvme3n1"
PCIBridge
PCI 2d:00.0 (NVMExp)
Block(Disk) "nvme4n1"
...
Package L#1
NUMANode L#1 (P#1 252GB)
...
HostBridge
PCIBridge
PCI bf:00.0 (NVMExp)
Block(Disk) "nvme9n1"
PCIBridge
PCI c0:00.0 (NVMExp)
Block(Disk) "nvme10n1"
HostBridge
PCIBridge
PCI cf:00.0 (NVMExp)
Block(Disk) "nvme11n1"
PCIBridge
PCI d0:00.0 (NVMExp)
Block(Disk) "nvme12n1"
...
There is an error in the functionality of NTT not described above
- You can report the error through contact@mangoboost.io. On reporting, you should provide the debug log that
includes the state of both the hardware and the software, by creating a
tar.gz
file of/var/log/mango/ntt_log
.