Skip to main content

Troubleshooting

Only one NTT BDF is identified in the system​

  • Verify that PCIe bifurcation is correctly configured on the target PCIe slot. The system will not detect the two devices on the card if x8x8 bifurcation is not properly enabled.

nvme discover command does not show the target subsystems​

Fio performance is measured lower than expected​

  • Ensure that the target node is configured with the correct NUMA setup. To maximize performance, the adapter and SSDs should reside in the same NUMA node. Also, the CPU core running the NTT service should be located in the same NUMA node.
  • You can verify the NUMA status of PCIe devices with the following commands. 
    (target) ~$ sudo apt install hwloc
    ...
    (target) ~$ lstopo-no-graphics
    Machine (504GB total)
    Package L#0
        NUMANode L#0 (P#0 252GB)
        ...
        HostBridge
        PCIBridge
            PCI 2a:00.0 (NVMExp)
            Block(Disk) "nvme1n1"
        PCIBridge
            PCI 2b:00.0 (NVMExp)
            Block(Disk) "nvme2n1"
        PCIBridge
            PCI 2c:00.0 (NVMExp)
            Block(Disk) "nvme3n1"
        PCIBridge
            PCI 2d:00.0 (NVMExp)
            Block(Disk) "nvme4n1"
        ...
    Package L#1
        NUMANode L#1 (P#1 252GB)
        ...
        HostBridge
        PCIBridge
            PCI bf:00.0 (NVMExp)
            Block(Disk) "nvme9n1"
        PCIBridge
            PCI c0:00.0 (NVMExp)
            Block(Disk) "nvme10n1"
        HostBridge
        PCIBridge
            PCI cf:00.0 (NVMExp)
            Block(Disk) "nvme11n1"
        PCIBridge
            PCI d0:00.0 (NVMExp)
            Block(Disk) "nvme12n1"
        ...

Other issues not listed above​

  • If you encounter an issue not covered here, report it to contact@mangoboost.io. Please attach a debug log capturing the state of both the hardware and the software (a tar.gz of /var/log/mango/ntt_log).