2

I have a fat node which has 2TB memory. With the new Connect-IB card, I want to increase the MTT, so I could register a large memory region. I found this post for HowTo Increase Memory Size used by Mellanox Adapters , but it didn't mention how to increase that for Connect-IB. Could anyone give me any suggestion?

Tgilgul
  • 1,614
  • 1
  • 20
  • 35
Zack
  • 1,205
  • 2
  • 14
  • 38
  • 1
    Did you try allocating memory with 1 GB hugepages and then registering it? I am not sure if this will help, though. – Anuj Kalia Mar 19 '16 at 12:37
  • As far as I know the Connect-IB driver doesn't have a similar feature. You should try @AnujKalia's suggestion. – haggai_e Mar 20 '16 at 06:24

1 Answers1

1

You did not specify the OS, however the Connect-X recipe you pointed to is linux specific, so I assume we are speaking about linux openib stack.

AFAIK, Connect-IB driver allocates memory from the kernel for MTT and other cashes dynamically.

(See drivers/net/ethernet/mellanox/mlx5/core/pagealloc.c and uses of public functions defined in this module by other drivers/net/ethernet/mellanox/mlx5/core/* modules)

Serge
  • 6,088
  • 17
  • 27