QLogic Support
 
 
 
Skip Navigation

Announcements

Dear Customers,

Maintenance is scheduled for the QLogic (Cavium) support site.
The customer support log-in page, driver downloads, and license key activation page may be unavailable between Friday, October 27, at 13:00 PDT, and will remain offline until Monday, October 30, at 08:00 PDT.
We apologize for any inconvenience. You may still open a support case at globalsupport@cavium.com during this time.



For warranty/service verification, please provide your product serial number(s)when contacting support. Serial numbers are located on product bar code labels or from management tools.


Ask Search:
Customer Support Article

Changing QLogic BR-1860 Fabric Adapter Modes in ESXi5.x

  • May 21, 2014
  • ·
  • Like
  • 0

Summary

Changing the QLogic BR-1860 Fabric Adapter Modes in ESXi5.x. Examples of HBA, CNA and NIC modes of operation.

Question

How can the BR-1860 Modes in ESXi5.x be changed?

Answer

QLogic BR-1860 Fabric Adapter Modes

 HBA Mode:

BR-1860 adapter installed straight out of the box with no optics. Only Fibre Channel is enabled out of the box. The Brocade FC/CNA Adapter driver (BFA) driver has been installed in the system.
 
Example commands from ESXi5.x host command line with Brocade Command line Utility (BCU) plugin installed:

 
~ # esxcli brocade bcu --command='adapter --list'
------------------------------------------------------------------------
AD#  NP  HW-path        Type   Model-Info       Serial-num   Name
------------------------------------------------------------------------
 1   2   0000:07        AnyIO  Brocade-1860-2p  BUL2508K09X  --
------------------------------------------------------------------------


PCI Function Command:

Note: FC is active, using the AD# 1 in the pcifn command:

Example command output:

~ # esxcli brocade bcu --command='pcifn --list 1'
 
--------------------------------------------------------------------------
Fn    Port  Type  QPairs    MSI-X     Option    SR-IOV  Max     Active
                            Resources Rom       capable VFs     VFs
---------------------------------------------------------------------------
Active:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
Configured:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
2     0     ETH   32        64        Enabled   N       0       -
3     1     ETH   32        64        Enabled   N       0       -
---------------------------------------------------------------------------
 
lspci.txt from vmsupport: 

Note:  PCI-e function 0,1 are shown and the adapter reports as an FC HBA:
 
0000:07:00.0 Serial bus controller: Brocade Communications Systems, Inc. Brocade FC HBA 1860/1867 [vmhba4]
 
0000:07:00.1 Serial bus controller: Brocade Communications Systems, Inc. Brocade FC HBA 1860/1867 [vmhba5]
 
*********************************************************************************************************************
 

CNA Mode:

This command changes the adapter mode to CNA. The BFA driver is already installed.
  
~ # esxcli brocade bcu --command='adapter --mode 1 CNA'
 
Warning: This command will not reset the settings configured on the adapter.
 
Adapter mode is configured successfully.
A host reboot is needed for the changes to be effective. You may also have to change the SFP to match the new mode.


Example CNA report below shows state after issuing the 
PCI Function Command but before reboot: 

Note: The FC Type is active.
 
~ # esxcli brocade bcu --command='pcifn --list 1'
---------------------------------------------------------------------------
Fn    Port  Type  QPairs    MSI-X     Option    SR-IOV  Max     Active
                            Resources Rom       capable VFs     VFs
---------------------------------------------------------------------------
Active:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
Configured:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
2     0     ETH   32        64        Enabled   N       0       -
3     1     ETH   32        64        Enabled   N       0       -
---------------------------------------------------------------------------

 

The CNA output below shows the state after issuing the PCI Function Command and rebooting. The BFA driver is already installed.

Note: Both FC and ETH functions are now active.  
 
~ # esxcli brocade bcu --command='pcifn --list 1'
 
---------------------------------------------------------------------------
Fn    Port  Type  QPairs    MSI-X     Option    SR-IOV  Max     Active
                            Resources Rom       capable VFs     VFs
---------------------------------------------------------------------------
Active:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
2     0     ETH   32        64        Enabled   N       0       -
3     1     ETH   32        64        Enabled   N       0       -
Configured:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
2     0     ETH   32        64        Enabled   N       0       -
3     1     ETH   32        64        Enabled   N       0       -
---------------------------------------------------------------------------

 
lspci.txt from the vmsupport, this shows the PCI mode for the adapter.

Note: Only the BFA driver is installed at this time. Functions 2,3 are reported as network controllers but function 0,1 are missing.  Also, there is no vmnic or vmhba reported.  Both BFA and BNA drivers MUST be installed for CNA to function
 
0000:07:00.2 Network controller: Brocade Communications Systems, Inc. Brocade Fabric Adapter
0000:07:00.3 Network controller: Brocade Communications Systems, Inc. Brocade Fabric Adapter
 
 

Log excerpt after installing the BNA driver with adapter in CNA mode. BFA driver was previously installed:

Note: Both BFA and BNA drivers MUST be Installed for CNA function to work correctly
 
BNA driver installation:
 
/var/log/vmware # esxcli software vib install -v Brocade_bootbank_net-bna_3.2.3.0-1OEM.550.0.0.1198610.vib
 
Installation Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   Reboot Required: true
   VIBs Installed: Brocade_bootbank_net-bna_3.2.3.0-1OEM.550.0.0.1198610
   VIBs Removed:
   VIBs Skipped:


After Reboot:

lspci.txt  from vmsupport  with CNA Mode with BFA and BNA Driver Installed: 
 
Note:  Function 0,1 Report FCoE CNA and Function 2,3 Report Ethernet Adapter and a vmhba and vmnic number are assigned by the vmkernel which proves the BFA and BNA drivers are loaded.  This is correct!
 
0000:07:00.0 Serial bus controller: Brocade Communications Systems, Inc. Brocade FCoE CNA 1860/1864 [vmhba4]
0000:07:00.1 Serial bus controller: Brocade Communications Systems, Inc. Brocade FCoE CNA 1860/1864 [vmhba5]
0000:07:00.2 Network controller: Brocade Communications Systems, Inc. Brocade Ethernet Adapter 1860/1864 [vmnic6]
0000:07:00.3 Network controller: Brocade Communications Systems, Inc. Brocade Ethernet Adapter 1860/1864 [vmnic14]

 

 

NIC Mode:   
 

Changing adapter to NIC mode,  BFA and BNA drivers are installed. 
 
~ # esxcli brocade bcu --command='adapter --mode 1 NIC'
Warning: This command will not reset the settings configured on the adapter.
 
Adapter mode is configured successfully.
A host reboot is needed for the changes to be effective. You may also have to change the SFP to match the new mode.
 

The CNA output of PCI Function Command Before Reboot:

Note:  Configured shows ETH only.
 
~ # esxcli brocade bcu --command='pcifn --list 1'
---------------------------------------------------------------------------
Fn    Port  Type  QPairs    MSI-X     Option    SR-IOV  Max     Active
                            Resources Rom       capable VFs     VFs
---------------------------------------------------------------------------
Active:
0     0     FC    32        64        Enabled   N       0       -
1     1     FC    32        64        Enabled   N       0       -
2     0     ETH   32        64        Disabled  N       0       -
3     1     ETH   32        64        Disabled  N       0       -
Configured:
0     0     ETH   32        64        Enabled   N       0       -
1     1     ETH   32        64        Enabled   N       0       -

---------------------------------------------------------------------------
 

PCI Function Command After Reboot:

 
~ # esxcli brocade bcu --command='pcifn --list 1'
Note:  ETH is Active
---------------------------------------------------------------------------
Fn    Port  Type  QPairs    MSI-X     Option    SR-IOV  Max     Active
                            Resources Rom       capable VFs     VFs
---------------------------------------------------------------------------
Active:
0     0     ETH   32        64        Enabled   N       0       -
1     1     ETH   32        64        Enabled   N       0       -
Configured:
0     0     ETH   32        64        Enabled   N       0       -
1     1     ETH   32        64        Enabled   N       0       -
---------------------------------------------------------------------------
 

 
 
lspci.txt from vmsupport NIC Mode and BFA and BNA drivers installed.
Note: Function 0,1 report Ethernet Adapter:
 
0000:07:00.0 Network controller: Brocade Communications Systems, Inc. Brocade Ethernet Adapter 1860/1864 [vmnic6]
0000:07:00.1 Network controller: Brocade Communications Systems, Inc. Brocade Ethernet Adapter 1860/1864 [vmnic14]
 
 

Attachment