LSI MPT SAS Linux management

• DRAFT*

Check what exact controller do you have:

lscpi

or more specified:

lspci | grep LSI
09:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)

example with controller Supermicro LSI AOC-S3008L-L8i https://www.supermicro.com/products/accessories/addon/AOC-S3008L-L8i.cfm

check the mpt3sas module is loaded

lsmod | grep sas
mpt3sas               222983  1 
raid_class             13554  1 mpt3sas
scsi_transport_sas     41224  1 mpt3sas

Otherwise load it with

modprobe mpt3sas

ALso you may neeed to download the rpm and install it : https://www.supermicro.com/wftp/driver/SAS/LSI/3008/Driver/

Alternate link : https://www.broadcom.com/products/storage/host-bus-adapters/sas-9311-8i#downloads (another adapter with the same logic)

Once downloaded you need to install the module according to your kernel. In our case we use kernel  3.10.0-862.11.6.vz7.64.7 Openvz7 SO we will use the next rpm: kmod-mpt3sas-26.00.00.00_el7.3-1.x86_64.rpm

If you face any dep issues do not afraid to install it with --nodeps like

rpm -i kmod-mpt3sas-26.00.00.00_el7.3-1.x86_64.rpm --nodeps

If everything is fine you should be able to see the loaded modules and smartctl should work fine:

smartctl --scan
/dev/sda -d scsi # /dev/sda, SCSI device
/dev/sdb -d scsi # /dev/sdb, SCSI device

I know that raid based on sdb:

smartctl --all /dev/sdb

smartctl 6.6 2017-11-05 r4594 [x86_64-linux-3.10.0-862.11.6.vz7.64.7] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               LSI
Product:              Logical Volume
Revision:             3000
Compliance:           SPC-4
User Capacity:        11,999,998,115,840 bytes [11.9 TB]
Logical block size:   512 bytes
Physical block size:  4096 bytes
Logical Unit id:      0x600508e000000000f3cd50d24b3e470e
Serial number:        3528510963239550027
Device type:          disk
Local Time is:        Sun Oct 21 10:35:42 2018 EEST
SMART support is:     Unavailable - device lacks SMART capability.

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature:     0 C
Drive Trip Temperature:        0 C 

Error Counter logging not supported

Device does not support Self Test logging

You may see the disks attached with lswh

lshw -c disk

You need to make sure SCSI generic device driver is loaded (and will be loaded at boot). Simply run:

lsmod | grep sg

if nothing listed try to activate module:

modprobe sg

You can add this to autoload:

echo sg >> /etc/modules

To view SMART details use the next:

smartctl -a  /dev/sg0  #for Logic Volume
smartctl -a  /dev/sg2 #for disk attached to the 1st channel in my case
smartctl -a  /dev/sg5 

_________________________________________________

• LSI controller Management*

You need to download bin http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-16e#downloads find binary for your system and just copy it to /usr/local/bin/ for ease of use (it's up to you) Just type sas3ircu in shell to see commands.

For Example LIST LSI SAS controllers:

# sas3ircu LIST
Avago Technologies SAS3 IR Configuration Utility.
Version 13.00.00.00 (2016.03.08) 
Copyright (c) 2009-2016 Avago Technologies. All rights reserved. 
         Adapter      Vendor  Device                       SubSys  SubSys 
  Index    Type          ID      ID    Pci Address          Ven ID  Dev ID 
 -----  ------------  ------  ------  -----------------    ------  ------ 
   0     SAS3008       1000h   97h    00h:09h:00h:00h      15d9h   0808h 
SAS3IRCU: Utility Completed Successfully. 

Display raid volumes details/info:

# sas3ircu 0 DISPLAY
Avago Technologies SAS3 IR Configuration Utility.
Version 13.00.00.00 (2016.03.08) 
Copyright (c) 2009-2016 Avago Technologies. All rights reserved. 
Read configuration has been initiated for controller 0
------------------------------------------------------------------------
Controller information
------------------------------------------------------------------------
  Controller type                         : SAS3008
  PI Supported                            : Yes
  PI Mixing                               : Disabled
  BIOS version                            : 8.35.00.00
  Firmware version                        : 15.00.03.00
  Channel description                     : 1 Serial Attached SCSI
  Initiator ID                            : 0
  Maximum physical devices                : 255
  Concurrent commands supported           : 3072
  Slot                                    : 40
  Segment                                 : 0
  Bus                                     : 9
  Device                                  : 0
  Function                                : 0
  RAID Support                            : Yes
------------------------------------------------------------------------
IR Volume information
------------------------------------------------------------------------
IR volume 1
  Volume ID                               : 322
  PI Supported                            : No
  Status of volume                        : Okay (OKY)
  Volume wwid                             : 03**********7e22
  RAID level                              : RAID1
  Size (in MB)                            : 9536743
  Physical hard disks                     :
  PHY[0] Enclosure#/Slot#                 : 1:0
  PHY[1] Enclosure#/Slot#                 : 1:1
IR volume 2
  Volume ID                               : 323
  PI Supported                            : No
  Status of volume                        : Okay (OKY)
  Volume wwid                             : 0e**********cdf3
  RAID level                              : RAID10
  Size (in MB)                            : 11444090
  Physical hard disks                     :
  PHY[0] Enclosure#/Slot#                 : 1:4
  PHY[1] Enclosure#/Slot#                 : 1:5
  PHY[2] Enclosure#/Slot#                 : 1:6
  PHY[3] Enclosure#/Slot#                 : 1:7
------------------------------------------------------------------------
Physical device information
------------------------------------------------------------------------
   <---ommited--->

---to add: lsiutil mpt-status