Difference between revisions of "LSI MPT SAS Linux management"

From vpsget wiki
Jump to: navigation, search
(Created page with "*DRAFT* Check what exact controller do you have: lscpi or more specified: lspci | grep LSI 09:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 PCI...")
 
Line 79: Line 79:
 
  smartctl -a  /dev/sg2 #for disk attached to the 1st channel in my case
 
  smartctl -a  /dev/sg2 #for disk attached to the 1st channel in my case
 
  smartctl -a  /dev/sg5  
 
  smartctl -a  /dev/sg5  
 +
 +
 +
_________________________________________________
 +
LSI controller Management
 +
 +
You need to download bin
 +
http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-16e#downloads
 +
find binary for your system and just copy it to /usr/local/bin/ for ease of use (it's up to you)
 +
Just type sas3ircu in shell to see commands.
 +
 +
For Example LIST LSI SAS controllers:
 +
 +
# sas3ircu LIST
 +
Avago Technologies SAS3 IR Configuration Utility.
 +
Version 13.00.00.00 (2016.03.08)
 +
Copyright (c) 2009-2016 Avago Technologies. All rights reserved.
 +
          Adapter      Vendor  Device                      SubSys  SubSys
 +
  Index    Type          ID      ID    Pci Address          Ven ID  Dev ID
 +
  -----  ------------  ------  ------  -----------------    ------  ------
 +
    0    SAS3008      1000h  97h    00h:09h:00h:00h      15d9h  0808h
 +
SAS3IRCU: Utility Completed Successfully.
 +
 +
 +
Display raid volumes details/info:
 +
 +
# sas3ircu 0 DISPLAY
 +
Avago Technologies SAS3 IR Configuration Utility.
 +
Version 13.00.00.00 (2016.03.08)
 +
Copyright (c) 2009-2016 Avago Technologies. All rights reserved.
 +
Read configuration has been initiated for controller 0
 +
------------------------------------------------------------------------
 +
Controller information
 +
------------------------------------------------------------------------
 +
  Controller type                        : SAS3008
 +
  PI Supported                            : Yes
 +
  PI Mixing                              : Disabled
 +
  BIOS version                            : 8.35.00.00
 +
  Firmware version                        : 15.00.03.00
 +
  Channel description                    : 1 Serial Attached SCSI
 +
  Initiator ID                            : 0
 +
  Maximum physical devices                : 255
 +
  Concurrent commands supported          : 3072
 +
  Slot                                    : 40
 +
  Segment                                : 0
 +
  Bus                                    : 9
 +
  Device                                  : 0
 +
  Function                                : 0
 +
  RAID Support                            : Yes
 +
------------------------------------------------------------------------
 +
IR Volume information
 +
  <---ommited--->
 +
  
  

Revision as of 12:35, 27 November 2018

  • DRAFT*

Check what exact controller do you have:

lscpi

or more specified:

lspci | grep LSI
09:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)

example with controller Supermicro LSI AOC-S3008L-L8i https://www.supermicro.com/products/accessories/addon/AOC-S3008L-L8i.cfm

check the mpt3sas module is loaded

lsmod | grep sas
mpt3sas               222983  1 
raid_class             13554  1 mpt3sas
scsi_transport_sas     41224  1 mpt3sas


Otherwise load it with

modprobe mpt3sas

ALso you may neeed to download the rpm and install it : https://www.supermicro.com/wftp/driver/SAS/LSI/3008/Driver/

Alternate link : https://www.broadcom.com/products/storage/host-bus-adapters/sas-9311-8i#downloads (another adapter with the same logic)

Once downloaded you need to install the module according to your kernel. In our case we use kernel  3.10.0-862.11.6.vz7.64.7 Openvz7 SO we will use the next rpm: kmod-mpt3sas-26.00.00.00_el7.3-1.x86_64.rpm

If you face any dep issues do not afraid to install it with --nodeps like

rpm -i kmod-mpt3sas-26.00.00.00_el7.3-1.x86_64.rpm --nodeps

If everything is fine you should be able to see the loaded modules and smartctl should work fine:

smartctl --scan
/dev/sda -d scsi # /dev/sda, SCSI device
/dev/sdb -d scsi # /dev/sdb, SCSI device

I know that raid based on sdb:

smartctl --all /dev/sdb

smartctl 6.6 2017-11-05 r4594 [x86_64-linux-3.10.0-862.11.6.vz7.64.7] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               LSI
Product:              Logical Volume
Revision:             3000
Compliance:           SPC-4
User Capacity:        11,999,998,115,840 bytes [11.9 TB]
Logical block size:   512 bytes
Physical block size:  4096 bytes
Logical Unit id:      0x600508e000000000f3cd50d24b3e470e
Serial number:        3528510963239550027
Device type:          disk
Local Time is:        Sun Oct 21 10:35:42 2018 EEST
SMART support is:     Unavailable - device lacks SMART capability.

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature:     0 C
Drive Trip Temperature:        0 C 

Error Counter logging not supported

Device does not support Self Test logging

You may see the disks attached with lswh

lshw -c disk

You need to make sure SCSI generic device driver is loaded (and will be loaded at boot). Simply run:

lsmod | grep sg

if nothing listed try to activate module:

modprobe sg

You can add this to autoload:

echo sg >> /etc/modules

To view SMART details use the next:

smartctl -a  /dev/sg0  #for Logic Volume
smartctl -a  /dev/sg2 #for disk attached to the 1st channel in my case
smartctl -a  /dev/sg5 


_________________________________________________ LSI controller Management

You need to download bin http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-16e#downloads find binary for your system and just copy it to /usr/local/bin/ for ease of use (it's up to you) Just type sas3ircu in shell to see commands.

For Example LIST LSI SAS controllers:

# sas3ircu LIST
Avago Technologies SAS3 IR Configuration Utility.
Version 13.00.00.00 (2016.03.08) 
Copyright (c) 2009-2016 Avago Technologies. All rights reserved. 
         Adapter      Vendor  Device                       SubSys  SubSys 
  Index    Type          ID      ID    Pci Address          Ven ID  Dev ID 
 -----  ------------  ------  ------  -----------------    ------  ------ 
   0     SAS3008       1000h   97h    00h:09h:00h:00h      15d9h   0808h 
SAS3IRCU: Utility Completed Successfully. 

Display raid volumes details/info:

# sas3ircu 0 DISPLAY
Avago Technologies SAS3 IR Configuration Utility.
Version 13.00.00.00 (2016.03.08) 
Copyright (c) 2009-2016 Avago Technologies. All rights reserved. 
Read configuration has been initiated for controller 0
------------------------------------------------------------------------
Controller information
------------------------------------------------------------------------
  Controller type                         : SAS3008
  PI Supported                            : Yes
  PI Mixing                               : Disabled
  BIOS version                            : 8.35.00.00
  Firmware version                        : 15.00.03.00
  Channel description                     : 1 Serial Attached SCSI
  Initiator ID                            : 0
  Maximum physical devices                : 255
  Concurrent commands supported           : 3072
  Slot                                    : 40
  Segment                                 : 0
  Bus                                     : 9
  Device                                  : 0
  Function                                : 0
  RAID Support                            : Yes
------------------------------------------------------------------------
IR Volume information
 <---ommited--->


---to add: lsiutil mpt-status