Skip to main content

raid - Very slow disk performance on HP P410 with RAID1+0



I have HP Microserver N54L, until recently i have used integrated software raid without problems.
I have 2x WD Black and 2x WD Red (non-pro) disks for my raid array. I also have SSD directly on the motherboard (not that it matters, just to get all facts straight).



I purchased HP P410 with 256MB memory back with a Battery Back Write Cache module.




I'm using esxi 5.1 and i have one windows virtual machine. In this windows machine i get terrible read speeds (only up to 40-60 MB/s) write speed is kinda OK (around 100MB/s) but still slower than when i used integrated raid.



For example this is copying a large file from raid to ssd http://img.hihi.si/Upload/vYbD.png :(



This is my raid controller and array info



~ # esxcli   hpssacli cmd -q "ctrl all show config detail"

Smart Array P410 in Slot 1

 Bus Interface: PCI
 Slot: 1
 Serial Number: PACCRCN80ZK1TXH
 Cache Serial Number: PACCQID11090TB9
 RAID 6 (ADG) Status: Disabled
 Controller Status: OK
 Hardware Revision: C
 Firmware Version: 6.60
 Rebuild Priority: Medium
 Expand Priority: Medium

 Surface Scan Delay: 15 secs
 Surface Scan Mode: Idle
 Queue Depth: Automatic
 Monitor and Performance Delay: 60  min
 Elevator Sort: Enabled
 Degraded Performance Optimization: Disabled
 Inconsistency Repair Policy: Disabled
 Wait for Cache Room: Disabled
 Surface Analysis Inconsistency Notification: Disabled
 Post Prompt Timeout: 0 secs

 Cache Board Present: True
 Cache Status: OK
 Cache Ratio: 50% Read / 50% Write
 Drive Write Cache: Enabled
 Total Cache Size: 256 MB
 Total Cache Memory Available: 144 MB
 No-Battery Write Cache: Enabled
 Cache Backup Power Source: Batteries
 Battery/Capacitor Count: 1
 Battery/Capacitor Status: OK

 SATA NCQ Supported: True
 Number of Ports: 2 Internal only
 Encryption Supported: False
 Driver Name: HP HPSA
 Driver Version: 5.0.0
 Driver Supports HP SSD Smart Path: False

 Array: A
  Interface Type: SATA
  Unused Space: 0  MB

  Status: OK
  Array Type: Data



  Logical Drive: 1
     Size: 1.8 TB
     Fault Tolerance: 1+0
     Heads: 255
     Sectors Per Track: 32

     Cylinders: 65535
     Strip Size: 256 KB
     Full Stripe Size: 512 KB
     Status: OK
     Caching:  Enabled
     Unique Identifier: 600508B1001CC56A2CBC714D023D29CD
     Logical Drive Label: A002F51APACCRCN80ZK1TXH0967
     Mirror Group 0:
        physicaldrive 2I:0:5 (port 2I:box 0:bay 5, SATA, 1 TB, OK)
        physicaldrive 2I:0:6 (port 2I:box 0:bay 6, SATA, 1 TB, OK)

     Mirror Group 1:
        physicaldrive 2I:0:7 (port 2I:box 0:bay 7, SATA, 1 TB, OK)
        physicaldrive 2I:0:8 (port 2I:box 0:bay 8, SATA, 1 TB, OK)
     Drive Type: Data
     LD Acceleration Method: Controller Cache

  physicaldrive 2I:0:5
     Port: 2I
     Box: 0
     Bay: 5

     Status: OK
     Drive Type: Data Drive
     Interface Type: SATA
     Size: 1 TB
     Native Block Size: 512
     Firmware Revision: 05.01D05
     Serial Number:      WD-WCATR3871895
     Model: ATA     WDC WD1002FAEX-0
     SATA NCQ Capable: True
     SATA NCQ Enabled: True

     Current Temperature (C): 40
     Maximum Temperature (C): 53
     PHY Count: 1
     PHY Transfer Rate: 3.0Gbps

  physicaldrive 2I:0:6
     Port: 2I
     Box: 0
     Bay: 6
     Status: OK

     Drive Type: Data Drive
     Interface Type: SATA
     Size: 1 TB
     Native Block Size: 512
     Firmware Revision: 05.01D05
     Serial Number:      WD-WCATR3904352
     Model: ATA     WDC WD1002FAEX-0
     SATA NCQ Capable: True
     SATA NCQ Enabled: True
     Current Temperature (C): 40

     Maximum Temperature (C): 44
     PHY Count: 1
     PHY Transfer Rate: 3.0Gbps

  physicaldrive 2I:0:7
     Port: 2I
     Box: 0
     Bay: 7
     Status: OK
     Drive Type: Data Drive

     Interface Type: SATA
     Size: 1 TB
     Native Block Size: 4096
     Rotational Speed: 5400
     Firmware Revision: 01.01A01
     Serial Number:      WD-WCC4J4478782
     Model: ATA     WDC WD10EFRX-68P
     SATA NCQ Capable: True
     SATA NCQ Enabled: True
     Current Temperature (C): 32

     Maximum Temperature (C): 34
     PHY Count: 1
     PHY Transfer Rate: 3.0Gbps

  physicaldrive 2I:0:8
     Port: 2I
     Box: 0
     Bay: 8
     Status: OK
     Drive Type: Data Drive

     Interface Type: SATA
     Size: 1 TB
     Native Block Size: 4096
     Firmware Revision: 01.01A01
     Serial Number:      WD-WCC1U5116513
     Model: ATA     WDC WD10EFRX-68J
     SATA NCQ Capable: True
     SATA NCQ Enabled: True
     Current Temperature (C): 30
     Maximum Temperature (C): 36

     PHY Count: 1
     PHY Transfer Rate: 3.0Gbps


SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 250
  Device Number: 250
  Firmware Version: RevC
  WWID: 50014380118D3DBF
  Vendor ID: PMCSIERA
  Model:  SRC 8x6G



Any ideas what to do? Do i need to provide more information?


Answer




  • You're mixing 4k-sector (Advanced Format) disks and 512-byte drives in the same array. That's one consideration.

  • WD Red and Black disk drives have different characteristics.

  • What type of performance are you expecting? ESXi isn't compatible with software RAID, so are you comparing the right things? If you're comparing another OS to ESXi, that's not a valid comparison.

  • Adjust your RAID controller cache ratio to be biased towards writes, not 50:50.

  • The MicroServer is a slow system.



Comments

Post a Comment

Popular posts from this blog

linux - iDRAC6 Virtual Media native library cannot be loaded

When attempting to mount Virtual Media on a iDRAC6 IP KVM session I get the following error: I'm using Ubuntu 9.04 and: $ javaws -version Java(TM) Web Start 1.6.0_16 $ uname -a Linux aud22419-linux 2.6.28-15-generic #51-Ubuntu SMP Mon Aug 31 13:39:06 UTC 2009 x86_64 GNU/Linux $ firefox -version Mozilla Firefox 3.0.14, Copyright (c) 1998 - 2009 mozilla.org On Windows + IE it (unsurprisingly) works. I've just gotten off the phone with the Dell tech support and I was told it is known to work on Linux + Firefox, albeit Ubuntu is not supported (by Dell, that is). Has anyone out there managed to mount virtual media in the same scenario?
Post a Comment
Read more

ubuntu - Monitoring CPU, Mem, disk, on a single server

I've been looking for a simple starter solution for monitoring my [currently] single server hosted solution. Other than Nagios and similar, are there other good (simple) solutions people are using? Answer Everything depends on what you want. For example Munin is very simple, you can install and configure it in less then 10 minutes (on one server), it can sends alarms, make graphs from monitoring cpu, mem. apache connections, eaccellerator, disk io and many many more (it has many plugins). But if you are planning in future get some more machines, munin may not be enough. For example in munin you cant monitor state of individual processes, can't monitor changes in files (for security purpose). So if you wanna only see what is the utilization of basics parameters on your server and don't plan to buy some more servers Munin is what you are looking for, but if you wanna be alarmed when some of your service is down, take more control on what is happeninig on...
Post a Comment
Read more

hp proliant - Smart Array P822 with HBA Mode?

We get an HP DL360 G8 with an Smart Array P822 controller. On that controller will come a HP StorageWorks D2700 . Does anybody know, that it is possible to run the Smart Array P822 in HBA mode? I found only information about the P410i, who can run HBA. If this is not supported, what you think about the LSI 9207-8e controller? Will this fit good in that setup? The Hardware we get is used but all original from HP. The StorageWorks has 25 x 900 GB SAS 10K disks. Because the disks are not new I would like to use only 22 for raid6, and the rest for spare (I need to see if the disk count is optimal or not for zfs). It would be nice if I'm not stick to SAS in future. As OS I would like to install debian stretch with zfs 0.71 as file system and software raid. I have see that hp has an page for debian to. I would like to use hba mode because it is recommend, that zfs know at most as possible about the disk, and I'm independent from the raid controller. For us zfs have many benefits, ...
Post a Comment
Read more