Monday, June 25, 2018

storage - HP Smart Array P822 w. Dual D2700 - cabling for best performance




Reading the D2600/D2700 User guide, there's a section called "Cabling examples", but none of the examples match what we intend to do.



I just want to make sure that it makes sense, before we do it.



So here's the plan:



We have 1xP822 in a Gen8 rack server and 2xD2700 enclosures. We have 24 drives in each D2700. Both D2700 is configured with the exact same disk layout. We create one RAID10 array on top of the D2700 enclosures (meaning one side of the mirror is on each D2700 enclosure - the HP ACU/SSM automatically makes sure of this).



We then connect the P822 controller with 4 cables in total to the D2700 enclosures (NO cascading):




P822 Port 1E: D2700 box1, IO Module A
P822 Port 2E: D2700 box2, IO Module A
P822 Port 3E: D2700 box1, IO Module B
P822 Port 4E: D2700 box2, IO Module B



Not thinking about the expansion options here, would this be the correct way of cabling, in terms of getting maximum performance from the drives/enclosures/p822 controller?



Thanks :)




EDIT: So what I'm reading from the comments so far, is that this approach is not "WRONG/INCORRECT", it's just not really beneficial in any way?...


Answer



I have lots of full D2700 enclosures... You will be oversubscribed at the enclosure level, due to the SAS expander backplane in the D2700. You'll have either 4 or 8 lanes of 6Gbps bandwidth available to you.



24 x 6Gbps-linked SAS disks, each really capable of 2Gbps == 48Gbps sequential capability (minus overhead).



That's versus your 4 x 6Gbps = 24Gbps SAS SFF-8088 link to the host.



You should be looking into a Dual-Domain configuration, where you're leveraging the multipath SAS connections between the host and the array and disks. This also provides some resiliency.




IOPS will be a function of workload and array layout, not the cabling arrangement.



Max throughput will be well below the PCIe 3.0 full-duplex 8 Gigabytes/second capability of the PCIe slot. The bottlenecks in raw throughput will be your D2700 enclosure, followed by the RAID controller.



There's no cabling arrangement that will yield an appreciable difference in that throughput, short of going to a dual-domain multipath configuration.


No comments:

Post a Comment

linux - How to SSH to ec2 instance in VPC private subnet via NAT server

I have created a VPC in aws with a public subnet and a private subnet. The private subnet does not have direct access to external network. S...