Skip to main content

ssd - The setup of S2D that delivers up to 2M IOPS to SQL FCI

itemprop="text">

We are about to deploy shared storage
researching for ultra-fast storage to implement Microsoft SQL Server Failover Cluster
(FCI). So far the project goes, we would to start with 500K IOPS for 8k blocks about
70r/30w pattern.
Also we would like to have an ability to encrease pefromance
up to 2M IOPS (for same pattern) in a year or so, due to the SQL server growing
expectations.




For the purpose of the
project, we are going to deploy 4-node cluster of Microsoft Storage Spaces Direct (S2D).
As for hardware we already have 2x Dell rack servers R730xd with 2x E5-2697 and 512GB
RAM and we are ready to get 2 more.



As for
storage, Microsoft recommends going with NVMe or NVMe + SSD to obtain maximum
performance ( href="https://technet.microsoft.com/en-us/windows-server-docs/storage/storage-spaces/choosing-drives"
rel="noreferrer">source). Therefore, after some research, Samsung SSDs are
good to go with. href="https://www.starwindsoftware.com/blog/benchmarking-samsung-nvme-ssd-960-evo-m-2"
rel="noreferrer">https://www.starwindsoftware.com/blog/benchmarking-samsung-nvme-ssd-960-evo-m-2
rel="noreferrer">http://www.storagereview.com/samsung_960_pro_m2_nvme_ssd_review



The
setup we consider is following: 1x Samsung 960 EVO NVMe + 4x Samsung PM863 SSD per S2D
host.



Can S2D implementation using Samsung 960
EVO NVMe and Samsung PM863 deliver 500k to SQL
FCI?



EDIT:




a)
didn't you ask something similar the other day? -
I did. A new question was
posted since the first shot was off-topic. Subject and body are changed. Previous
question will be deleted.



b) they're consumer
drives, -
The question is about to find the setup of S2D that could house
required 500k IOPS on start. What setup would you
recommend?



c) how are you planning on connecting
all of those, I'm unaware of a server out there with 5 x M.2 slots - we need to know
this, - Only 1x M.2 drive per each node is to be used. I have corrected the setup of
shared storage: 1x Samsung 960 EVO NVMe + 4x Samsung PM863 SATA SSD per S2D
host.



d) what kind of IOPSs (size and type)? -


SQL FCI read intensive workload of 4k, 8k, 64k blocks. Reads range
is 70-90% and writes one - 30-10%.



e) 500k-to-2M
is a very wide range of requirement variance - why such a wide range? -
The
project performance is expected to significantly grows in sort period, so we must have
ability to run 4x workload on same hardware till the and of the first year. A year after
we will add 4x more hosts to cluster.



We are
Microsoft Shop so there is no option to go eslewhere but Microsoft SQL Server 2016.
Also, as you might consume the project requires redundancy and extra availability
therefore SQL Failover Cluster Intance will be deployed aside S2D.



Answer




It's a bad idea to use consumer SSDs in your SDS deployments. VMware VSAN and
Microsoft S2D both assume writes will be "atomic", so one ACK-ed by host is actually on
persistent memory; consumer SSDs don't have any power outage protection so they MIGHT
lose your data. Write endurance is also very different.



href="https://blogs.technet.microsoft.com/filecab/2016/11/18/dont-do-it-consumer-ssd/"
rel="noreferrer">https://blogs.technet.microsoft.com/filecab/2016/11/18/dont-do-it-consumer-ssd/




href="https://blogs.vmware.com/vsphere/2013/12/virtual-san-hardware-guidance-part-1-solid-state-drives.html"
rel="noreferrer">https://blogs.vmware.com/vsphere/2013/12/virtual-san-hardware-guidance-part-1-solid-state-drives.html



href="http://www.yellow-bricks.com/2013/09/16/frequently-asked-questions-virtual-san-vsan/"
rel="noreferrer">http://www.yellow-bricks.com/2013/09/16/frequently-asked-questions-virtual-san-vsan/



I'd
suggest to stick with some Enterprise-grade NVMe cards.



Comments

Post a Comment

Popular posts from this blog

linux - iDRAC6 Virtual Media native library cannot be loaded

When attempting to mount Virtual Media on a iDRAC6 IP KVM session I get the following error: I'm using Ubuntu 9.04 and: $ javaws -version Java(TM) Web Start 1.6.0_16 $ uname -a Linux aud22419-linux 2.6.28-15-generic #51-Ubuntu SMP Mon Aug 31 13:39:06 UTC 2009 x86_64 GNU/Linux $ firefox -version Mozilla Firefox 3.0.14, Copyright (c) 1998 - 2009 mozilla.org On Windows + IE it (unsurprisingly) works. I've just gotten off the phone with the Dell tech support and I was told it is known to work on Linux + Firefox, albeit Ubuntu is not supported (by Dell, that is). Has anyone out there managed to mount virtual media in the same scenario?
Post a Comment
Read more

hp proliant - Smart Array P822 with HBA Mode?

We get an HP DL360 G8 with an Smart Array P822 controller. On that controller will come a HP StorageWorks D2700 . Does anybody know, that it is possible to run the Smart Array P822 in HBA mode? I found only information about the P410i, who can run HBA. If this is not supported, what you think about the LSI 9207-8e controller? Will this fit good in that setup? The Hardware we get is used but all original from HP. The StorageWorks has 25 x 900 GB SAS 10K disks. Because the disks are not new I would like to use only 22 for raid6, and the rest for spare (I need to see if the disk count is optimal or not for zfs). It would be nice if I'm not stick to SAS in future. As OS I would like to install debian stretch with zfs 0.71 as file system and software raid. I have see that hp has an page for debian to. I would like to use hba mode because it is recommend, that zfs know at most as possible about the disk, and I'm independent from the raid controller. For us zfs have many benefits, ...
Post a Comment
Read more

linux - Awstats - outputting stats for merged Access_logs only producing stats for one server's log

I've been attempting this for two weeks and I've accessed countless number of sites on this issue and it seems there is something I'm not getting here and I'm at a lost. I manged to figure out how to merge logs from two servers together. (Taking care to only merge the matching domains together) The logs from the first server span from 15 Dec 2012 to 8 April 2014 The logs from the second server span from 2 Mar 2014 to 9 April 2014 I was able to successfully merge them using the logresolvemerge.pl script simply enermerating each log and > out_putting_it_to_file Looking at the two logs from each server the format seems exactly the same. The problem I'm having is producing the stats page for the logs. The command I've boiled it down to is /usr/share/awstats/tools/awstats_buildstaticpages.pl -configdir=/home/User/Documents/conf/ -config=example.com awstatsprog=/usr/share/awstats/wwwroot/cgi-bin/awstats.pl dir=/home/User/Documents/parced -month=all -year=all...
Post a Comment
Read more