Category Archives: vSAN

VMware Virtual SAN

Screen Shot 2017-07-25 at 4.58.25 PM

vSAN 6.6 All Flash on OVH Private Cloud

Recently had the opportunity to set up an all flash vSAN on OVH BMaaS to facilitate a Customer NSX POC. Took the chance to run some vSAN throughput test.

This is the server built that we got from OVH. We selected the Mini-HG and configure it with 3 SSD. Its physical locally in the OVH BHS (Canada) DC.

Screen Shot 2017-07-25 at 5.05.15 PM

 

This was the service we selected. Basically, I used the vRACK service and put vSAN traffic on the 2nd NIC ie. the private NIC. But anyway, that would be another blog post to write all the deployment details.

Test was ran on a Windows Server 2012R2 Machine, 2 vCPU, 4GB of RAM using AS SSD Benchmark.

Screen Shot 2017-07-25 at 11.59.11 AMScreen Shot 2017-07-25 at 11.59.29 AM

Some details of the vSAN Cluster.

Screen Shot 2017-07-25 at 4.37.50 PM

 

Screen Shot 2017-07-25 at 4.42.43 PM

Screen Shot 2017-07-25 at 4.42.31 PM

Screen Shot 2017-07-25 at 4.42.56 PM

Host details .. Basically all 3 hosts are the same specifications.

Screen Shot 2017-07-25 at 4.36.55 PM

 

Look at the Controllers and Disk.

Screen Shot 2017-07-25 at 4.48.53 PM

Screen Shot 2017-07-25 at 4.49.18 PM

 

Some vSAN Monitoring

Screen Shot 2017-07-25 at 4.45.45 PM

Screen Shot 2017-07-25 at 4.45.21 PM

Screen Shot 2017-07-25 at 4.46.15 PM

 

 

vSAN 6.5 Lab1

vSAN 6.5 ROBO All Flash – 2-node Direct Connect Testing

vSAN 6.5 ROBO All Flash – 2-node Direct Connect Testing

Screen Shot 2017-01-18 at 12.05.30 PM

vSAN 6.5 now supports using a low cost Cat6 or SFP+ TwinAX cables for cross-connect the 2 hosts. I had setup the lab to perform this ROBO setup. vSAN 6.5 also supports iSCSI which I plan to test it as well.

vSAN 6.5 Lab1

 

I plan to install vCenter 6.5 on these two nodes as well and therefore need to bootstrap the installation. I follow the instruction from William Lam blog – How to bootstrap vCenter Server onto a single VSAN node Part 1.

I did not want to go through the click through installation and therefore follow again his blog to install the vCenter using ovftool CLI method.

Had some issues with using the ovftool at the moment. Will have to update this blog again.

25 June 2017 Update

Finally got some time to perform some testing. I have been using these nodes to run nested ESXi for NSX Multi-site Lab. They are configured as individual standalone vSAN. Here are the specs to the boxes.

Supermicro E300 – SYS-E300-8D
Intel Xeon CPU D-1518 @ 2.2Ghz (4 cores per socket)
64GB of RAM
Cache: Sandisk SDSSDA240G 240GB
Capacity:  Samsung SSD 850 Evo M.2 1TB
2 x 1GE : Intel I210
4 x 1GE: Intel I350
2 x 10GE : Intel X552

ESXi 6.5 Build 4564106

Screen Shot 2017-06-25 at 5.55.51 PM Screen Shot 2017-06-25 at 5.58.28 PM

Screen Shot 2017-06-25 at 6.04.37 PM

Screen Shot 2017-06-25 at 6.04.52 PM

Some performance testing…

Screen Shot 2017-06-25 at 5.50.24 PMScreen Shot 2017-06-25 at 5.51.20 PM

 

 

 

VSAN Hybrid vs All-Flash Stretched Cluster Testing

This post reorganize the results from the previous two posts to show comparison between Hybrid and All-Flash VSAN.

Preferred Site – Hybrid vs All-Flash (10Gbps Network) – MB/s10Gbps Hybrid VSAN - Preferred Site - Mbps10Gbps All-Flash VSAN - Preferred Site - MBps

Preferred Site – Hybrid vs All-Flash (10Gbps Network) – IOPS
10Gbps Hybrid VSAN - Preferred Site - IOPS10Gbps All-Flash VSAN - Preferred Site - IOPS

Secondary Site – Hybrid vs All-Flash (10Gbps Network) – MB/s
10Gbps Hybrid VSAN - Secondary Site - Mbps10Gbps All-Flash VSAN - Secondary Site - MBps

Secondary Site – Hybrid vs All-Flash (10Gbps Network) – IOPS
10Gbps Hybrid VSAN - Secondary Site - IOPS10Gbps All-Flash VSAN - Secondary Site - IOPS

Conclusion:
In an All-Flash VSAN setup, the write speed perform better, be it the testing VM on the preferred or secondary site. The difference is about 3X.
The read latency is also much lesser in an All-Flash VSAN setup in both sites.

*The remarks in the AS SSD Benchmark tool are not accurate for the Hybrid VSAN as I did not change the description when the tool was running on the Secondary Site.

VSAN All-Flash Stretched Cluster Testing – 1Gbps vs 10Gbps Network

Both hosts disk group consists of
1) Flash Tier: 240GB SSD
2) Capacity Tier: 1TB Samsung 850EVO SSD

Testing VM running on the following sites:

Preferred Site – 1Gbps vs 10Gbps (MB/s)
1Gbps All-Flash VSAN - Preferred Site - MBps10Gbps All-Flash VSAN - Preferred Site - MBps

Preferred Site – 1Gbps vs 10Gbps (IOPS)
1Gbps All-Flash VSAN - Preferred Site - IOPS10Gbps All-Flash VSAN - Preferred Site - IOPS

Secondary Site – 1Gbps vs 10Gbps (MB/s)
1Gbps All-Flash VSAN - Secondary Site - MBps10Gbps All-Flash VSAN - Secondary Site - MBps

Secondary Site – 1Gbps vs 10Gbps (IOPS)
1Gbps All-Flash VSAN - Secondary Site - IOPS10Gbps All-Flash VSAN - Secondary Site - IOPS

Conclusion
In an All-Flash VSAN environment, 1Gbps network is clearly being the bottleneck. With the 10Gbps network, I could observe average about 5X improvements in terms of transfer rates and IOPS.

VSAN Hybrid Stretched Cluster Testing – 1Gbps vs 10Gbps Network

Both hosts disk group consists of
1) Flash Tier: 240GB SSD
2) Capacity Tier: 500GB 7200RPM SATA Drive

Testing VM running on the following sites:

Preferred Site – 1Gbps vs 10Gbps (MB/s)
1Gbps Hybrid VSAN - Preferred Site - Mbps10Gbps Hybrid VSAN - Preferred Site - Mbps

 

Preferred Site – 1Gbps vs 10Gbps (IOPS)
1Gbps Hybrid VSAN - Preferred Site - IOPS10Gbps Hybrid VSAN - Preferred Site - IOPS

Secondary Site – 1Gbps vs 10Gbps (MB/s)
1Gbps Hybrid VSAN - Secondary Site - Mbps10Gbps Hybrid VSAN - Secondary Site - Mbps

Secondary Site – 1Gbps vs 10Gbps (IOPS)
1Gbps Hybrid VSAN - Secondary Site - IOPS1Gbps Hybrid VSAN - Secondary Site - IOPS

*The remarks in the AS SSD Benchmark tool are not accurate for the Hybrid VSAN as I did not change the description when the tool was running on the Secondary Site.

How to recover unmounted disks in VSAN?

With VSAN6.1, Virtual SAN monitors solid state drive and magnetic disk drive health and proactively isolates unhealthy devices by unmounting them. This has happen to my home lab and wish to share how I recover the unmounted disks.

You can read more about this feature on http://cormachogan.com/2015/09/22/vsan-6-1-new-feature-problematic-disk-handling/

VSAN_unmounted_disks

As you can see, the disks in one of my hosts are unmounted. I have tried to find a menu so I can remount the disks but could not find one. Put the hosts into maintenance mode and restart the hosts also did not recover the unmounted disks.

I have to erase the partitions (both HDD and Flash) for that host, claim the disks again before I could observe the disks are mounted correctly again.

VSAN_unmounted_disks_delete_partitions