10GE Testing – Multi-NIC vMotion

Had access to some 10GE NICs and therefore decided to do some performance testing and try out Multi-NIC vMotion.

Intel X520-DA2

The 10GE NICs were Intel X520-DA2 and I used SFP-H10GB-CU3M to connect directly to both hosts as I do not access to a 10GE switch at the moment.

Without reading any documentation, I tried add both 10GE ports into a vSwitch and vMotion does not work. After googling and reading the documentation, we actually have to separate the 10GE ports into their own vSwitches before the Multi-NIC vMotion will work.

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2007467

Single-NIC 10GE vMotion Configuration
multi-nic-vmotion-1nic-host1multi-nic-vmotion-1nic-host2

Single-NIC 10GE vMotion Tests
Test 1: 14 seconds
Test 2: 14 seconds
Test 3: 10 seconds
Test 4: 11 seconds
multi-nic-vmotion-1nic-vmotiontest1multi-nic-vmotion-1nic-vmotiontest2multi-nic-vmotion-1nic-vmotiontest3multi-nic-vmotion-1nic-vmotiontest4

Single-NIC 10GE vMotion Network Performance Graphs
multi-nic-vmotion-1nic-host1-network-graphmulti-nic-vmotion-1nic-host2-network-graph 

 

Multi-NIC 2X10GE vMotion Configuration
multi-nic-vmotion-2nic-host1multi-nic-vmotion-2nic-host2

Multi-NIC 2X10GE vMotion Tests
Test 1: 10 seconds
Test 2: 12 seconds
Test 3: 09 seconds
Test 4: 12 seconds
multi-nic-vmotion-2nic-vmotiontest1 multi-nic-vmotion-2nic-vmotiontest2multi-nic-vmotion-2nic-vmotiontest3multi-nic-vmotion-2nic-vmotiontest4

Multi-NIC 2X10GE vMotion Network Performance Graphs
multi-nic-vmotion-2nic-host1-network-graphmulti-nic-vmotion-2nic-host2-network-graph


Conclusion:
Although with Multi-NIC, vMotion seems to perform faster as compare to Single-NIC, however, the difference is not significant. This is probably due to the size and the number of VMs I used for the vMotion tests.

It was noticed that there was load sharing of vMotion traffic between the 2 10GE ports as you can see from the network performance graphs. Using single-NIC, network usage is about 200MBps while multi-NIC scenario, network usage is about 100MBps per NIC which is 50% of that single-NIC.

Be Sociable, Share!

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>