Tag Archives: vmware

VMworld Europe 2019-Day 1 Keynote Highlights

VMworld Europe is happening in Barcelona this week, and today saw the annual Tuesday keynote start the morning off. I’m not amongst the 14,000 attendees from 111 countries at the event this year, so I’m recapping the highlights from the comfort of the sofa thanks to the online broadcast.

PG-Welcome-VMworld2019As has become normal for this European keynote, Jean-Paul Brulard (Senior VP and GM for VMware EMEA) welcomed the audience and introduced CEO Pat Gelsinger to deliver the core of the session. Pat focused on how digital technology has permeated all areas of our life and looked into the future to see how technologies such as AI and 5G will continue to accelerate this development.

VMware’s vision of Any Device, Any Application, and Any Cloud continues to be refined year on year- and the show looked at how VMware works to help provide consistence to the technologists trying to master the breadth of applications, clouds,  and devices in the modern world.

The product features started with Joe Beda being brought onstage to talk Kubernetes. VMware’s new Tanzu portfolio of products is designed to help build, run, and manage Kubernetes in the enterprise and is sold as a product to help both developers and IT. This section included the announcement of the betas of  Project Galleon which takes the Bitnami catalogue to the enterprise and Project Pacific which is vSphere rearchitected with Kubernetes at it’s core. VMware’s Tanzu Mission Control product which helps manage Kubernetes deployments on any platform has reached Private Beta.

image

In the hybrid cloud arena, VMware Cloud Director Service has been introduced to allow the 4000 VMware Cloud Provider Partners (VCPP) to provision the infrastructure from the hyperscale clouds to their customers. This is available on AWS and IBM clouds today and expected in Azure by the end of the year.

The VMware on AWS platform is continuing to be developed- now available in 4 times the number of regions that it was a year ago, and the Outposts product getting closer to being delivered which will open up AWS zones in customer datacentres. When Tanzu ships next year it will be also feature on the VMWonAWS platform.

rJr0l480_400x400Microsoft also got a mention, VMware are partnering there to provide the HCX migration tools on Azure, and integrating Workspace One with Microsoft Endpoint Manager. Azure SQL 2019 on VMware vSphere is an interesting concept- providing the public cloud database service but on-premises.

Staying on-prem, the private cloud is covered with VMware Cloud on Dell EMC is now available – this couples VMware Cloud Foundation with Dell’s VXRail hardware to provide Datacentre-as-a-Service.

NSX, the “secret sauce” of previous VMworld keynotes, continues to develop- the acquisition of AVI Networks providing load balance capabilities and software-defined intrusion detection to bring features only seen within the datacentre in special purpose devices or next-gen firewalls right down into the hypervisor and adjacent to the applications.

Sanjay Poonen (COO) interspersed customer chats in amongst the presentation and towards the end took centre stage to discuss VMware’s security stance.  Their strategy is to provide proactive security whilst tying the network security, endpoint security, cloud security, identity, and analytics together. The Carbon Black acquisition closed between the US and Europe events and this technology will be layered into vSphere, Workspace One, and NSX, providing agentless antivirus protection and threat detection.

There’s a wide range of announcements here- and whilst a lot of the content is similar to the US event back in August, albeit further along the roadmap- it sets up for a good week in Barcelona. You can tune in to the full keynote (1 hour 48 minutes) on Youtube.

246520-vmworld2019-contentcatalog-eu-blank-1600x250

Improving Documentation via the Community.

Have you ever had to deal with incorrect documentation? Or been frustrated by a typo? Or been annoyed that a how-to guide uses an old version of an interface?

Now you can fix it!

Many software providers are now using community-editable documentation online. This isn’t a Wikipedia style free-for-all, but a carefully moderated process ensuring that the resulting document is accurate.  If you come across an error in an online doc, or even a PowerShell help page, check and see if you can submit edits.

Continuous deployment pipelines mean that these edits can make it into live documentation in a matter of hours or days- impressive times if you’ve ever submitted an errata to a printed book, or submitted a bug request to get online documentation fixed.

docs.Microsoft.com

If you visit a Microsoft docs page, you’ll see an Edit link at the top of the screen (see (1) in the screenshot below). Clicking on this takes you to a page on Github with the source of the document. Click there to edit the file and a git fork will be made under your own profile- make your edits and submit a merge request and, once approved, your updates will appear in the original website. You’ll even get a little credit (see (2) in the screenshot below) for your contribution.

image

In this particular example I was following the step-by-step guide and noticed that the wording in the document no longer matched the Azure Portal. I was quickly able to suggest a fix and later that day the page was updated and anyone else following the instructions wouldn’t be misled. Two minutes of my time hopefully saved ten minutes of head-scratching by someone else.

VMware PowerCLI Example Scripts

As the name suggests, the source code for some example PowerCLI scripts has been published by VMware supported by members of the #vCommunity. If you find an error in the scripts you can pop over to Github and correct them- and remember this isn’t just the code of the script, but also it’s accompanying documentation.

image

In this example a typo in the get-help file was spotted and quickly corrected. Whilst the spelling mistake wasn’t a show-stopper this shows how quick and easy it is to contribute to these projects without being a coding guru.

Summary

Many of these projects use Github and learning how to use that version control platform isn’t arduous- especially for small changes like these- and is a useful skill to pickup if you don’t already have it. The important message here is you don’t need to be a developer to contribute to the code.

So, next time you spot a mistake in documentation, see if you can fix it yourself and help the next person who comes along.

vSAN Cluster Shutdown

A few weeks ago I had to shutdown a vSAN Cluster temporarily for a planned site-wide 24 hour power outage that was blacking out a datacentre. With the amount of warning and a multi-datacentre design this wasn’t an issue, but I made use of vSphere tags and some Powershell/PowerCLI to help with the evacuation and repopulation of the affected cluster. Hopefully some of this may be useful to others.

The infrastructure has two vSAN Clusters – Cluster-Alpha and Cluster-Beta. Cluster-Beta was the one being affected by the power outage, and there was sufficient space on Cluster-Alpha to absorb migrated workloads. Whilst they exist in different datacentres both clusters are on the same LAN and under the same vCenter.

I divided the VMs on Cluster-Beta into three categories:

  1. Powered-Off VMs and Templates. These were to stay in place, they would be inaccessible for the outage but I determined this wouldn’t present any issues.
  2. VMs which needed to migrate and stay on. These were tagged with the vSphere tag “July2019Migrate”
  3. VMs which needed to be powered off but not migrated. For example test/dev boxes which were not required for the duration. These were tagged with “July2019NOMigrate”

The tagging was important, not only to make sure I knew what was migrating and what was staying, but also what we needed to move back or power on once the electrical work had completed. PowerCLI was used to check that all powered-on VMs in Cluster-Beta were tagged one way or another.

Get the VMs in CLuster-Beta where the tag “July2019Migrate” is not assigned and the tag “July 2019NOMigrate” is not assigned and the VM is Powered On.

Get-Cluster -Name "Cluster-Beta" |Get-VM | where {
 (Get-TagAssignment -Entity $_).Tag.Name –notcontains "July2019Migrate" –and
 (Get-TagAssignment -Entity $_).Tag.Name –notcontains "July2019NOMigrate" –and
 $_.PowerState –eq “PoweredOn”}

In the week approaching the shutdown the migration was kicked off:

#Create a List of the VMs in the Source Cluster which are tagged to migrate
$MyTag= Get-Tag -Name "July2019Migrate"
$MyVMs=Get-Cluster "Cluster-Beta" | Get-VM | Where-Object {(Get-TagAssignment -Entity $_).Tags -contains $MyTag }
#Do the Migration
$TargetCluster= "Cluster-Alpha" #Target Cluster
$TargetDatastore= "vSANDatastore-Alpha" #Target Datastore on Target Cluster
$MyVMs | Move-VM -Destination (Get-Cluster -Name $TargetCluster) -Datastore (Get-Datastore -Name $TargetDatastore) -DiskStorageFormat Thin -VMotionPriority High

At shutdown time, a quick final check of the remaining powered on VMs was done and then all remaining VMs in Cluster-Beta were shut down. Once there were no running workloads on Beta it was time to shut down the vSAN cluster. This part I didn’t automate as I’m not planning on doing it a lot, and there’s comprehensive documentation in the VMware Docs site. The process is basically one of putting all the hosts into maintenance mode and then once the whole cluster is done, powering them off.

You are in a dark, quiet datacentre. There are many servers, all alike. There may be Grues here.

When power was restored, the process was largely reversed. I powered on the switches providing the network interconnect between the nodes, and then powered on those vSAN hosts and waited for them to come up. Once all the hosts were visible to vCenter, it was just a case of selecting them all and choosing “Exit Maintenance Mode”

2019-07-29 (8)

There was a momentary flash of alerts as nodes come up and wonder where their friends are, but in under a minute the cluster was passing the vSAN Health Check

image

At this point it was all ready to power on the VMs that had been shutdown and left on the cluster, and vMotion the migrated virtual machines back across. Again, PowerCLI simplified this process:

#Create a List of the VMs in the Source Cluster which are tagged to stay but need powering on.
$MyTag= Get-Tag -Name "July2019NOMigrate"
$MyVMs=Get-Cluster “Cluster-Alpha” | Get-VM | Where-Object {(Get-TagAssignment -Entity $_).Tags -contains $MyTag }
#Power on those VMs
$MyVMs | Start-VM

#Create a List of the VMs in the Source Cluster which are tagged to migrate (back)
$MyTag= Get-Tag -Name "July2019Migrate"
$MyVMs=Get-Cluster “Cluster-Alpha” | Get-VM | Where-Object {(Get-TagAssignment -Entity $_).Tags -contains $MyTag }
#Do the Migration
$TargetCluster= "Cluster-Beta" #New Target Cluster
$TargetDatastore= "vSANDatastore-Beta" #Target Datastore on Target Cluster
$MyVMs | Move-VM -Destination (Get-Cluster -Name $TargetCluster) -Datastore (Get-Datastore -Name $TargetDatastore) -DiskStorageFormat Thin -VMotionPriority High

Then it was just a case of waiting for the data to flow across the network and finally check that everything had migrated successfully and normality had been restored.

we have normality, I repeat we have normality…Anything you still can’t cope with is therefore your own problem. Please relax.

Trillian, via the keyboard of Douglas Adams. The Hitchhiker’s Guide to the Galaxy

Hyper-Converged Cynicism

Or “How I’ve come to love my vSAN Ready Nodes”

I’ll admit it, some years ago I was very cynical about HyperConverged Infrastructure (HCI). Outside of VDI workloads I couldn’t see how it would fit in my environment – and this was all down to the scaling model.

With the building-block architecture of HCI; storage, compute, and memory are all expanded in a linear fashion. Adding an extra host to the cluster to expand the storage capacity also increases the available memory and CPU in the pool of resources. But my workloads were varied, one day we might get a new storage-intensive application, the next week it might be one which is memory intensive. I was used to independently expanding the storage through a SAN and just the compute/memory side through the servers and didn’t want to be either running up against a capacity wall or purchasing unnecessary compute just to cater for storage demands.

This opinion changed when my own HCI journey started in 2017 with the purchase of a VMware vSAN cluster built on Dell Ready Nodes. Whist I’ll be writing about that particular technology here, the principles apply to other HCI infrastructures.



If the problem of HCI could is scaling, the solution is scale. These imbalances in load and growth balance out once a number of VMs are on the system- and this scale doesn’t have to be massive, even from the 4-host starting point of a vSAN cluster I found that when the time came to install node 5, the demands on storage and memory were roughly matched to the relevant capacities of the new node.

The original hosts need to be sized correctly, but unless you’re starting in a totally greenfield environment then you will have existing hosts and storage to interrogate and establish a baseline on current usage requirements. Use these figures, allow appropriate headroom for growth, and then add a bit more (particularly when considering the storage) to prevent the new infrastructure from running near capacity. Remember you are trading a certain level of efficiency for resilience – the cluster needs to be able to withstand at least one host loss and still have plenty of capacity for manoeuvre.

If you are going down the vSAN route, I can thoroughly recommend the ReadyNode option. Knowing that hardware will arrive and just work with the software-defined storage layer without spending hours digging in the Hardware Compatibility Lists was a great time saver, and we’re confident that we can turn round to our vendors and say “this didn’t work” without getting told “it’s because you’ve got disk controller chipset X and that’s not compatible with driver Y on version Z”. There’s a reason I named this blog “IT Should Just Work”.DellEMC vSAN ReadyNode

When expanding the cluster I consider best practice to be to expand with hosts of as similar configuration as possible to the original. If larger nodes are added (for example, storage/memory/CPU is now cheaper/bigger/faster) then these can create a performance imbalance in the cluster. For example a process running on host A might get access to a 2.2GHz CPU, but run the same process on host B with a 3GHz CPU and it will finish slower. Also worth considering is what happens when a host fails, or is taken into maintenance mode for patching. If this host is larger than it’s compatriots then (without very careful planning and capacity management) there might not be sufficient capacity on the remaining hosts to keep the workloads running smoothly.

It is possible in vSAN to add “storage-only” nodes, reducing the memory and possibly going single-socket (this saves on your license cost too!) and then using DRS rules to keep VMs off the host. Likewise “compute-only” nodes are possible, where the host doesn’t contribute any storage to the cluster. Whilst there are probably specific use-cases for both these types of nodes, the vast majority of the time I believe them to be best avoided. Without very careful consideration of workloads and operational practices these could easily land you in hot water.

So, I’m a convert. Two years down the line here and HCI is the on-premises infrastructure I’d recommend to anyone who asks. And those clouds gathering on the horizon? Well, if you migrate to VMware Cloud on AWS then you’re going to be running vSAN HCI there too!

VMworld 2018 Banner

Wear Comfortable Shoes

Ladies and Gentlemen of VMworld 2019.

Wear comfortable shoes.

If I could offer you only one tip for the conference, comfy shoes would be it.
The long term benefits of comfortable shoes have been proved by scientists, whereas the rest of my advice has no basis more reliable than my own meandering experience…
I will dispense this advice now.

Enjoy the knowledge and learning imparted at the breakout sessions; oh nevermind; you will not understand all the knowledge and learning imparted until you watch the recordings.
But trust me, in 20 years you’ll look back at your notes from the event and recall in a way you can’t grasp now how much technology lay before you and how fabulous that UI really looked…
You can’t fit in as many parties as you imagine.

Do one thing everyday that scares you.

Present a session.

Don’t ignore other people’s opinions, don’t put up with people who ignore yours.

Talk to people.

Don’t waste your time on free pens;
Sometimes there’s T-shirts,
Sometimes there’s LEGO.
The swag list is long, and in the end, it’s only what fits in your suitcase home that counts.

Drink plenty of water.

Maybe you’ll do the Hackathon, maybe you won’t, maybe you’ll watch a vBrownbag, maybe you won’t, maybe you’ll get an early night, maybe you’ll dance the funky chicken at the VMworld party.
Whatever you do, don’t worry too much when someone says on-premise.
Enjoy your time at the conference, Use it every way you can… Don’t be afraid of doing new things, or what other people think of them,
Spending time wisely is the greatest investment you’ll ever make…

Use that Early Bird pricing, you’ll miss it when it’s gone.

Be nice to your peers in the vCommunity; They are the best way to learn and the people most likely to stick with you in the future

Stretch.

Go to VMworld US once, but leave before it makes you hard;
Go to VMworld EU once, but leave before it makes you soft.

Accept certain inalienable truths, vBeards will grow and turn grey, vendors will talk FUD, you too will get tired, and when you do you’ll fantasise that when you were younger vChins were clean-shaven, vendors were noble, and the flash client was the best thing since sliced bread.

But trust me on the comfortable shoes…