Troubleshooting NSX Host Preparation Error “Agency Already Exist For Cluster”

Yesterday while setting up my lab for NSX-V deployment, I encountered an issue with host preparation and it failed with error “Agency 3d62d2da-5e93-4f57-a87c-063a7af3be28 already exist for cluster Mgmt-Cluster. Delete this agency from EAM database


I past I had NSX-V configured in my cluster and sometimes back I uninstalled NSX-V components and was playing with NSX-T and later uninstalled NSX-T as well. I guess the uninstall was not clean and left behind lingering item in EAM database. Read More

Deleting Workload Domain in VMware Cloud Foundation

In last post of this series, we learnt how to deploy a workload domain via SDDC Manager. In this post we will learn how to delete it. 

If you are not following along this series, then I recommend reading earlier posts of this series from below links:

1: Physical/Virtual Infra Preparation

2: DNS and IP Pools Requirements for vCF 

3: Nested Esxi Host Deployment & Configuration

4: Deploying Management Domain aka SDDC Bringup

5: Workload Domain Deployment

To delete a workload domain, login to SDDC Manager and navigate to Inventory > Workload Domains and from Action menu select “Delete Domain Read More

Building a VMware Cloud Foundation Lab: Part 5 – VI Workload Domain Deployment

In last post of this series we learnt the process of SDDC bringup aka Management Domain deployment. Also we verified we are able to login to SDDC manager. The management domain is integrated in SDDC manager by default during bringup process.

In this post I will walk through steps of deploying a Virtual Infrastructure Workload Domain. If you are new to vCF and wondering what a workload domain is, then in simpler words its resource cluster where end users will provision their vm’s.

If you are not following along this series, then I recommend reading earlier posts of this series from below links: Read More

Building a VMware Cloud Foundation Lab: Part 4 – SDDC Bringup

This is probably the most important post of this series. In this post we will learn how to bring up the SDDC i.e the Management Domain deployment.

Before we start the process we need to have the vCF 3.7.x cloud builder ova handy which can be downloaded from here

Cloud Builder deployment is pretty much straight forward.  Not covering the steps of deployment as nothing fancy there. Once the cloud builder vm boots up, open console of the vm to fetch the URL to access UI.


Download and Complete Deployment Parameter Sheet Read More

Building a VMware Cloud Foundation Lab: Part 3 – Esxi Host Deployment & Configuration

In last Post of this series, I talked about the DNS records and IP Pools that should be in place for a successful vCF deployment.

In this post I will walk through steps needed to create nested Esxi and post installation steps.

Before we plan to create nested Esxi hosts or physical, we need to identify the build/version of Esxi and other components that are compatible with a given vCF version. VMware KB-52520 help you identify this.

For vCF 3.7 please refer to below table for build number needed.  Read More

Building a VMware Cloud Foundation Lab: Part 2 – DNS and IP Pools

When you are planning for a vCF deployment, you need lot and lot of IP’s and DNS records. 

In my environment I have an AD integrated DNS running on MS 2012 R2.

If you are only planning on deploying the Management Workload Domain in your environment you only need to create the forward and reverse lookup records for Management Workload Domain. If Virtual Infrastructure Workload Domain will be introduced in future then you need to plan the DNS records accordingly.

Note: Please see this article for comprehensive list of DNS requirement for vCF deployment. Read More

Building a VMware Cloud Foundation Lab: Part 1 – Infra Preparation

Recently I got chance to do a nested vCF 3.5/3.7 deployment in my lab and it was a great learning. Few friends of mine reached out to me to know more about VMware Cloud Foundation product as a whole and how we can get our hands dirty on it. 

Through this series of articles, I want to share my experience with you on how to do a successful vCF 3.7 deployment in a nested environment.  

What is VMware Cloud Foundation (vCF)?

As per VMware official documentation

VMware Cloud Foundation is an integrated software stack that bundles compute virtualization (VMware vSphere), storage virtualization (VMware vSAN), network virtualization (VMware NSX), and cloud management and monitoring (VMware vRealize Suite) into a single platform that can be deployed on premises as a private cloud or run as a service within a public cloud. Read More

NSX Guest Introspection: Components & Configuration

What is NSX Guest  Introspection ?

VMware NSX Guest Introspection is a security feature which when enabled, offloads antivirus and anti-malware agent processing to a dedicated virtual appliance (service vm’s). 

When Guest Introspection is enabled on a cluster, it continuously update antivirus signatures, thus giving uninterrupted protection to the virtual machines running in that cluster. New virtual machines that are created (or existing virtual machines that went offline) are immediately protected with the most current antivirus signatures when they come online. Read More

Deleting Stubborn Interconnect Configuration in HCX

I had a working HCX setup in my lab and I was doing some modification in my setup and tried chopping off my interconnect networking configuration in HCX Cloud side. Deletion of interconnect configuration was failing for me with below error

hcx-pool-delete error.JPG

Let me first explain how I landed in this situation. 

I was deleting the interconnect appliances from my on-prem to show demo to my peers on how the interconnects are deployed via HCX plugin in vSphere webclient. During the demo I did not noticed that site pairing between my on-prem HCX and cloud side HCX was broken (due to vCenter upgrade in cloud side, cert mismatch issue occurred). Read More

Creating HCX Multi Site Service-Mesh for Hybrid Mobility

This is in continuation with my last post where I discussed about what is service mesh feature of HCX and how it works. In this post we will learn how to create service mesh.

As we discussed earlier that we need to have compute/network profiles created on both on-prem and cloud side.

The compute profile describes the infrastructure at the source and destination site and provides the placement details (Resource Pool, Datastore) where the virtual appliances should be placed during deployment and the networks to which they should connect. Read More

What is HCX Multi-Site Services Mesh

Recently I upgraded HCX appliances in my lab and saw a new tab named “Multi Site Services Mesh” appearing in both cloud side and enterprise side UI and was curious to know about this new feature.

What is HCX Multi Site Services Mesh?

As we know that in order to start consuming HCX, we need to have the interconnect appliances (CGW, L2C and WAN Opt) deployed in both on-prem and cloud side. Before starting the deployment of appliances, we should have the Interconnect configuration already in place in cloud side. Read More

Managing HCX Migration via Powershell

HCX supports 3 methods for migrating VM’s to cloud:

  • Cold Migration
  • HCX Cross-Cloud vMotion
  • HCX Bulk Migration

To know more about these migration methods, please read this post  to know more about the migration methods. 

HCX migrations can be scheduled from the HCX UI using the vSphere Client or can be automated using the HCX API. In last post of this series, I demonstrated few PowerCli commands that we can use for HCX system. 

API/PowerCli is obvious choice when you think of automation. Using automation do not only help in reducing the amount of user input required in UI but reduces the chances of human errors as well. Read More

Getting Started With HCX PowerCli Module

With the release of PowerCli 11.2, support for many new VMware products was introduced and VMware HCX is one such product. PowerCli module name for HCX is “VMware.VimAutomation.HCX” and it currently have 20 cmdlets to manage HCX.

You can use windows power shell to install/upgrade your PowerCli to v11.2 using below commands:

1: Once the necessary module is installed, we can use the Get-Command to examine the cmdlets that are available for HCX.

Get-Command -Module VMware.VimAutomation.HCX Read More

Exploring HCX API

VMware Hybrid Cloud Extension is a powerful product for datacenter migration/replacement (On-Prem or from On-Prem to Cloud) and disaster recovery.  VMware HCX supports 3 major cloud at the moment namely VMware Cloud on AWS, OVH Cloud and IBM Cloud.

Although HCX interface for workload migration is very simple and even the first times can migrate workloads without much difficulty, but it is always good to know about the API offering of any product so that you can automate stuffs via scripting.

HCX API allows customers to automate all aspects of HCX including the HCX VAMI UI for initial configuration as well as consuming the HCX services which are exposed in the vSphere UI. Read More

Upgrading Clustered vRLI Deployment

In this post I will walk through steps of upgrading a clustered vRLI deployment. Before preparing for upgrade, make sure to read VMware documentation for the supported upgrade path.

One very important consideration before you start upgrading vRLI:

Upgrading vRealize Log Insight must be done from the master node’s FQDN. Upgrading using the Integrated Load Balancer IP address is not supported.

To start vRLI upgrade, login to the web interface of master node and navigate to Administration > Cluster and click on Upgrade Cluster button. Read More