PowerShell Script to Deploy Multiple VM on Azure in Parallel #azure #powershell

Posted by Marco Russo (SQLBI) on SQL Blog See other posts from SQL Blog or by Marco Russo (SQLBI)
Published on Tue, 29 Oct 2013 11:44:00 GMT Indexed on 2013/10/29 16:06 UTC
Read the original article Hit count: 1294

Filed under:
|

This blog is usually dedicated to Business Intelligence and SQL Server, but I didn’t found easily on the web simple PowerShell scripts to help me deploying a number of virtual machines on Azure that I use for testing and development. Since I need to deploy, start, stop and remove many virtual machines created from a common image I created (you know, Tabular is not part of the standard images provided by Microsoft…), I wanted to minimize the time required to execute every operation from my Windows Azure PowerShell console (but I suggest you using Windows PowerShell ISE), so I also wanted to fire the commands as soon as possible in parallel, without losing the result in the console.

In order to execute multiple commands in parallel, I used the Start-Job cmdlet, and using Get-Job and Receive-Job I wait for job completion and display the messages generated during background command execution. This technique allows me to reduce execution time when I have to deploy, start, stop or remove virtual machines. Please note that a few operations on Azure acquire an exclusive lock and cannot be really executed in parallel, but only one part of their execution time is subject to this lock. Thus, you obtain a better response time also in these scenarios (this is the case of the provisioning of a new VM).

Finally, when you remove the VMs you still have the disk containing the virtual machine to remove. This cannot be done just after the VM removal, because you have to wait that the removal operation is completed on Azure. So I wrote a script that you have to run a few minutes after VMs removal and delete disks (and VHD) no longer related to a VM. I just check that the disk were associated to the original image name used to provision the VMs (so I don’t remove other disks deployed by other batches that I might want to preserve).

These examples are specific for my scenario, if you need more complex configurations you have to change and adapt the code. But if your need is to create multiple instances of the same VM running in a workgroup, these scripts should be good enough.

I prepared the following PowerShell scripts:

  • ProvisionVMs: Provision many VMs in parallel starting from the same image. It creates one service for each VM.
  • RemoveVMs: Remove all the VMs in parallel – it also remove the service created for the VM
  • StartVMs: Starts all the VMs in parallel
  • StopVMs: Stops all the VMs in parallel
  • RemoveOrphanDisks: Remove all the disks no longer used by any VMs. Run this script a few minutes after RemoveVMs script.

ProvisionVMs

# Name of subscription

$SubscriptionName = "Copy the SubscriptionName property you get from Get-AzureSubscription"

 

# Name of storage account (where VMs will be deployed)

$StorageAccount = "Copy the Label property you get from Get-AzureStorageAccount"

 

function ProvisionVM( [string]$VmName ) {

    Start-Job -ArgumentList $VmName {

        param($VmName)

$Location = "Copy the Location property you get from Get-AzureStorageAccount"

$InstanceSize = "A5" # You can use any other instance, such as Large, A6, and so on

$AdminUsername = "UserName" # Write the name of the administrator account in the new VM

$Password = "Password"      # Write the password of the administrator account in the new VM

$Image = "Copy the ImageName property you get from Get-AzureVMImage"

# You can list your own images using the following command:

# Get-AzureVMImage | Where-Object {$_.PublisherName -eq "User" }

        New-AzureVMConfig -Name $VmName -ImageName $Image -InstanceSize $InstanceSize |

            Add-AzureProvisioningConfig -Windows -Password $Password -AdminUsername $AdminUsername|

            New-AzureVM -Location $Location -ServiceName "$VmName" -Verbose

    }

}

 

# Set the proper storage - you might remove this line if you have only one storage in the subscription

Set-AzureSubscription -SubscriptionName $SubscriptionName -CurrentStorageAccount $StorageAccount

 

# Select the subscription - this line is fundamental if you have access to multiple subscription

# You might remove this line if you have only one subscription

Select-AzureSubscription -SubscriptionName $SubscriptionName

 

# Every line in the following list provisions one VM using the name specified in the argument

# You can change the number of lines - use a unique name for every VM - don't reuse names

# already used in other VMs already deployed

ProvisionVM "test10"

ProvisionVM "test11"

ProvisionVM "test12"

ProvisionVM "test13"

ProvisionVM "test14"

ProvisionVM "test15"

ProvisionVM "test16"

ProvisionVM "test17"

ProvisionVM "test18"

ProvisionVM "test19"

ProvisionVM "test20"

 

# Wait for all to complete

While (Get-Job -State "Running") {

    Get-Job -State "Completed" | Receive-Job

    Start-Sleep 1

}

 

# Display output from all jobs

Get-Job | Receive-Job

 

# Cleanup of jobs

Remove-Job *

 

# Displays batch completed

echo "Provisioning VM Completed"

RemoveVMs

# Name of subscription

$SubscriptionName = "Copy the SubscriptionName property you get from Get-AzureSubscription"

 

function RemoveVM( [string]$VmName ) {

    Start-Job -ArgumentList $VmName {

        param($VmName)

        Remove-AzureService -ServiceName $VmName -Force -Verbose

    }

}

 

# Select the subscription - this line is fundamental if you have access to multiple subscription

# You might remove this line if you have only one subscription

Select-AzureSubscription -SubscriptionName $SubscriptionName

 

# Every line in the following list remove one VM using the name specified in the argument

# You can change the number of lines - use a unique name for every VM - don't reuse names

# already used in other VMs already deployed

RemoveVM "test10"

RemoveVM "test11"

RemoveVM "test12"

RemoveVM "test13"

RemoveVM "test14"

RemoveVM "test15"

RemoveVM "test16"

RemoveVM "test17"

RemoveVM "test18"

RemoveVM "test19"

RemoveVM "test20"

 

# Wait for all to complete

While (Get-Job -State "Running") {

    Get-Job -State "Completed" | Receive-Job

    Start-Sleep 1

}

 

# Display output from all jobs

Get-Job | Receive-Job

 

# Cleanup

Remove-Job *

 

# Displays batch completed

echo "Remove VM Completed"

StartVMs

# Name of subscription

$SubscriptionName = "Copy the SubscriptionName property you get from Get-AzureSubscription"

 

function StartVM( [string]$VmName ) {

    Start-Job -ArgumentList $VmName {

        param($VmName)

        Start-AzureVM -Name $VmName -ServiceName $VmName -Verbose

    }

}

 

# Select the subscription - this line is fundamental if you have access to multiple subscription

# You might remove this line if you have only one subscription

Select-AzureSubscription -SubscriptionName $SubscriptionName

 

# Every line in the following list starts one VM using the name specified in the argument

# You can change the number of lines - use a unique name for every VM - don't reuse names

# already used in other VMs already deployed

StartVM "test10"

StartVM "test11"

StartVM "test11"

StartVM "test12"

StartVM "test13"

StartVM "test14"

StartVM "test15"

StartVM "test16"

StartVM "test17"

StartVM "test18"

StartVM "test19"

StartVM "test20"

 

# Wait for all to complete

While (Get-Job -State "Running") {

    Get-Job -State "Completed" | Receive-Job

    Start-Sleep 1

}

 

# Display output from all jobs

Get-Job | Receive-Job

 

# Cleanup

Remove-Job *

 

# Displays batch completed

echo "Start VM Completed"

 

StopVMs

# Name of subscription

$SubscriptionName = "Copy the SubscriptionName property you get from Get-AzureSubscription"

 

function StopVM( [string]$VmName ) {

    Start-Job -ArgumentList $VmName {

        param($VmName)

        Stop-AzureVM -Name $VmName -ServiceName $VmName -Verbose -Force

    }

}

 

# Select the subscription - this line is fundamental if you have access to multiple subscription

# You might remove this line if you have only one subscription

Select-AzureSubscription -SubscriptionName $SubscriptionName

 

# Every line in the following list stops one VM using the name specified in the argument

# You can change the number of lines - use a unique name for every VM - don't reuse names

# already used in other VMs already deployed

StopVM "test10"

StopVM "test11"

StopVM "test12"

StopVM "test13"

StopVM "test14"

StopVM "test15"

StopVM "test16"

StopVM "test17"

StopVM "test18"

StopVM "test19"

StopVM "test20"

 

# Wait for all to complete

While (Get-Job -State "Running") {

    Get-Job -State "Completed" | Receive-Job

    Start-Sleep 1

}

 

# Display output from all jobs

Get-Job | Receive-Job

 

# Cleanup

Remove-Job *

 

# Displays batch completed

echo "Stop VM Completed"

RemoveOrphanDisks

$Image = "Copy the ImageName property you get from Get-AzureVMImage"

# You can list your own images using the following command:

# Get-AzureVMImage | Where-Object {$_.PublisherName -eq "User" }

 

# Remove all orphan disks coming from the image specified in $ImageName

Get-AzureDisk |

    Where-Object {$_.attachedto -eq $null -and $_.SourceImageName -eq $ImageName} |

    Remove-AzureDisk -DeleteVHD -Verbose

 

© SQL Blog or respective owner

Related posts about Azure

Related posts about powershell