Connect to your Office 365 instance.

$UserCredential = Get-Credential
Connect-MsolService -Credential $UserCredential


Show your license SKUs

 

Get-MsolAccountSku

 


Run the command to change your user's licenses All At Once (example is from Office 365 Education for students to  Office 365 Education Plus for student )

get-MSOLUser -All | where {$_.isLicensed -eq "TRUE" -and $_.Licenses.AccountSKUID -eq "[School]:STANDARDWOFFPACK_STUDENT"} | Set-MsolUserLicense -RemoveLicense "[School]:STANDARDWOFFPACK_STUDENT" -AddLicense "[School]:STANDARDWOFFPACK_IW_STUDENT"

 


10 At a time (Test it)

get-MSOLUser -All | where {$_.isLicensed -eq "TRUE" -and $_.Licenses.AccountSKUID -eq "[School]:STANDARDWOFFPACK_STUDENT"} | select -Last 10 | Set-MsolUserLicense -RemoveLicense "[school]:STANDARDWOFFPACK_STUDENT" -AddLicense "[School]:STANDARDWOFFPACK_IW_STUDENT" 

 

Note: It takes a long time to finish.  I ran it on about 2800 students and it took around 45 minutes to complete.