Appending secondary owners for a group via powershell

I am running into issues when trying to update the secondary owners list for a given group.

I can set a secondary owner via the command below, but it overwrites existing data. I am trying to append a new secondary owner without removing what's there already.

set-qadgroup "group name" -secondaryowner (get-aduser user).distinguishedname

I tried retrieving the existing secondary owners and then stuck the members of the array into another variable using the -join method to colon separate the array members, but that did not help.