Uninstall SPE without forced reboot?

I am trying to do a silent uninstall of the SPE agent for Password Manager.  It forces a reboot without warning.   Is there a way to prevent that?