Connecting to VRDP with simple auth causes VBoxSVC to hang indefinitely

[kballen]

Running VirtualBox 5.0.10 on a Windows 10 x64 host, I have configured a VM with VRDP enabled, external auth, and the VBoxAuthSimple auth driver. Upon connecting to the RDP port, both the Manager and the VM process UIs lock up indefinitely. I've found that if I kill VBoxSvc.exe, both programs unfreeze, though the VM terminates shortly after. Furthermore, while the programs are frozen, attempting to run VBoxManage also stalls indefinitely, which further leads me to believe that VBoxSVC has locked up. The same configuration except using the normal Winlogon auth driver works as expected.

I have attached VBox.log from a case where I connected via RDP at ~3:52, killed VBoxSvc at ~9:19, and the VM later crashed. I also have dump files of VBoxSvc.exe and Virtualbox.exe in the frozen state that I can provide on request.

[kballen]

VBox.log

[sunlover]

Thanks for reporting this. The fix is available in VBox 5.0 r104704+. Please test the latest Windows build from https://www.virtualbox.org/wiki/Testbuilds

[kballen]

r104704 works great for me. Thanks!

[Frank Mehnert]

Fix is part of VBox 5.0.12.