@ning johnny zhao , Usually Azure Bastion supports concurrent connections for every OS. But WIN 10 has a limitation on concurrent logins where this OS limitation extended to bastion as well. Please check if there are any concurrent login of this machine and try to close them.
----------
Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.