As answered
it's already possible to connect Android Studio to WSA. But, after you restart Android Studio, it disconnects the Android Debug Bridge and you need to run \ connect <WSA instance IP> again.
Is there a way to automatically tell the ADB to connect to WSA when you start up Android Studio, or simply keep it connected?