Unable to install Docker Desktop on Windows 10 Pro 21H1

Question

I'm attempting to install Docker Desktop on Windows 10 Pro 21H1, but I keep receiving the following error:

Component CommunityInstaller.EnableFeaturesAction failed: Not found 
   at CommunityInstaller.InstallWorkflow.<DoHandleD4WPackageAsync>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at CommunityInstaller.InstallWorkflow.<DoProcessAsync>d__23.MoveNext()

I've tried removing:

C:\Program Files\
C:\Users\Abhijeet\AppData\Local\Docker
C:\Users\Abhijeet\AppData\Local\Docker Desktop

as well as other Docker-related folders, several times.

WSL2 is operating smoothly on my Ubuntu 20 machine.

sid_c06@LAPTOP-HJCDC6N0:~$ wsl.exe -l -v
  NAME            STATE           VERSION
* Ubuntu-20.04    Running         2

I tried unchecking the WSL2 option during installation, however when I tried to start Docker Desktop afterward, the step of starting Linux Containers on WSL2 failed.

Unable to start
at Docker.Core.Pipe.NamedPipeClient.d__5.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at Docker.Core.Pipe.NamedPipeClient.Send(String action, Object[] parameters)
at Docker.Actions.DoStart(SynchronizationContext syncCtx, Boolean showWelcomeWindow, Boolean executeAfterStartCleanup)
at Docker.Actions.<>c__DisplayClass27_0.b__0()
at Docker.ApiServices.TaskQueuing.TaskQueue.<>c__DisplayClass17_0.<.ctor>b__1()

Could you please tell me what I'm doing wrong? Should I also skip Docker Desktop and install Docker straight on Ubuntu on WSL2? For the same, I couldn't discover any concreate steps. Please let me know if you think that's a good idea.