OnMSFT has created a guide that explains how to sideload Android apps on Windows 11.
How to Sideload Android Apps on Windows 11
Sideload Android Apps on Windows 11 without the Amazon app store. You can sideload a lot of the supported applications through the WSA.
How to Sideload Android Apps on Windows 11 - OnMSFT.com