Unfortunately then the domain becomes a unique identifier. It still doesn’t fix the security issues with email itself.
You also end up giving away a lot of personal information to the domain registrar, which is less anonymous than third party email providers.
Password managers can be accessed across devices