You can certainly attempt that, but from my own personal experience, sooner or later you’ll run into issues that cannot be addressed through overlays, overrides, etc.
Personally, I’d not attempt this without resolving Support flake references to patches · Issue #3920 · NixOS/nix · GitHub
Your experience will not be great.