Perhaps git would work?

But rsync can do this fine with --recursive --delete. The mirror will remain an exact replica.

Restic, kopia, and Borg are all pretty good backup tools with deduplication built in, so they might be a good option if you’re doing this for backup purposes?