This is exactly how it works in plenty of countries, actually! The US is the outlier here. In practice people have zero trouble figuring out which family member was driving - just like they have no trouble getting a kid to fess up to scratching the bumper while backing up into their own garage.