Reflect on the fact that 'didn't vote recently' is being used as we speak to suppress voting in the upcoming election. For non-US readers, every state has a Secretary fo State who rather than doing any kind of foreign affairs work like the federal office of that name, primarily oversees paperwork and particularly elections. These Secretaries of State are elected offices and highly politicized, since officeholders can heavily impact the conduct of elections. In Georgia, for example, one of the candidates for Governor is currently Secretary of State, and has put the eligibility of tens of thousands of voters into question in a way that just happens to massively impact likely voters for his opponent.
I agree, and in that context, having name, party affiliation, and last_voted_at be public record would be the only way for an independent organization to gauge the impact per party of the disenfranchisement.