[FEATURE] Add the partition checksum to ensure data consistency

[zuston]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the feature

In #2653, we introduced a mechanism to verify the record count of each partition. To enable more precise consistency checks, we should also support computing and validating partition-level checksums.

Motivation

No response

Describe the solution

No response

Additional context

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!