Fdupes

FDUPES is a program for identifying duplicate files residing. within specified directories. — GitHub

It first compares file sizes, partial MD5 signatures, full MD5 signatures, and then performs a byte-by-byte comparison for verification.

Personally I using it to decrease entropy of my filesystem.