The Mondrian Puzzle asks whether it is ever possible to partition a square into at least two disjoint rectangles of integer side lengths and the same area where no two rectangles have the same dimension. In this talk, we show that for a positive proportion of squares, this task is impossible. Along the way, we discuss several classic results in analytic number theory.