Thin nanosheets from a layered zirconium phosphate–carboxyphosphonate is reported here. Small Pd nanoparticles have been supported on these nanosheets by an efficient method. The resulting Pd-catalyst was fully characterized and tested in the Suzuki–Miyaura coupling. The catalytic system proved its efficiency as it was reused for several cycles and showed low Pd leaching.