In 2024, an unprecedented outbreak of H5N1 high pathogenicity avian influenza was detected in dairy cattle in the USA resulting in spillbacks into poultry, wild birds and other mammals including humans. Here, we present molecular and virological evidence that the cattle B3.13 genotype H5N1 viruses rapidly accumulated adaptations in polymerase genes that enabled better replication in bovine cells and tissues, as well as cells of other mammals including humans. We find evidence of several mammalian adaptations in cattle including PB2 M631L, which is found in all cattle sequences, and PA K497R, which is found in the majority. Structurally, PB2 M631L maps to the polymerase-ANP32 interface, an essential host factor for viral genome replication. We show that this mutation adapts the polymerase to better interact with bovine ANP32 proteins, particularly ANP32A, and thereby enhances virus replication in bovine mammary systems and primary human airway cultures. We show that ongoing evolution in the PB2 gene, including E627K and a convergently arising D740N substitution, further increase polymerase activity and virus replication in a range of mammalian cells. Thus, circulation of H5N1 in dairy cattle allows virus adaption improving replicative ability in cattle and poses a continued risk of zoonotic spillover.