Clade 2.3.4.4b highly pathogenic avian influenza A(H5N1) viruses continue to expand geographically and across mammalian hosts, raising concern about pandemic potential. The degree and specificity of pre-existing immunity in humans are key determinants of this risk. We analyzed hemagglutinin (HA)- and neuraminidase (NA)-specific antibody responses in 300 sera collected from adults in New York City. While HA directed binding antibodies to clade 2.3.4.4b H5 were low and hemagglutination-inhibiting antibodies were absent, we detected widespread binding and functional NA antibodies against N1 neuraminidases from clade 2.3.4.4b H5N1 viruses. Neuraminidase inhibition (NI) titers were highest against North American D1.1 genotype N1 viruses and correlated strongly with neutralizing activity, whereas HA-binding antibodies did not. An additional N-linked glycosylation site, as found in the NA of a human D1.1 isolate from British Columbia, reduced susceptibility to NI antibodies. Antibodies to N5 from H5N5 were minimal. These findings indicate that population-level immunity to clade 2.3.4.4b H5 viruses is dominated by NA-directed antibodies, with important implications for pandemic risk assessment.