The high genetic and antigenic variability of influenza virus and the repeated exposures of individuals to the virus over time account for the human immune responses toward this pathogen to continuously evolve during the lifespan of an individual. Influenza-specific immune memory to past strains has been shown to affect the immune responses to subsequent influenza strains and in turn to be changed itself through the new virus encounter. However, exactly how and to what extent this happens remains unclear. Here we studied pre-existing immunity against influenza A virus (IAV) by assessing IAV binding (IgG), neutralizing, and neuraminidase-specific antibodies to 5 different IAV strains in 180 subjects from 3 different age cohorts, adolescents, adults, and elderly, over a 5-year time span. In each age cohort, the highest neutralizing antibody titers were seen for a virus strain that circulated early in their life but the highest increase in titer was found for the most recent virus strains. In contrast, the highest IgG titers were seen against recent virus strains but the biggest increase in titer occurred against older strains. Significant increases in neutralizing antibody titers against a newly encountered virus strain were observed in all age cohorts demonstrating that pre-existing immunity did not hamper antibody induction. Our results indicate that the evolution of influenza-specific humoral immunity differs for rather cross-reactive virus-binding antibodies and more strain-specific neutralizing antibodies. Nevertheless, in general, our observations lend support to the antigenic seniority theory according to which the antibody response to influenza is broadened with each virus encounter, with the earliest encountered strain taking in the most senior and thus dominant position.