Popularity is fickle. Just ask a politician. Many of them watch their ratings to see how their constituents view their policies. They may start with a high rating, but then it steadily declines during their term.
Jesus also experienced a sharp decline in popularity. His popularity reached its peak after He fed the 5,000 (John 6:14-15).