Page one of a category can look fine while the later pages are a mess. Products might appear under several filters, move between pages, or become hard to reach.
Do you manually check the deeper pages when reviewing a shop? Which problems make you change the structure rather than leave the pagination alone?