A tool-evaluation discussion rather than an endorsement of a particular vendor.
Compare crawl scope, export quality and reproducibility rather than only the headline feature list. Which sample pages would you use to evaluate a crawler for your project?
A concrete example of how you would make the decision would be more useful than a general rule. What would change your answer?
.
