Robots.txt proper way to some URLs starting with numbers

Viewed 16

So I want to disallow all redirects after removing IDs from category pages (example.com/13-category) and products (example.com/13-category/316-product) so they won't be crawled.

My thought was:

Disallow: /1*
Disallow: /2*
Disallow: /3*
Disallow: /4*
Disallow: /5*
Disallow: /6*
Disallow: /7*
Disallow: /8*
Disallow: /9*

But the problem is that there are pages like example.com/blog/3_(blog name) and so on. How should I go about making the Disallow and Allow list with the least amount of lines?

0 Answers
Related