Case experiment: nofollow tag's strong resistance to search engines

Hello everyone, I am Qiu Yu. I also like the nofollow tag very much. I analyzed the use of the nofollow tag in large industry networks and how to grasp the "degree" of the use of the nofollow tag. Today, I will analyze the blocking effect of nofollow tag on search engine indexing and inclusion through these two days of experiments. The most common use of nofollowr is Google's search engine, and then Baidu also officially announced its support for nofollow tag. The nofollow tag is mainly used to tell search engines not to track all links with this tag, and not to index and include the link, so as to prevent irrelevant links from losing weight. For nofollow tags, the most common ones are user registration, shopping cart, novice help, contact us, company introduction, about us, website statistics, website map, privacy protection, and so on. However, the role of nofollow tag is more to block the indexing and inclusion of invalid urls. The following is a follow-up investigation on noffow tag's blocking of indexing and inclusion of search engines:

1. Because the links filtered by product attributes are similar to a large number of the same content, invalid url addresses with a large number of the same content will greatly disperse the website weight and waste a lot of spider crawling time. Therefore, preventing search engines from including and indexing similar pages has become an important issue. Therefore, I use the nofollow tag for the links on these product property pages.

2. The data collected every other day with nofollow tag:

The spiders' crawling pages the next day with the nofollow tag:

From the analysis of inclusion and spider crawling the next day after using nofollow for links similar to face pages, Baidu's inclusion dropped from more than 5000 to more than 800, and Google's from more than 40000 to more than 2000. Moreover, spiders do not crawl pages with nofollow tags, which shows that nofollow tags are very effective in blocking the indexing and inclusion of search engines.