When examining the response acquired in the server, the crawler to start with checks the value with the HTTP position code: Values inside the 2xx and 3xx ranges point out an accurate and productive reaction, while all other values are deemed an mistake. If the thing is inconsistent results, there