.Google.com restricts robots.txt assistance to 4 industries, clarifying its viewpoint on unsupported directives.Google.com only supports four details robots.txt fields.In need of support regulations in robots.txt will definitely be disregarded.Consider bookkeeping your robots.txt documents in light of this improve.