.Google.com confines robots.txt support to four industries, clarifying its viewpoint on in need of support ordinances.Google.com just supports four details robots.txt fields.Unsupported directives in robots.txt will certainly be actually neglected.Think about bookkeeping your robots.txt data due to this upgrade.