.Google limits robots.txt assistance to four industries, clarifying its own posture on in need of support regulations.Google simply supports four details robots.txt fields.In need of support directives in robots.txt will definitely be actually neglected.Consider auditing your robots.txt files taking into account this improve.