Skip to content

A script that will scan from the root of your server, and look for all folders, it assumes all folders on the root should be disallowed with robots.txt

Notifications You must be signed in to change notification settings

dombrock-archive/Robot_Overlord

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

Robot_Overlord

A simple PHP script that will create or modify the robots.txt in all sub domains on a server to disallow indexing.

Very useful for large staging servers.

Place this file at the root of the server and navigate to it with your browser.

That is all you need to do.

If the robots.txt doesn't exists it will be created. If it does exists it will be modified and a backup will be made (just in case).

About

A script that will scan from the root of your server, and look for all folders, it assumes all folders on the root should be disallowed with robots.txt

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages