Develop robots.txt file to authenticate and quit crawler from crawling just about anything other than your property site. Helping Engines like google: Search engines like google and yahoo like Google are like librarians for the online market place. They use meta tags to determine what your webpages are about. This https://hellopredict.com