To stay away from undesirable content while in the search indexes, website owners can instruct spiders not to crawl certain files or directories in the normal robots.txt file in the root directory on the domain. In addition, a page could be explicitly excluded from the internet search engine's databases through https://www.imdb.com/title/tt30110854/?ref_=wl_t_1