I am explaining here why we should not use robots.txt to remove page from Google indexing. Why we should not block pages for googlebot, instead we should use Noindex. Let's learn about Noindex Vs robots.txt. In which cases we should use robots.txt and in which case we should use noindex.