Get Started Now
Chat with our online support to discuss about your Web project.
Client Testimonials
I'm happy to get service from Do Surf In Pvt. Ltd. I think I would choose this company first and consult with for any kind of service I would need.
Manager, SongsNepal.ComSupport
DSI Blog
2009
15
December
Well, we all have been implementing robots.txt in our website to block search engines to crawl our private pages. But sometimes search engines crawl that page and index them. So, what can be the cause.
Here, in this video Matt Cutts is describing how Google handles robots.txt.