|
hello Owen,
I am also agree with you but not on all the points.
Users normally go to sitemap if they are lost or they are looking for some particular information on your site which they dont find easily. So i think sitemap use is necessary.
You can use Robot.txt only if you want restriction in some areas of your site.
Else if there are no restrictions then no need to use robot.txt file.
And about custom 404 page :
Whenever your site is unable to find any request, it displays a normal system 404 page. So instead of displaying that 404 page, we can create our own custom 404 page and optimize it for better.
Thanks
|