JeEtrOck said:
robot.txt ko use karna itna riscky kyun hai ye bata saktein hain app
Bhi ye risky to nahi he, balke useful tool he, jis ke zerye aap apni website per mojood data ko mukhtalif robots se protect ker sakte hain.
For example aap chahte hain ke koi bhi robot aapki website ke root mein folder [Login] ko access na ker sake to aap ye code likh sakte hain:
Code:
User-agent: *
Disallow: /Login/
upper diye gaye code se ye faida hoga ke mukhtalif robot (software) jo ke website ke kamzorian automatic talash kertay hain, wo aapke login folder ko access he nahi ker sakte, is se hacking ka khatra kam hojata he.
Bookmarks