Kisi website main robots.txt file kya hoti hai, Aur ye kaise banai jati hai, aur iss ka kya role hota hai.
Kindly agar kisi ko pata hai, to mujhe guide kar dain, mujhe is bare main urgent info chayie.

Thanks in Advanced