Search Engine ko Website crawl karne se kaise roke

Kayi baar hamare saath aise situation aate hai jinki wajah se hume apne blog ko search engine ko crawl karne aur search pe list hone se rokna hota hai. Is article me hum aapko batayenge how to stop search engines from crawling website.

Koi bhi Search engine ko block kyu karega

Bahut sare websites ke liye search engine traffic ka ek biggest source hai. Bahut sare user jub apni site ko start karte hai to ye nahi jante hai ke site ko local development environment ya staging site pe kaise create kare. Agar aap apne site ko live publicly accessible domain name pe develop kar rahe hote hai to aap nahi chahte hai ke google aapke under construction or maintenance mode page ko index kare.

Bahut se aise log hai jo WordPress ka use private blog ko create karne ke liye karte hai aur nahi chahte hai ke wo search result me index ho kyu ki wo unke private post hote hai.

Bahut sare log wordpress ka use apne project ko manage karne or Intranet ke liye karte hai aur nahi chahte ke unka internal document publicly accessible ho.

Upar diye gaye sabhi situation me aap nahi chahte hai ke aapka blog search engine me index ho.

Logon ke beech me ek misconception ye hai ke agar aapke pass aise link nahi hai jo aapke domain ki taraf point kare to search engine aapki website ko kabhi find nahi kar sakta hai. Lekin Ye baat completely true nahi hai.

Bahut sare aise ways hai jinki help se search engine website ko linked pa sakte hai. Example

• Aapka domain name pahle koi aur use kar raha ho aur aapke site pe abhi bhi kuch link point ho rahe ho.
• Kuch domain search site ke result unpe aapke link ke sath index ho rahe ho.
• Domain name ki list ke sath bahut sare page hai aapki site unme se kisi pe dikhayi de sakti hai.
• 
  
  

Bahut sari chizen web pe hoti hai jise hum control nahi kar sakte hai. Lekin aapki website aapke control me hai aur aap apne website ko search engine ko index karne ke liye instruct kar sakte hai.

How to stop search engines from crawling website

WordPress built-in feature ke sath aata hai jiski help se hum apne site ko search engine ko crawl karne se rok sakte hai. Hame apne dashboard me Settings ke option me Reading me jana hai aur Search Engine Visibility option ke niche ke box ko aapko check karna hoga.

Jub aap upar diye gaye box ko check karte hai to aapke site pe niche diye gaye code ko wordpress aapke website header me add kar deta hai.

<meta name='robots' content='noindex,follow' />

WordPress aapke site ke robot.txt fil eko bhi modify kar dega aur usme nuche diye gaye line ko add kar dega.

User-agent: *
Disallow: /

Ye lines robots ko aapke site ko index nahi karne dega. Halaki ye completely search engine pe depend karta hai ke wo aapke request ko accept karta hai ke nahi. Lekin zyadatar search engine is request ko accept karte hai.

Is baat ko kaise sure kare ke search result me aapki site appear na ho

WordPress ka default visibility setting search engine ko aapke site ko index nahi karne deta hai. Phir bhi search engine aapke site se file, page aur post ko index kar sakta hai.

Agar aap chahte hai ke search engine aapki website ko crawl aur index na kare to aapko apne website ko bahut sare level pe password protect karna hoga.

Iska matlab ye hai ke agar aapki site ko koi acccess karna chahega to usse username aur password manga jayega., aur ye search engine ke liye bhi hai. Login failure hone pe 401 error display hoga. To aaeye dekhte hai ke un methods ko jinki help se hum apne site ko search engine ko crawl karne se rok sakte hai.

1. cPanel ka use kar ke complete site ki security password

Agar aapke WordPress hosting provider aapko cPanel se hosting account ko manage karna allow karte hai to aap apne poore site ko cPanel ki help se protect kar sakte hai. Apko sirf apne cPanel dashboard me login karna hai aur security section me ‘Password Protect Directories’ icon pe click karna hai.

Ab aapko us folder ko choose karna hai jisme aapne WordPress ko install kiya hai usually wo public_html folder hota hai.

Agar aapne public_html directory me bahut se wordpress site ko install kar rakha hai to aapko folder icon ko open kar ke browse karna hai aur us website ke folder ko select karna hai jise aap password protect karna chahte hai.

Next screen pe aapko us protected directories ka naam enter karna hai aur save button pe click karna hai.

Your information will be saved and cPanel will reload the page. After that, you need to add an authorized user by entering a username and password.

Aapka information save ho jayega aur cPanel page ko reload kar lega. Iske baad aapko authorize user ka user name aur password add karna hoga.

Bus aapko itna hi karna hai, aapne apne wordPress website ko password protect kar diya hai.

Ab jub bhi koi aapki website ko access karne ki koshish karega to us se username and password manga jayega.

2. Plugin ki help se WordPress Password Protect kare

Agar aap ek managed wordpress hosting solution ka use karte hai to kabhi kabhi aapko cPanel me access nahi milta hai.

Aise case me aapko apne site ko password protect banane ke liye plugins ki help leni hogi. Niche kuch plugins ke naam bataye gaye hai jinki help se aap apne wordpress site ko password protected bana sakte hai.

• SeedProd – Ye wordpress ke liye ek #1 coming soon and maintenance mode plugin hai jise 800,000+ websites use kar rahe hai. Ye complete access control aur permissions features ke sath aata hai jiske help se aap apne wordpress site ko search engine ke sath sath har kisi se hide kar sakte hai.
• Password Protected – Apne site ko ek single password se password protect karne ka ye sabse aasan tareeqa hai. Aap is plugin ki help se apne website ko password protect kar sakte hai.

Umeed hai ye article How to stop search engines from crawling website aapke liye helpsful hoga.