Rojname.com is a news search engine with focus on Kurds, Middle East and Europe. RojnameBot is an application created to automatically perform simple and repetitive tasks like crawling webpages. Our spider crawls new content of Kurdish and international news websites and link to their pages via our website, apps and social media accounts. Rojname.com is existing more than 15 years. Use of our website is free.
User-Agent: RojnameBot (http://rojname.com/bot.html)
Is RojnameBot useful? - Who uses Rojname.com?
We know that worldwide many people ie. politicians, academicians and especially journalists are using and following Rojname.com.
How RojnameBot crawls your website
Crawl Frequency - How often does RojnameBot crawls your website
RojnameBot crawls your website generally once a 6 hours. RojnameBot does not visit main-url more than a maximum of once a 10 minutes. Even if new content exists, RojnameBot should not request more than one page from your site within the same 60 seconds time period.
How to prevent RojnameBot from crawling your site
You should do changes in your "/robots.txt".
RojnameBot will seek for similar lines in your "/robots.txt" file:
Is RojnameBot safe?
RojnameBot is created to help people while respecting site owners. But every application can have bugs. If you discover any please contact us. We promise to make it better.
Please click here to contact us.