If you ask this question, you may have found the name 'startmebot' in your server access logs. For some functionality, start.me uses a so-called 'bot' that retrieves information from websites. Our bot identifies itself with the name 'startmebot' in its user agent string. The full user agent string for out bot is:
Mozilla/5.0 (compatible; startmebot/1.0; +http://www.start.me/bot)
What kind of information does the bot retrieve?
Our bot is used to retrieve three kinds of information from external sites:
- A website page's title
- A website's favicon
- The contents of RSS feeds offered by a website
Does the bot respect robots.txt
?
Our bot does not actually index any content, but only retrieves specific information from online sources. In doing this, our bot does not consider the contents of robots.txt
. If you feel our bot is visiting your site too often or should not access specific information on your site, please send us an email at support@start.me.
Comments
0 comments
Article is closed for comments.