What is AutoFeedBot?
AutoFeedBot is the automated agent that reads your dealer website on your behalf, after you've signed up to AutoFeed and authorised it to do so. It fetches your public listing pages, the same way a search engine would, so your stock can be kept in sync with Carslink.ai.
User-agent: AutoFeedBot. Crawl frequency: every 15 minutes per authorised dealer site. If you're a site administrator and want AutoFeedBot to slow down or stop visiting your site, please get in touch via the contact form.
AutoFeedBot at a glance
| Property | Value |
|---|---|
| User-agent | AutoFeedBot |
| Operator | AutoFeed (autofeed.uk) |
| Crawl frequency | Every 15 minutes per authorised site |
| Request rate | Up to ~2 requests per second |
| Respects robots.txt | Yes |
| Contact | https://autofeed.uk/contact |
Glossary
- Authorised site
- A dealer website whose owner has signed the AutoFeed authorisation declaration.
- Polite crawler
- A bot that identifies itself, honours robots.txt, and limits request rate to avoid load.
- Listing page
- A public page on a dealer site that describes a single vehicle for sale.
What is AutoFeedBot?
AutoFeedBot is the automated agent that reads a dealer's public listing pages on their behalf, after the dealer has signed up to AutoFeed and authorised it. It fetches pages the same way a search engine does, so stock stays in sync with Carslink.ai and other marketplaces.
How often does AutoFeedBot crawl my site?
AutoFeedBot revisits each authorised dealer site roughly every 15 minutes so stock changes — new arrivals, price drops, sold cars — are reflected on Carslink.ai within minutes.
Does AutoFeedBot respect robots.txt?
Yes. AutoFeedBot identifies itself with the user-agent 'AutoFeedBot' and honours robots.txt directives. Site administrators can slow it down or block it via robots.txt or by contacting AutoFeed.
Will AutoFeedBot slow down my website?
No. AutoFeedBot crawls at a polite rate (a couple of requests per second at most) and is engineered to behave like a normal search-engine crawler.