When Google, Bing, Geizhals or similar search engines and price comparison sites (so-called "bots") search a shop, Findologic often also searches the result pages. This can lead to many requests due to the filter links. The indexing of the result pages by bots is unnecessary, since the item inventory is already indexed via the normal navigation and item pages and is found with the search engines. Furthermore, the indexing of the result pages is usually also not effective, since the bots select and index all possible combinations of filters that customers would never select in this constellation.

The exclusion of Google from Findologic has no negative influence whatsoever on Google's ranking. Excluding Findologic from Google can even result in a better ranking, since duplicate content is avoided.

Since the basic fee of the Findologic tariffs only contains a certain number of monthly search queries, this can lead to an exceeding of the tariff and thus to further costs. As far as possible, requests from bots will not be billed as a gesture of goodwill. In order to avoid misunderstandings, however, we ask you in your own interest to exclude the bots with the information below.

An indication of possible bot queries would be, for example, an unusually high number of search queries for EANs/item numbers in your shop. In this case, please contact us at support@findologic.com stating the reporting period and the conspicuous search queries.

You will find the actually billed queries (without the bots known to us) on your monthly invoice.

And this is how it works: Adapt robots.txt

Create a file called "robots.txt" in the root directory of your website. Depending on the shop system, this file must contain different instructions, which you will find below. If the file already exists, then add the following at the end.

To check the correct integration of robots.txt, you can use the following tools:

You need a search URL there that is checked. Simply perform a search and then copy the address in the address bar of your browser into the corresponding field of the tool. The specified lines are usually sufficient to exclude the most important bots. Bots that do not comply with the robots.txt directives will be removed by Findologic before the invoice is created.

Shopware 5
​

Shopware 6
​

plentyMarkets

Please note that the check (see below) may issue a warning:

This warning can be ignored because it only applies to small bots; Google and Bing process the directive correctly.

Own/Miscellaneous

No ready-made instructions can be provided for systems or in-house developments not listed here. If you have any questions, please contact the developer of the system.