managing robots.txt

Alessandro Dentella's Avatar

Alessandro Dentella

05 Aug, 2019 07:33 AM

Hi,

I'd like to know how it is possible to fine tune tobots.txt to allow indexing by search engines. Is it freely configurable?

Thanks in advance

  1. 1 Posted by Alessandro Dent... on 09 Aug, 2019 08:23 AM

    Alessandro Dentella's Avatar

    I noticed that starting a new tenderapp.com the default robots.txt allows search engines indexing so I guess it should be possible to change an already existing one but I cannot see how to to that. Please, can you tell me what should we do? Missing this information we have to migrate to other solutions.

  2. Support Staff 2 Posted by Courtenay on 13 Aug, 2019 05:50 PM

    Courtenay's Avatar

    can you tell us a bit more about what you’re trying to do? generally, public sites/categories are listed as indexable on your primary domain.

  3. 3 Posted by Alessandro Dent... on 14 Aug, 2019 05:31 PM

    Alessandro Dentella's Avatar

    > can you tell us a bit more about what you’re trying to do? generally,
    > public sites/categories are listed as indexable on your primary domain.
    >

    Sure, that's just a trial domain I made to understand how's the
    default now.

    The support-site I'm intereseted in pushing to be indexable is
    anki.tenderapp.com, that, as you can see, is disabled.

    The owner of the site says that robots.txt is out of his control
    and i wanted to help understand how to make it indexable.

      https://anki.tenderapp.com/discussions/add-ons/36143-why-is-indexing-disabled-on-this-support-site

    Maybe it's an old configuration? maybe it's a request that was
    reasonable in the past?

    Thanks in advance

    sandro

    PS: I already answered yesterday, maybe I answered below the line...

  4. Support Staff 4 Posted by Courtenay on 15 Aug, 2019 01:56 AM

    Courtenay's Avatar

    The customer has a different custom domain name which is considered primary over the .tenderapp.com subdomain and so this one is blocked so we don’t get double results. they may want to check their settings and remove the domain or fix it so it correctly hosts the content without redirecting.

Discussions are closed to public comments.
If you need help with Tender please start a new discussion.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac

Recent Discussions

05 Dec, 2019 01:11 AM
22 Nov, 2019 01:04 PM
14 Oct, 2019 04:05 AM
14 Oct, 2019 12:43 AM
21 Sep, 2019 02:33 PM