Activating robots.txt in Ingeniux CMS

Description

Websites use the robots.txt text file to communicate with web crawlers and other automated agents, such as search engine bots. This file resides in the root directory of a website to provide instructions on which parts of the site should not be crawled or indexed by search engines. CMS Administrators use robots.txt to prevent external search engines from indexing pages they do not want to appear in search engine results.

Requirements

Create a robots.txt file.

See Google's guide for developers, Basic guidelines for creating a robots.txt file, if you need help creating the robots.txt file.

Step-by-Step

To activate your robots.txt in Ingeniux CMS:

1. Navigate to Assets > Assets Tree in the CMS.
2. Upload the robots.txt file to a folder in the Assets Tree.
   1. Create a folder if one does not exist in the Asset Tree.
   2. Right-click the new folder, then select New from the drop-down menu.

      

   3. Drag your robots.txt to the Create New Asset dialog.
   4. Click Create Asset.
3. Check in robots.txt.
   1. Right-click robots.txt, then select Check in from the context menu.

      

      The Check in assets to be published dialog displays.

   2. Optional: Add a description of the check-in action in the field provided.
   3. Complete the check-in operation by clicking Confirm.
4. Mark robots.txt for a publishing target.
   1. Right-click the robots.txt file, then select Mark for Publish from the context menu.
   2. Select the target(s) that will include robots.txt via the Change Content Publish Marking dialog.
5. Provide robots.txt with a custom URL.
   1. Right-click robots.txt, then select Properties from the context menu.
   2. Select the URL Management option in the Properties dialog.
   3. Click Add.
   4. Enter the following value in the New Custom URL Path field:
      New Custom URL Path Value

      /robots.txt

   5. Click Add.

      

      The new custom field displays.

   6. Click Confirm to close the Properties dialog.
6. Publish the robots.txt asset to the appropriate publishing target(s).

   See Publishing Assets for the steps to publish an asset.