skip to navigation
skip to content

sloth-ci.ext.robots_txt 1.0.3

Robots.txt for the Sloth CI server

Robots.txt for the Sloth CI server.

`Robots.txt <https:"" wiki="" robots_exclusion_standard="">`__ is a file you put on your server to protect certain URLs from being accessed by crawler bots.

By default,tThis extension serves *robots.txt* on the server root, e.g. However, you can specify your own file to serve and the URL to serve it on.


.. code-block:: bash

$ pip install sloth-ci.ext.robots_txt


.. code-block:: yaml
:caption: sloth.yml

# Use the sloth_ci.ext.robots_txt module.
module: robots_txt

# Absolute path to the custom robots.txt file.
# If not given, the bundled one is used (disallows everything to everyone).
# file: ~/robots.txt

# URL path to robots.txt.
# By default the file is available in the root: **
# path: /static/robots.txt  
File Type Py Version Uploaded on Size (md5) MS Windows installer any 2016-02-21 137KB (md5) Source 2016-02-21 4KB
sloth_ci.ext.robots_txt-1.0.3-py3-none-any.whl (md5) Python Wheel 3.5 2016-02-21 4KB