Server IP : 85.193.89.191 / Your IP : 3.142.132.224 Web Server : Apache System : Linux 956367-cx40159.tmweb.ru 3.10.0-1160.105.1.el7.x86_64 #1 SMP Thu Dec 7 15:39:45 UTC 2023 x86_64 User : bitrix ( 600) PHP Version : 8.1.27 Disable Function : NONE MySQL : OFF | cURL : OFF | WGET : ON | Perl : ON | Python : ON | Sudo : ON | Pkexec : ON Directory : /proc/983/cwd/lib64/python2.7/ |
Upload File : |
� ٜSec @ s} d Z d d l Z d d l Z d g Z d d d � � YZ d d d � � YZ d d d � � YZ d e j f d � � YZ d S( s< robotparser.py Copyright (C) 2000 Bastian Kleineidam You can choose between two licenses when using this package: 1) GNU GPLv2 2) PSF license for Python 2.2 The robots.txt Exclusion Protocol is implemented as specified in http://info.webcrawler.com/mak/projects/robots/norobots-rfc.html i����Nt RobotFileParserc B sb e Z d Z d d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z RS( ss This class provides a set of methods to read, parse and answer questions about a single robots.txt file. t c C s>