User-agent: Google-Extended User-agent: GPTBot User-agent: GPTBot-User User-agent: ChatGPT User-agent: 008 User-agent: 360Spider User-agent: 404checker User-agent: 404enemy User-agent: 80legs User-agent: 8484 Boston Project v 1.0 Disallow: / User-agent: Amazonbot Disallow: /do-not-crawl/ User-agent: Abonti User-agent: Aboundex User-agent: Accoona-AI-Agent User-agent: Acunetix User-agent: ADmantX User-agent: AfD-Verbotsverfahren User-agent: AhrefsBot User-agent: AIBOT User-agent: AiHitBot User-agent: Aipbot User-agent: Alexibot User-agent: Alligator User-agent: AllSubmitter User-agent: AlphaBot User-agent: AlvinetSpider User-agent: Anarchie User-agent: AnsearchBot User-agent: AnsearchBot/1.0 User-agent: Anonymization.Net User-agent: Anonymization.Net Vivaldi User-agent: Antenne Hatena User-agent: Apache-HttpClient User-agent: Apexoo User-agent: ApocalXExplorerBot User-agent: Arachnophilia User-agent: archive.org_bot User-agent: ASPSeek User-agent: Asterias User-agent: ASpider/0.09 User-agent: Attach User-agent: AURESYS/1.0 User-agent: autoemailspider Disallow: / User-agent: b2w/0.1 User-agent: BackDoorBot User-agent: Backlink-Ceck User-agent: backlink-check User-agent: BacklinkCrawler User-agent: BackRub/. User-agent: BackStreet User-agent: BackWeb User-agent: Badass User-agent: Baiduspider User-agent: Baiduspider-favo User-agent: Baiduspider-cpro User-agent: Baiduspider-ads User-agent: Baiduspider-news User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: Bandit User-agent: Barkrowler User-agent: BatchFTP User-agent: Battleztar Bazinga User-agent: BaySpider User-agent: BBBike User-agent: BDCbot User-agent: BDFetch User-agent: BecomeBot/1.23 User-agent: BetaBot User-agent: Bigfoot User-agent: Bitacle User-agent: Big Brother User-agent: Bizbot003 User-agent: BizBot04 kirk.overleaf.com User-agent: BizInformation User-agent: Blackboard User-agent: Black Hole User-agent: BlackWidow User-agent: BLEXBot User-agent: Blow User-agent: BlowFish User-agent: Boardreader User-agent: Bolt User-agent: BotALot User-agent: Brandprotect User-agent: Brandwatch User-agent: BSpider User-agent: BSpider/1.0 libwww-perl/0.40 User-agent: Bubing User-agent: Buddy User-agent: BuiltBotTough User-agent: BuiltWith User-agent: Bullseye User-agent: BunnySlippers User-agent: BuzzSumo Disallow: / User-agent: Calculon User-agent: Calif Univ Tools User-agent: CATExplorador User-agent: CazoodleBot User-agent: CCBot User-agent: Cegbfeieh User-agent: Cerberian User-agent: Check&Get User-agent: CheeseBot User-agent: CherryPicker User-agent: CherryPickerElite User-agent: CherryPickerElite/1.0 User-agent: CherryPickerSE User-agent: CherryPickerSE/1.0 User-agent: ChinaClaw User-agent: christcrawler User-agent: Chlooe User-agent: Claritybot User-agent: Cliqzbot User-agent: Cloud mapping User-agent: coccocbot-web User-agent: Cogentbot User-agent: cognitiveseo User-agent: Collector User-agent: com.plumanalytics User-agent: ConveraCrawler User-agent: Copier User-agent: CopyRightCheck User-agent: Copyscape User-agent: Cosmos User-agent: Craftbot User-agent: crawler4j User-agent: crawler.feedback User-agent: crawl.sogou.com User-agent: CrazyWebCrawler User-agent: Crescent User-agent: Crescent Internet ToolPak HTTP OLE Control User-agent: CSHttp User-agent: Curious User-agent: Custo User-agent: CustomExchangeBrowser Disallow: / User-agent: DatabaseDriverMysqli User-agent: DataCha0s User-agent: DBLBot User-agent: demandbase-bot User-agent: Demon User-agent: DepSpid User-agent: Deusu User-agent: Devil User-agent: Digincore User-agent: DigitalPebble User-agent: DIIbot User-agent: Dirbuster User-agent: Disco User-agent: Discobot User-agent: DISCo Pump 3.1 User-agent: Discoverybot User-agent: DittoSpyder User-agent: DnyzBot User-agent: DomainAppender User-agent: DomainCrawler User-agent: DomainSigmaCrawler User-agent: DomainStatsBot User-agent: Dotbot User-agent: Download Wonder User-agent: Dragonfly User-agent: Drip User-agent: DTS Agent Disallow: / User-agent: e-SocietyRobot User-agent: EasyDL User-agent: Ebingbong User-agent: eCatch User-agent: ECCP/1.0 User-agent: EchO! User-agent: Ecxi User-agent: edgeio-retriever User-agent: EirGrabber User-agent: EmailCollector User-agent: EMail Siphon User-agent: EMail Wolf User-agent: EmailSiphon User-agent: EmailWolf User-agent: EnigmaBot User-agent: Entrieva User-agent: EroCrawler User-agent: evc-batch User-agent: Evil User-agent: Exabot User-agent: explorersearch User-agent: Express WebPictures User-agent: ExtLinksBot User-agent: Extractor User-agent: ExtractorPro User-agent: Extreme Picture Finder User-agent: EyeNetIE User-agent: Ezooms Disallow: / User-agent: f-bot test pilot User-agent: Factbot User-agent: FDM User-agent: FemtosearchBot User-agent: FHscan User-agent: Filangy User-agent: Fimap User-agent: findlinks User-agent: Firefox/7.0 User-agent: Flamingo_SearchEngine User-agent: FlashGet User-agent: Flunky User-agent: Foobot User-agent: Franklin Locator 1.8 User-agent: Freeuploader User-agent: FrontPage User-agent: FurlBot User-agent: Furl Search User-agent: FyberSpider User-agent: Fyrebot Disallow: / User-agent: GalaxyBot User-agent: Genieo User-agent: GermCrawler User-agent: Getintent User-agent: GetRight User-agent: GetWeb User-agent: Gigablast User-agent: Gigabot User-agent: G-i-g-a-b-o-t User-agent: Girafabot User-agent: Go-Ahead-Got-It User-agent: Gotit User-agent: GoZilla User-agent: Go!Zilla User-agent: gqbi hnxupsxgfgnX berXjteu User-agent: Grabber User-agent: GrabNet User-agent: Grafula User-agent: GrapeFX User-agent: Green Research, Inc. User-agent: GridBot User-agent: GT::WWW Disallow: / User-agent: Haansoft User-agent: HaosouSpider User-agent: Harvest User-agent: Harvest/1.5 User-agent: Havij User-agent: HEADMasterSEO User-agent: Heritrix User-agent: Hloader User-agent: HMView User-agent: HTMLparser User-agent: HTTP::Lite User-agent: httplib User-agent: HTTrack User-agent: HTTrack 3.0 User-agent: Huaweisymantecspider User-agent: Humanlinks User-agent: HybridBot Disallow: / User-agent: Iblog User-agent: ichiro User-agent: IDBot User-agent: Id-search User-agent: Igentia User-agent: IlseBot User-agent: Image Fetch User-agent: Image Sucker User-agent: Implisensebot User-agent: IndeedBot User-agent: Indy Library User-agent: infobot User-agent: InfoNaviRobot User-agent: InfoTekies User-agent: INGRID/0.1 User-agent: instabid User-agent: Intelliseek User-agent: InterGET User-agent: Internet Ninja User-agent: InternetSeer User-agent: internetVista monitor User-agent: ips-agent User-agent: Iria User-agent: IRLbot User-agent: Iskanie User-agent: ISC Systems User-agent: IstellaBot Disallow: / User-agent: Java User-agent: Java/1.4.2_04 User-agent: Java1.3.1_08 User-agent: Java/1.5.0 User-agent: JamesBOT User-agent: Jbrofuzz User-agent: JennyBot User-agent: JetCar User-agent: JikeSpider User-agent: JoBo/1.3 User-agent: JOC Web Spider User-agent: Joomla User-agent: Jorgee User-agent: JustView User-agent: Jyxobot Disallow: / User-agent: Kenjin Spider User-agent: Keyword Density User-agent: Kozmosbot Disallow: / User-agent: Lanshanbot User-agent: Larbin User-agent: larbin_2.6.3 User-agent: LeechFTP User-agent: LeechGet User-agent: LexiBot User-agent: Lftp User-agent: LibWeb User-agent: libWeb/clsHTTP User-agent: Linguee User-agent: Libwhisker User-agent: Lightspeedsystems User-agent: Likse User-Agent: LinkChecker User-agent: Linkdexbot User-agent: LinkextractorPro User-agent: linklooker User-agent: LinkpadBot User-agent: LinkScan User-agent: LinkScan/8.1a Unix User-agent: LinksManager User-agent: LinkWalker User-agent: LinqiaMetadataDownloaderBot User-agent: LinqiaRSSBot User-agent: LinqiaScrapeBot User-agent: Lipperhey User-agent: Litemage_walker User-agent: Lmspider User-agent: LNSpiderguy User-agent: ltx71 - (http://ltx71.com/) User-agent: lwp-request User-agent: LWP::Simple User-agent: lwp-trivial User-agent: lwp-trivial/1.34 Disallow: / User-agent: Mail.Ru User-agent: Magnet User-agent: Mag-Net User-agent: magpie-crawler User-agent: Mail.RU_Bot User-agent: Majestic12 User-agent: MarkMonitor User-agent: MarkWatch User-agent: Masscan User-agent: Mass Downloader User-agent: Mata Hari User-agent: MauiBot User-agent: Meanpathbot User-agent: Mediatoolkitbot User-agent: mediawords User-agent: MegaIndex.ru User-agent: Metauri User-agent: MFC_Tear_Sample User-agent: Microsoft Data Access User-agent: Microsoft URL Control User-agent: Microsoft URL Control - 5.01.4511 User-agent: Microsoft URL Control - 6.00.8169 User-agent: MIDown tool User-agent: MIIxpc User-agent: MIIxpc/4.2 User-agent: miniRank/2.0 User-agent: Missigua Locator User-agent: Mister PiX User-agent: MJ12bot User-agent: MLBot User-agent: MSNPTC/1.0 User-agent: Moget User-agent: moget/2.1 User-agent: Mojeek User-agent: Morfeus Fucking Scanner User-agent: Mozilla/PICgrabber User-agent: mozilla/5.0 (compatible; heritrix/1.3.0 +http://crawler.archive.org) User-agent: Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-17) User-agent: Mozilla/3.0 (compatible; Indy Library) User-agent: Mr.4x3 User-agent: MSFrontPage User-agent: MSIECrawler User-agent: MSProxy/2.0 User-agent: Msrabot User-agent: MS Search 4.0 Robot User-agent: MS Search 5.0 Robot User-agent: MS Web Services Client Protocol User-agent: muhstik-scan User-agent: Musobot User-agent: MVAClient Disallow: / User-agent: Name Intelligence User-agent: Nameprotect User-agent: NASA Search User-agent: NaverBot User-agent: NaverBot-1.0 User-agent: Navroad User-agent: NearSite User-agent: Needle User-agent: Nessus User-agent: NetAnts User-agent: NetAttache User-agent: Netcraft User-agent: netEstate NE Crawler User-agent: NetLyzer User-agent: NetMechanic User-agent: NetSpider User-agent: Nettrack User-agent: Net Vampire User-agent: Netvibes User-agent: NetZIP User-agent: Newsblur User-agent: NextGenSearchBot User-agent: NHSEWalker User-agent: Nibbler User-agent: nicebot User-agent: NICErsPRO User-agent: Niki-bot User-agent: Nikto User-agent: NimbleCrawler User-agent: Ninja User-agent: Nmap User-agent: Nomad User-agent: noxtrumbot User-agent: NPbot User-agent: Nutch Disallow: / User-agent: oBot User-agent: Octopus User-agent: Offline Explorer User-agent: Offline Navigator User-agent: OmniExplorer_Bot User-agent: Openbot User-agent: OpenDNS Domain Crawler User-agent: Openfind User-agent: Openfind data gathere User-agent: OpenindexSpider User-agent: OpenLinkProfiler User-agent: Openvas User-agent: OpenVAS User-agent: OutclicksBot User-agent: OutfoxBot User-agent: OutfoxMelonBot Disallow: / User-agent: PageAnalyzer User-agent: Page Analyzer User-agent: PageGrabber User-agent: page scorer User-agent: PageScorer User-agent: Panscient User-agent: Papa Foto User-agent: Pavuk User-agent: pcBrowser User-agent: PECL::HTTP User-agent: PeoplePal User-agent: phantom-bot User-agent: PHPCrawl User-agent: Picscout User-agent: Picsearch User-agent: PictureFinder User-agent: Pimonster User-agent: Pi-Monster User-agent: Pinterestbot User-agent: Pixray User-agent: PleaseCrawl User-agent: plumanalytics User-agent: Pockey User-agent: POE-Component-Client-HTTP User-agent: Port Huron Labs User-agent: Probethenet User-agent: Program Shareware User-agent: ProPowerBot User-agent: ProPowerBot/2.14 User-agent: ProWebWalker User-agent: Psbot User-agent: Pump User-agent: PxBroker User-agent: PyCurl Disallow: / User-agent: QuepasaCreep User-agent: QueryN Metasearch User-agent: Quick-Crawler Disallow: / User-agent: RankActive User-agent: RankActiveLinkBot User-agent: RankFlex User-agent: RankingBot User-agent: RankingBot2 User-agent: Rankivabot User-agent: RankurBot User-agent: RealDownload User-agent: Reaper User-agent: RebelMouse User-agent: Recorder User-agent: RedesScrapy User-agent: ReGet User-agent: RepoMonkey User-agent: Ripper User-agent: River Valley Inc User-agent: RMA User-agent: RocketCrawler User-agent: Rogerbot User-agent: Rvldsmcmuwduwxnltyrm x snl Disallow: / User-agent: SafetyNet Robot 0.1 User-agent: SalesIntelligent User-agent: SBIder User-agent: ScanAlert User-agent: Scanbot User-agent: scan.lol User-agent: Scooter User-agent: Scooter-3.0.FS User-agent: ScoutJet User-agent: Scrapy User-agent: Screaming User-agent: ScreenerBot User-agent: Searchestate User-agent: SearchmetricsBot User-agent: searchpreview User-agent: Semrush User-agent: SemrushBot User-agent: SEOkicks User-agent: SEOlyticsCrawler User-agent: Seomoz User-agent: SEOprofiler User-agent: seoscanners User-agent: SEOstats User-agent: sexsearcher User-agent: SeznamBot User-agent: Shodan User-agent: ShopWiki User-agent: SightupBot User-agent: Siphon User-agent: SISTRIX User-agent: Sitebeam User-agent: SiteBot User-agent: SiteExplorer User-agent: Siteimprove User-agent: SiteLockSpider User-agent: SiteSnagger User-agent: SiteSucker User-agent: Site Sucker User-agent: Sitevigil User-agent: Slackbot-LinkExpanding User-agent: SlySearch User-agent: SmartDownload User-agent: SMTBot User-agent: Snake User-agent: Snapbot User-agent: Snooper/b97_01 User-agent: Snoopy User-agent: SocialRankIOBot User-agent: sogouspider User-agent: Sogou web spider User-agent: sootle User-agent: Sosospider User-agent: Sottopop User-agent: SpaceBison User-agent: Spammen User-agent: SpankBot User-agent: Spanner User-agent: Spbot User-agent: Speedy User-agent: Speedy Spider User-agent: Spinn3r User-agent: sproose User-agent: SputnikBot User-agent: Sqlmap User-agent: Sqlworm User-agent: Sqworm User-agent: Steeler User-agent: Stripper User-agent: Sucker User-agent: Sucuri User-agent: suggybot User-agent: SumeetBot User-agent: SuperBot User-agent: SuperBot/2.6 User-agent: SuperHTTP User-agent: Surfbot User-agent: SurveyBot User-agent: Suzuran User-agent: Swiftbot User-agent: sysscan User-agent: Szukacz User-agent: Szukacz/1.4 Disallow: / User-agent: T0PHackTeam User-agent: T8Abot User-agent: tAkeOut User-agent: Teleport User-agent: TeleportPro User-agent: Telesoft User-agent: Telesphoreo User-agent: Telesphorep User-agent: The Intraformant User-agent: TheNomad User-agent: TightTwatBot User-agent: Titan User-agent: Toata User-agent: toCrawl/UrlDispatcher User-agent: Toweyabot User-agent: Tracemyfile User-agent: TrackBack User-agent: True_Robot User-agent: True_Robot/1.0 User-agent: Turingos User-agent: Turnitin User-agent: TurnitinBot User-agent: TwengaBot User-agent: Twice User-agent: Twiceler User-agent: Typhoeus Disallow: / User-agent: UnisterBot User-agent: UrlPouls User-agent: URLy.Warning User-agent: URLy Warning User-agent: URL_Spider_Pro Disallow: / User-agent: Vacuum User-agent: Vagabondo User-agent: VB Project User-agent: VCI User-agent: VCI WebViewer User-agent: VeriCiteCrawler User-agent: VidibleScraper User-agent: Virusdie User-agent: Vivaldi User-agent: VoidEYE User-agent: Voil User-agent: Voltron User-agent: voyager Disallow: / User-agent: Walhello appie User-agent: Wallpapers/3.0 User-agent: WallpapersHD User-agent: WASALive-Bot User-agent: wbdbot User-agent: WBSearchBot User-agent: Webalta User-agent: WebAuto User-agent: Web Auto User-agent: WebBandit User-agent: WebBandit/3.50 User-agent: WebCapture User-agent: WebCollage User-agent: Web Collage User-agent: WebCopier User-agent: WEBDAV User-agent: WebEnhancer User-agent: Web Enhancer User-agent: WebFetch User-agent: Web Fetch User-agent: WebFuck User-agent: Web Fuck User-agent: WebGo IS User-agent: WebImageCollector User-agent: WebLeacher User-agent: Wells Search II User-agent: WebmasterWorldForumBot User-agent: webmeup-crawler User-agent: webmirror User-agent: WebPix User-agent: Web Pix User-agent: WebReaper User-agent: WebSauger User-agent: Web Sauger User-agent: Webshag User-agent: WebsiteExtractor User-agent: WebsiteQuester User-agent: Website Quester User-agent: Webster User-agent: Webster Pro User-agent: WebStripper User-agent: WebSucker User-agent: Web Sucker User-agent: WebWhacker User-agent: WebZIP User-agent: Web Image Collector User-agent: WEP Search 00 User-agent: WeSEE User-agent: Wget User-agent: Whack User-agent: Whacker User-agent: Whatweb User-agent: Who.is Bot User-agent: Widow User-agent: WikioFeedBot User-agent: wikiwix-bot User-agent: wikiwix-bot-3.0 User-agent: WinHTTrack User-agent: WiseGuys Robot User-agent: WISENutbot User-agent: Wonderbot User-agent: Woobot User-agent: Wotbox User-agent: Wprecon User-agent: WPScan User-agent: WWW-Collector-E User-agent: WWW-Mechanize User-agent: WWW::Mechanize User-agent: WWWOFFLE User-agent: wwwster User-agent: Wysigot Disallow: / User-agent: x09Mozilla User-agent: x22Mozilla User-agent: Xaldon_WebSpider User-agent: Xaldon WebSpider User-agent: Xenu User-agent: Xenu's User-agent: Xenu's Link Sleuth User-agent: xpymep1.exe Disallow: / User-agent: yacy User-agent: yacybot User-agent: YodaoBot User-agent: YoudaoBot User-agent: YRSPider Disallow: / User-agent: Zade User-agent: Zao-Crawler User-agent: Zauba User-agent: zauba.io User-agent: Zermelo User-agent: Zeus User-agent: zgrab User-agent: Zitebot User-agent: ZmEu User-agent: Zookabot User-agent: ZumBot User-agent: ZyBorg Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /cache/ Disallow: /class/ Disallow: /include/ Disallow: /install/ Disallow: /kernel/ Disallow: /language/ Disallow: /templates_c/ Disallow: /modules/newbb/post.php Disallow: /modules/newbb/newtopic.php Disallow: /modules/newbb/search.php Disallow: /modules/wordbook/autocomplete.php Disallow: /modules/aquabdd/autocomplete.php Disallow: /search.php