# Robots.txt file # Description: Classes, Courses, Lessons & Teachers User-agent: * Disallow: / Disallow: /search Crawl-Delay: 4 User-agent: Bingbot User-agent: MSNBot User-agent: BingPreview User-agent: Slurp User-agent: Mail.Ru User-agent: YandexBot User-agent: YandexMedia User-agent: YandexImages User-agent: YandexCatalog User-agent: YaDirectFetcher User-agent: YandexBlogs User-agent: YandexNews User-agent: YandexPagechecker User-agent: YandexMetrika User-agent: YandexMarket User-agent: YandexCalendar User-agent: Googlebot-News User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Googlebot-Mobile User-agent: Googlebot Disallow: Disallow: /no-robots Disallow: /api Disallow: /cors/ Disallow: /xdc.html Disallow: /xdc/ Disallow: /www. Disallow: /login-or-register Disallow: /logout Disallow: /accounts/login Disallow: /sign-in.html Disallow: /my/ Disallow: /me/ Disallow: /api/ Disallow: /xdc/ Disallow: /page/ Disallow: /happening/enroll Disallow: /user/message Disallow: /register- Disallow: /register/ Disallow: /forum/new-topic Disallow: /schools/forum/new-topic Disallow: /forum/create-topic Disallow: /forum/reply Disallow: /whats-on/events/add Disallow: /offer/dialog Disallow: /set-language- Disallow: /wanted/dialog/ Disallow: /common/dialog/ Disallow: /d2nr4gpzcz9v7c. Disallow: /d15jsi2slmx0yx. Disallow: /d2m7ftr6nrjy8g. Disallow: /iwtl/created Disallow: /iwtl/updated Disallow: /es/ Disallow: /en/ Disallow: /ru/ Disallow: /it/ Disallow: /pt/ Disallow: /logout2 #this are temporary (typos in URLs) Disallow: /registger- User-agent: * Disallow: /no-robots Disallow: /api Disallow: /cors/ Disallow: /xdc.html Disallow: /xdc/ Disallow: /www. Disallow: /login-or-register Disallow: /logout Disallow: /accounts/login Disallow: /sign-in.html Disallow: /my/ Disallow: /me/ Disallow: /api/ Disallow: /xdc/ Disallow: /page/ Disallow: /happening/enroll Disallow: /user/message Disallow: /register- Disallow: /register/ Disallow: /forum/new-topic Disallow: /schools/forum/new-topic Disallow: /forum/create-topic Disallow: /forum/reply Disallow: /whats-on/events/add Disallow: /offer/dialog Disallow: /set-language- Disallow: /wanted/dialog/ Disallow: /common/dialog/ Disallow: /d2nr4gpzcz9v7c. Disallow: /d15jsi2slmx0yx. Disallow: /d2m7ftr6nrjy8g. Disallow: /iwtl/created Disallow: /iwtl/updated Disallow: /logout2 Disallow: /es/ Disallow: /en/ Disallow: /ru/ Disallow: /it/ Disallow: /pt/ #this are temporary (typos in URLs) Disallow: /registger- user-agent: AhrefsBot User-agent: WBSearchBot User-agent: MJ12bot User-agent: bl.uk_lddc_bot User-agent: TurnitinBot User-agent: SEOkicks-Robot User-agent: Exabot User-agent: awcheckBot User-agent: TurnitinBot User-agent: Sogou # http://www.wotbox.com/bot/ User-agent: wotbox # http://webmeup-crawler.com/ User-agent: BLEXBot # http://www.brandwatch.net User-agent: magpie-crawler User-agent: SemrushBot User-agent: spbot User-agent: XoviBot User-agent: sistrix User-agent: MojeekBot User-agent: grapeshot User-agent: dotbot User-agent: CCBot User-agent: CrazyWebCrawler-Spider Disallow: / # Ads crawlers User-agent: Mediapartners-Google User-agent: AdsBot-Google User-agent: Adidxbot Disallow: # 2841531d181a4172bf28d379babc8281 # http://www.myclasses.co/ # http://www.myclasses.co/