# 구글 바드 User-agent: Google-Extended Disallow: / # 챗GPT User-agent: GPTBot Disallow: / # 챗GPT : 플러그인 차단 User-agent: ChatGPT-User Disallow: / # Common Crawl : AI봇의 교육 목적으로 사용 User-agent: CCBot Disallow: / # Anthropic PBC : 인공지능 스타트업 회사 User-agent: anthropic-ai Disallow: / # omgili,omgilibot : LLM에 훈련데이터 판매 User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / # Facebook : 페이스북의 음성 인식 기술 학습용 User-agent: FacebookBot Disallow: / # Amazonbot Amazon AI Search Crawler User-agent: Amazonbot Disallow: / # OAI-SearchBot OpenAI AI Search Crawler User-agent: OAI-SearchBot Disallow: / # PerplexityBot Perplexity AI Search Crawler User-agent: PerplexityBot Disallow: / # YouBot YouAI AI Search Crawler User-agent: YouBot Disallow: / # Applebot-Extended Apple AI Data Scraper User-agent: Applebot-Extended Disallow: / # Bytespider ByteDance AI Data Scraper User-agent: Bytespider Disallow: / # ClaudeBot Anthropic AI Data Scraper User-agent: ClaudeBot Disallow: / # Diffbot StartX AI Data Scraper User-agent: Diffbot Disallow: / # Meta-ExternalAgent Meta AI Data Scraper User-agent: Meta-ExternalAgent Disallow: / # AI Agent Claude-Web Anthropic N/A User-agent: Claude-Web Disallow: / # Cohere-AI Agent Cohere.ai N/A User-agent: cohere-ai Disallow: / # Ai2Bot Ai2 AI Search Crawler User-agent: Ai2Bot Disallow: / # Ai2Bot-Dolma Ai2 AI Search Crawler User-agent: Ai2Bot-Dolma Disallow: / # FriendlyCrawler Unknown Unknown User-agent: FriendlyCrawler Disallow: / # GoogleOther Google AI Search Crawler User-agent: GoogleOther Disallow: / # GoogleOther-Image Google AI Search Crawler User-agent: GoogleOther-Image Disallow: / # GoogleOther-Video Google AI Search Crawler User-agent: GoogleOther-Video Disallow: / # ICC-Crawler Unknown User-agent: ICC-Crawler Disallow: / # ImagesiftBot Hive AI Data Scraper User-agent: ImagesiftBot Disallow: / # PetalBot Huawei AI Search Crawler User-agent: PetalBot Disallow: / # Scrapy Zyte AI Data Scraper User-agent: Scrapy Disallow: / # Timpibot Timpi AI Data Scraper User-agent: Timpibot Disallow: / # VelenPublicWebCrawler Hunter AI Search Crawler User-agent: VelenPublicWebCrawler Disallow: / # Webzio-Extended Webz.io AI Data Scraper User-agent: Webzio-Extended Disallow: / # DeepSeekBot User-agent: DeepSeekBot Disallow: / User-agent: sistrix Disallow: / User-agent: SISTRIX Crawler Disallow: / User-agent: SISTRIX Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: jobs.de-Robot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: UnisterBot Disallow: / User-agent: DotBot Disallow: / User-agent: dotbot Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SurveyBot Disallow: / User-agent: SEOdiver Disallow: / User-agent: spbot Disallow: / User-agent: wotbox Disallow: / User-agent: meanpathbot Disallow: / User-agent: BacklinkCrawler Disallow: / User-agent: magpie-crawler Disallow: / User-agent: oBot Disallow: / User-agent: fr-crawler Disallow: / User-agent: BLEXBot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: megaindex.com Disallow: / User-agent: CloudServerMarketSpider Disallow: / User-agent: trendictionbot Disallow: / User-agent: Exabot Disallow: / User-agent: careerbot Disallow: / User-agent: Lipperhey-Kaus-Australis Disallow: / User-agent: seoscanners.net Disallow: / User-agent: MetaJobBot Disallow: / User-agent: Spiderbot Disallow: / User-agent: LinkStats Disallow: / User-agent: JobboerseBot Disallow: / User-agent: ICCrawler Disallow: / User-agent: Plista Disallow: / User-agent: Domain Re-Animator Bot Disallow: / User-agent: Lipperhey-Kaus-Australis Disallow: / User-agent: turnitinbot Disallow: / User-agent: coccoc Disallow: / User-agent: um-IC Disallow: / User-agent: mindUpBot Disallow: / User-agent: sg-Orbiter Disallow: / User-agent: CCBot Disallow: / User-agent: Qwantify Disallow: / User-agent: Kraken Disallow: / User-agent: plukkie Disallow: / User-agent: SafeDNSBot Disallow: / User-agent: 360Spider Disallow: / User-agent: HaosouSpider Disallow: / User-agent: rogerbot Disallow: / User-agent: OpenHoseBot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: ThumbSniper Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: ImplisenseBot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: aiHitBot Disallow: / User-agent: trendictionbot Disallow: / User-agent: adscanner Disallow: / User-agent: crawler4j Disallow: / User-agent: WBSearchBot Disallow: / User-agent: Python/3.5 aiohttp Disallow: / User-agent: Toweya.com Disallow: / User-agent: netEstate Disallow: / User-agent: BUbiNG Disallow: / User-agent: Linguee Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: sentibot Disallow: / User-agent: SentiBot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: DomainCrawler Disallow: / User-agent: rogerbot Disallow: / User-agent: IndeedBot Disallow: / User-agent: GarlikCrawler Disallow: / User-agent: Gosign-Security-Crawler Disallow: / User-agent: Siteliner Disallow: / User-agent: SabsimBot Disallow: / User-agent: ltx71 Disallow: / User-agent: bingbot Crawl-delay: 30 User-agent: * Allow:/ Allow: /index.html Allow: /news/newsview.php Allow: /news/newsList.php Disallow: /_libs/ Disallow: /imgdb/ Disallow: /manager/ Disallow: /mypage/ Disallow: /mynews/ Sitemap: https://korean-vibe.com/sitemap.xml