Everything You Want to Know about TikTokSpider
TikTokSpider is ByteDance's crawler that fetches pages to generate TikTok link previews (Open Graph metadata) in bios, comments, and DMs; distinct from the AI-training crawler Bytespider.
Last verified August 15, 2026 against ByteDance's published crawler docs
Why it's crawling your site
A TikTok user shared a link to your page; TikTokSpider fetched it server-side to build a link preview. It respects robots.txt and does not execute JavaScript.
How TikTokSpider views your website
TikTokSpider fetches raw page HTML (single-page html fetch (og tags), no js rendering) — it does not execute JavaScript. Content that only appears after client-side rendering is invisible to it.
Paste a URL for the rendered-vs-crawled diff, blocked resources, and the sections that never reach the bot.
How to block TikTokSpider
Add the rule below to your site's robots.txt. Most crawlers, including TikTokSpider, check for changes within 24 hours.
User-agent: TikTokSpider
Disallow: /Need the full walkthrough?
Partial blocks, per-directory rules, Cloudflare and server-level options, verification.