User-agent: * Disallow: /font/ Disallow: /go/ Disallow: /unsubscribe/ Disallow: /api/ Disallow: /settings/ User-agent: MJ12bot Disallow: / User-agent: NAVER Disallow: / user-agent: AhrefsBot disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: /