Content not loading into Engage

Quick answers

Why are my website pages missing from Engage Indexed pages?

Firewalls and bot protection often return a challenge page instead of your real HTML. Engage then cannot index that content. Allow Scale2Rev crawl traffic per the instructions in your portal crawl errors view, then run a new crawl.

Also asked as: my content isn't loading; pages not in knowledge base.

Cloudflare is blocking Engage from reading my site, what do I do?

Create a firewall or WAF rule that bypasses bot challenges for Scale2Rev crawl traffic. Your Engage portal crawl errors screen lists the exact allow-list token your security team should use.

Also asked as: Cloudflare bot fight mode; Just a moment page.

How do I re-index my site after fixing the firewall?

Open Manage → Websites, select the site, and start a new crawl. When complete, check Manage → Indexed pages for full text previews on the URLs you care about.

Also asked as: re-crawl website; refresh knowledge base.

Can I exclude pages from Engage?

Yes. Use do-not-crawl URL patterns in site crawl settings and turn off individual pages in Manage → Indexed pages when you do not want them used in answers.

Also asked as: hide page from chatbot; disable URL.

Related searches: pages not crawled · knowledge base empty · content not indexed · Cloudflare blocking crawl · team page missing from Engage