Content not loading into Engage

Quick answers

Why are my website pages missing from Engage Content?

Firewalls and bot protection often return a challenge page instead of your real HTML. Engage then cannot index that content. Allow Scale2Rev crawl traffic per the instructions in your portal crawl errors view, then run a new crawl.

Also asked as: my content isn't loading; pages not in knowledge base.

Cloudflare is blocking Engage from reading my site — what do I do?

Create a firewall or WAF rule that bypasses bot challenges for Scale2Rev crawl traffic. Your Engage portal crawl errors screen lists the exact allow-list token your security team should use.

Also asked as: Cloudflare bot fight mode; Just a moment page.

How do I re-index my site after fixing the firewall?

Open Engage → Sites, select the site, and start a new crawl. When complete, check Engage → Content for full text previews on the URLs you care about.

Also asked as: re-crawl website; refresh knowledge base.

Can I exclude pages from Engage?

Yes. Use do-not-crawl URL patterns in site crawl settings and turn off individual pages in Engage → Content when you do not want them used in answers.

Also asked as: hide page from chatbot; disable URL.

Related searches: pages not crawled · knowledge base empty · content not indexed · Cloudflare blocking crawl · team page missing from Engage