To whitelist the JetOctopus bot in WordPress, you can follow these steps:
Method 1: Using the JetOctopus Plugin
1. Install and Activate the JetOctopus Plugin:
- Go to your WordPress dashboard and navigate to the "Plugins" section.
- Click "Add New" and search for "JetOctopus".
- Install and activate the plugin.
2. Configure the Plugin:
- After activation, navigate to the JetOctopus settings page.
- Enter your JetOctopus API key and other required details.
- Configure the plugin to capture logs from your WordPress site.
Method 2: Using the WordPress Robots.txt File
1. Edit the Robots.txt File:
- Go to your WordPress dashboard and navigate to the "Settings" section.
- Click "Permalinks" and then click "Save Changes".
- This will update the robots.txt file.
2. Add the JetOctopus User Agent:
- Open the robots.txt file in a text editor.
- Add the following lines to whitelist the JetOctopus bot:
txt
User-agent: JetOctopus
Disallow:
Method 3: Using a Security Plugin
1. Install and Activate a Security Plugin:
- Go to your WordPress dashboard and navigate to the "Plugins" section.
- Click "Add New" and search for a security plugin like "Wordfence" or "All in One WP Security".
- Install and activate the plugin.
2. Configure the Security Plugin:
- After activation, navigate to the security plugin settings page.
- Look for the "Whitelist" or "Allowed User Agents" section.
- Add the JetOctopus user agent to the whitelist.
By following these methods, you can ensure that the JetOctopus bot is allowed to crawl your WordPress site without being blocked by security measures.
Citations:[1] https://www.youtube.com/watch?v=sfvgbi5Hf-w
[2] https://stackoverflow.com/questions/20166581/how-to-allow-bots-crawlers-and-only-registered-users-in-wordpress
[3] https://www.g2.com/products/jetoctopus/reviews
[4] https://wordpress.org/support/topic/how-to-whitelist-crawlers/
[5] https://www.saasworthy.com/product-alternative/5080/jetoctopus