User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: /wp-includes/css/ Allow: /wp-includes/js/ Allow: /wp-content/themes/Divi/