How to prevent known bots heavily crawled (Googlebot, Bingbot, Facebook, Amazonbot, GPTBot, etc.)

We’re getting crawled heavily by known bots (Googlebot, Bingbot, Facebook, Amazonbot, GPTBot, etc.) which can slow down wer server, especially on high-traffic or high-volume sites like wers. Here are several effective strategies to make wer site faster and reduce the load caused by crawlers: ⸻ 🛡️ 1. Rate-Limit or Throttle Bots via Nginx Since we Continue reading “How to prevent known bots heavily crawled (Googlebot, Bingbot, Facebook, Amazonbot, GPTBot, etc.)”

Understanding fastcgi_cache_path, levels, keys_zone, max_size, inactive, use_temp_path

A note for myself to exaplain fastcgi_cache_path, levels, keys_zone, max_size, inactive, use_temp_path As documentation said, nginx will keep all active keys and information about data are stored in a shared memory zone, whose name and size are configured by the keys_zone parameter. As a matter of completeness, lets break down per part /var/cache/nginx is the place where the actual cache stored. Inside the Continue reading “Understanding fastcgi_cache_path, levels, keys_zone, max_size, inactive, use_temp_path”

Remove Query String in Nginx

I’ve removed and uninstall the some plugins, and I would like to prevent it display some error or 404, so I apply this way to nginx.conf redirection. If you want to redirect permanent, then you can use 302.

nginx: [emerg] open() “/usr/local/directadmin/data/users/apache/nginx_php.conf” failed

Upgarding DirectAdmin, and hit with this error. What I found from Google 1.60.1 fixes it (it was backported to 1.60 about an hour ago too, so, those latest releases not affected). It should have affected boxes only with additional free IPs and nginx. I have updated directadmin to latest version 1.61 but still Nginx not Continue reading “nginx: [emerg] open() “/usr/local/directadmin/data/users/apache/nginx_php.conf” failed”