At the moment AI and their malicious bots are the scourge of the internet. They ignore all the conventions and implicit rules built on trust over many years. Cloudflare has called out Perplexity on this abuse at Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives. You can also read more on the impact of these bots at The crawl before the fall… of referrals: understanding AI’s impact on content providers. Read more

Wordpress is a very nice publishing platform that is very easy to install and use. Unfortunately with its plugin system it can become very bloated and slow. This site uses ghost. It uses node.js. It is much faster than wordpress, but your typical shared web hosting doesn’t support it. This site runs on a small Google cloud compute engine instance. If you can’t/don’t want to use Google cloud and can’t find a hosting provider that will support node.js you can also try hugo. Hugo generates a static site that you can upload to almost any type of server. Read more