hhmx.de

· Föderation EN Do 17.10.2024 19:22:48

@andre_601 Pages suffer from crawling a lot recently. It's much harder to control than on Codeberg, because fine-tuning robots.txt is out of our control, and detecting abusive patterns is unique to each website.

We are thinking about solutions. ~f

Föderation EN So 20.10.2024 23:17:47

@Codeberg Any suggestions for defining a robot.txt that would work best with codeberg pages?