@matthiasott@mastodon.social I only heard stories until this week, when I was hit. I have a pet project that's fetching a lot of data and is a bit slow, but perfectly fine for human use. However, I suddenly had both Baidu and Meta's crawlers loading several pages at once, slowing everything down dramatically. Blocking both bots from that section of my site with robots.txt solved the problem... at least for now!