• 0 Posts
  • 146 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle

  • TBF, pushing a site to the public while adding a “no scrapping” rule is a bit of a shitty practice; and pushing it and adding a “no scrapping, unless you are Google” is a giant shitty practice.

    Rules for politely scrapping the site are fine. But then, there will be always people that disobey those, so you must also actively enforce those rules too. So I’m not sure robots.txt is really useful at all.














  • All I know is that one of them has a /v2/ subpath on its URL, and the other has nothing.

    Oh, and calls work in Firefox one the /v2/ one. That’s an important difference.

    What I really don’t know is why they kept pestering me for months to make sure my browser supports the new version (where they know what my browser is, and only published enough requirements to tell IE won’t work) while they only changed stuff that makes it work better on it.