BDO Bot Scrapping BDOCODEX

[ayeven]

Hello to admin of BDOCODEX,

As the tile say, I have made bdo bot that used your website data. So the questions arise after I made it, yeah sound silly I know. Questions here;

• Is it legal or allowed?

• Does bdocodex have rate limit. I have limit my scrapping bot so it wont flood the traffic though.

• Here is the bare code git Github Repo

• Here is the bdo bot that uses the script on scrapping Github Repo

You can take a look at the code if it do any harm to bdocodex. Again thank you

[Kiriak]

Sure, you can do it. Just make sure that your bot doesn't hammers the site too much or it'll be blocked by the ddos protection. And use the data caching as much as you can.

[ayeven]

Changed the code already from using pupeteer to axios and using fetch request. So it should not hammering website

[Kiriak]

Nice.

[Experience]

Hi Kiriak! I'm doing a similar thing and was wondering if you're still alright with other folks using your website data. Let me know!

[Kiriak]

Well, in general I don't like it. But it's not like I can do anything about it right? People are still trying to scrape the site several times every week...