Is a managed scraping API worth it for web scraping api…
0 reactions
Is a managed scraping API worth it for web scraping api and scraper tools, or is it better to build in-house?
Small team, Im the lead and we only need a few thousand pages a week for an ml dataset. Writing the scraper isnt the issue, its proxies, retries, js rendered pages and keeping everything alive after sites change. For this size would you still build in Node or just pay for one of the web scraping tools and avoid the maintenance?
#dev #js #programming #technology
Small team, Im the lead and we only need a few thousand pages a week for an ml dataset. Writing the scraper isnt the issue, its proxies, retries, js rendered pages and keeping everything alive after sites change. For this size would you still build in Node or just pay for one of the web scraping tools and avoid the maintenance?
#dev #js #programming #technology
| 2,000 mlx | |
| 4 | |
| 0 |