Merging overlapping scrape results without double counting: 1,869 rows in, 1,671 out
Most of my scraping jobs don't produce one clean dataset. They produce several that overlap: the same search run with four keywords, the same category page scraped every night, two scrapers pointed at