Less than 1 month –
10-30 hrs/week –
The objective is to compose a list of websites that their homepage code contains specific strings.
This is the first phase in a larger task. We will be glad to hire the successful freelance for future projects.
1. Get a large list of websites from a db table called Websites.
2. Crawl each of these websites home page only. Please note: use a crawling framework / plugin that creates a session or cookies as needed (some sites are not ...