CAP crawler – python crawler

The project was created for research purposes to collect structured and unstructured data from the web. Collected data is stored in Cassandra for scaling purposes and to increase IO. The project is available on Github, clone it 🙂   Features Shared crawl execution...