Publication at Faculty of Mathematics and Physics |
2012
Abstract
In this paper, we introduce a new approach to semantic Web crawling. We propose a scalable framework for semantic data crawling that works as a service.
Users can post their crawling requests via a RESTful API, the requests are processed on a scalable Hadoop cluster and aggregated results are returned in the desired format.