Added running from the script feature.

1372638f · Kyryll Parolis · d223fec9 · 1372638f
Commit 1372638f authored Jun 16, 2020 by Kyryll Parolis
Hide whitespace changes
Inline Side-by-side

Showing with 7 additions and 0 deletions

src/crawl.py src/crawl.py +7 -0

No files found.
--- a/src/crawl.py
+++ b/src/crawl.py
+from scrapy.crawler import CrawlerProcess
+from scrapy.utils.project import get_project_settings
+
+process = CrawlerProcess(get_project_settings())
+
+process.crawl('sitemap')
+process.start()