Scrapy Commands

scrapy startproject <project_name>
scrapy genspider <spider_name> <URL>
scrapy crawl <spider_name>
scrapy shell <'URL to scrape'>
	view(response) #Open webpage
    response.xpath('<xpath to test>') #test scrapy code below
       all_titles = response.xpath('//td[@class="titleColumn"]')
       first_title = all_titles[0]
       first_title.xpath('.//a/text()')
scrapy crawl <spider_name> -o <'file_name.csv'>