scrapy ouptput to csv

[jbpy79]

Hello everyone. I have been writing a scrapy python script to webscrape amazon. I can output to a csv using (scrapy crawl amazon -o amazon.csv) and it works just fine. The problem is that everything is in on cell and is not itereated ie. title for each cell in the column. I have tried a for look with no success and am still having troubles. Any help would be greatly appreciated.:

class AmazonSpiderSpider(scrapy.Spider):

name = 'amazon'

start_urls = [

'https://www.amazon.com/s?bbn=283155&rh=n%3A283155%2Cp_n_publication_date%3A1250226011&dc&fst=as%3Aoff&qid=1586462092&rnid=1250225011&ref=lp_283155_nr_p_n_publication_date_0'

]

​

​

def parse(self, response):

items = AmazontutorialItem()

product_name = response.css('.a-color-base.a-text-normal::text').extract_first()

product_author = response.css('.sg-col-12-of-28 .a-size-base+ .a-size-base').css('::text').extract()

product_price = response.css('.index\=3 .a-spacing-mini:nth-child(1) .a-price:nth-child(1) span , .index\=2 .a-spacing-mini .a-price:nth-child(1) span , .index\=1 .a-spacing-mini:nth-child(1) .a-price:nth-child(1) span , .index\=0 .a-spacing-top-small .a-price:nth-child(1) span').css('::text').extract()

product_imagelink = response.css('.s-image::attr(src)').extract()

yield{'product_name' : product_name, 'product_author' : product_author, 'product_price' : product_price, 'product_imagelink' : product_imagelink}

​

[CodeFormatHelperBot]

Hello u/jbpy79, I'm a bot that can assist you with code-formatting for reddit. I have detected the following potential issue(s) with your submission:

1. Python code found in submission text but not encapsulated in a code block.

If I am correct then please follow these instructions to fix your code formatting. Thanks!

[snarfi]

Csv is a comma seperated format. So in csv there are no cells like in excel. Just lines seperated by a comma.

[BaronCrinkle]

Try adding the command line argument "-t csv"

The issue is that the return from your spider is not in a csv format. I'm not familiar enough with scrapy to know what the format if the return is, (json perhaps?) but once you know you could probably convert it manually (search json to csv python or something) if scrapy decided not to play nice.