read csv file

Question

Hi

I can get a URL for a error report. the url likes this

https://domain/files/userid/errors2018-10-13+04%3A34%3A03+UTC20181013-17095-16eso8l.csv

How can I read this csv in python. Can I use request too?

thanks

li

unknown · Answer

I was able to read the report CSVs without saving them to a file. Here's what I did: import csv
import io

import requests

# Assuming you already got the download link from somewhere else
download_link = 'asdf'

# The download link saves the CSV into memory
response = requests.get(url=download_link)
# Raise errors if any occurred
response.raise_for_status()

# Use StringIO to process the CSV contents since we're not working with a file
# Cast the DictReader as a list so you can iterate over it more than once
data = list(csv.DictReader(io.StringIO(response.text)))‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

dgrobani · Answer

julielkz, I'm not certain, but I don't think you can read the file without first downloading it. You should be able to do that like this, including your token as carroll-ccsd‌ indicated: auth_header = {'Authorization': 'Bearer {}'.format(token)}
content = requests.get(file_url, headers=auth_header).content
with open(output_file_name, 'wb') as file:
file.write(content)‍‍‍‍

julielkz · Answer

Hi Robert,

i use this https://domain/api/v1/accounts/account_id/sis_imports

from there I can find 'url' for downloading the report , for example, the url can be

https://domain/files/userid/download?11330000005243390_processing_warnings_and_errors2018-10-13+04%3A34%3A03+UTC20181013-17095-16eso8l.csv

I want to open this csv, and read data from it.

I use python. Hope this helps

thanks

li