s3fs >> Read & Write files from S3

PHOTO EMBED

Sat Jul 09 2022 11:07:18 GMT+0000 (Coordinated Universal Time)

Saved by @kikoveiga

# Skip to here if you already have setup your environment variables

# File parameters
s3_file = 's3://bucket-name/path/to/file/titanic.csv'

# Import example file
df = pd.read_csv('https://raw.githubusercontent.com/datasciencedojo/datasets/master/titanic.csv')

##### Write file #####
df.to_csv(s3_file)

##### Read file #####
df_s3 = pd.read_csv(s3_file)
content_copyCOPY

https://saagie.zendesk.com/hc/en-us/articles/4407580470034-Read-Write-files-from-S3