piskvorky/smart_open: Utils for streaming large files (S3, HDFS, gzip, bz2...)

PHOTO EMBED

Sat Aug 03 2024 13:39:36 GMT+0000 (Coordinated Universal Time)

Saved by @Shook87

s3://my_bucket/my_key
s3://my_key:my_secret@my_bucket/my_key
s3://my_key:my_secret@my_server:my_port@my_bucket/my_key
gs://my_bucket/my_blob
azure://my_bucket/my_blob
hdfs:///path/file
hdfs://path/file
webhdfs://host:port/path/file
./local/path/file
~/local/path/file
local/path/file
./local/path/file.gz
file:///home/user/file
file:///home/user/file.bz2
[ssh|scp|sftp]://username@host//path/file
[ssh|scp|sftp]://username@host/path/file
[ssh|scp|sftp]://username:password@host/path/file
content_copyCOPY

https://github.com/piskvorky/smart_open