utils for streaming large files

 smart-open is a library for efficient streaming of very large files
 from/to storages such as HDFS, WebHDFS, HTTP, HTTPS, SFTP, or local
 filesystem. It supports transparent, on-the-fly (de-)compression for a
 variety of different formats (gzip, bz2, etc.).
 .
 This package excludes the support of S3 and GCS.