Set additional headers using --header-upload and --header-download

[pquerna]

For example if your s3 bucket is being served behind CloudFront, it is common to set Cache-Control: max-age=300,public to reduce cache TTL, or setting Content-Encoding: gzip for pre-compressed files.

s3cmd has the --add-header parameters for this purpose

Backends which have and haven't got support for --header-upload and --header-download

Backends which are crossed out are not HTTP based and can't support the feature

• alias
• amazonclouddrive
• azureblob
• b2
• box
• cache
• chunker
• crypt
• drive
• dropbox
• fichier
• ftp
• googlecloudstorage
• googlephotos
• http
• hubic
• jottacloud
• koofr
• local
• mailru
• mega
• memory
• onedrive
• opendrive
• pcloud
• premiumizeme
• putio
• qingstor
• s3
• sftp
• sharefile
• sugarsync
• swift
• union
• webdav
• yandex

[ncw]

I see. Wouldn't be too hard! I'd probably make an --add-header flag which all the remote storage systems could use not just s3.

Thanks for the suggestion.

[schickling]

+1

[ncw]

NB this additional header only wants to be set on the operation that actually uploaded the file - not on all the other operations (eg listing directories etc)

[nodughere]

Agreed.

The headers should be a dictionary.

Example rclone with Swift
rclone --add-header={'x-meta-object-my-favorite-car':'ford mustang', 'X-Delete-After': 3600} copy /home/doug/data/ SwiftCluster:container

This command would add metadata and allow objects to auto delete in 1 hour as an example

Example rclone with S3
rclone --add-header={'x-amz-meta-my-favorite-car':'ford mustang'} copy /home/doug/data/ S3Cluster:bucket

[wouterv]

I have a suggestion for local file system copy actions:

What whould help with backups is to have an additional header file next to the actual file with key=value file, or a json file containing the meta data.

And with that to use those files when uploading to a cloud provider.

Perhaps with an extra option --copy-headers=true --head-file-extension=.header or something for both copying from/to a local file system.

[treyd]

+1 for this request, although I would like the additional header to also be set on all requests. The reason behind this is there is some middleware in Swift that uses headers to control functionality, and it would be great if we can have rclone do this as well

[ncw]

I'm all in favour of a general purpose option to add headers... Anyone fancy sending in a PR?

[fortunto2]

I'm sorry, but when the scheduled implementation?