amazon web services - Create dynamic paths in AWS S3 -


i have bunch of files in s3 in following path example:

s3://bucket/date=2016-01-02/2016-01-02_1012_582.txt s3://bucket/date=2016-01-07/2016-01-07_1415_272.txt 

when files put in, partition, in case date, kept simple because quick. now, want partition based on file names.

so, 2 paths these:

s3://bucket/data/date=2016-01-02/a=1012/b=582/2016-01-02_1012_582.txt s3://bucket/data/date=2016-01-07/a=1415/b=272/2016-01-07_1012_272.txt 

is there clever way without reprocessing files? i've looked @ aws cli, doesn't seem part of it.

thanks

you have write script take each file , copy or move them new key.


Comments