I am a Software Engineer from India. I am currently building Daestro. I work in Rust, Javascript and Python. Zola 2025-03-18T00:00:00+00:00 https://vshukla.com/tags/s3/atom.xml 2025-03-18T00:00:00+00:00 2025-03-18T00:00:00+00:00 Vivek Shukla https://vshukla.com/snippets/gzip-and-s3-upload/

Compress files using gzip and upload to S3

<pre class="giallo z-code"><code data-lang="shellscript"><span class="giallo-l"><span class="z-comment">#!/bin/bash</span></span> <span class="giallo-l"></span> <span class="giallo-l"><span class="z-support z-function">cd</span><span class="z-string"> /path/to/parent/directory/of/project</span></span> <span class="giallo-l"></span> <span class="giallo-l"><span class="z-variable">directory</span><span class="z-keyword z-operator">=</span><span class="z-string">&quot;your_dir&quot;</span></span> <span class="giallo-l"><span class="z-variable">bucket</span><span class="z-keyword z-operator">=</span><span class="z-string">&quot;your_bucket&quot;</span></span> <span class="giallo-l"><span class="z-comment"># no change needed from here</span></span> <span class="giallo-l"></span> <span class="giallo-l"><span class="z-variable">suffix</span><span class="z-keyword z-operator">=</span><span>$(</span><span class="z-entity z-name">date</span><span class="z-string"> +&quot;%Y%m%d%H%M%S&quot;</span><span>)</span></span> <span class="giallo-l"><span class="z-variable">filename</span><span class="z-keyword z-operator">=</span><span class="z-variable">$directory</span><span class="z-string">&quot;_&quot;</span><span class="z-variable">$suffix</span><span class="z-string">&quot;.tar.gz&quot;</span></span> <span class="giallo-l"></span> <span class="giallo-l"><span class="z-entity z-name">tar</span><span class="z-constant z-other"> -czf</span><span class="z-variable"> $filename $directory</span></span> <span class="giallo-l"><span class="z-entity z-name">aws</span><span class="z-string"> s3 cp</span><span class="z-variable"> $filename</span><span class="z-string"> s3://</span><span class="z-variable">$bucket</span></span> <span class="giallo-l"><span class="z-entity z-name">rm</span><span class="z-variable"> $filename</span></span> <span class="giallo-l"></span> <span class="giallo-l"><span class="z-comment"># extracting</span></span> <span class="giallo-l"><span class="z-comment"># tar -xzf filename.tar.gz -C dir</span></span></code></pre>