Sunday, August 16, 2015

s3 upload large files to amazon using boto

Recently I had to upload large files (more than 10 GB) to amazon s3 using boto. But when I tried to use standard upload function set_contents_from_filename, it was always returning me: ERROR 104 Connection reset by peer.

After quick search I figured out that Amazon does not allow direct upload of files larger than 5GB. In order to upload file greater than 5GB we must use multipart upload, i.e. divide large file into smaller pieces and upload each piece separately. But I didn't want to cut my file phisically because I didn't have much disk space. Luckily there is a great solution - we can use file pointer and set number of bytes we want to upload per time. Below is my function that you can use to upload large files to amazon:

Wednesday, August 12, 2015

How to disable Authentication/Password require on using Modem Manager (Debian Jessie)

I'm using Modem Manager in Debian Jessie and every time when I launch Modem Manager, it requires me to enter admin password:

This is very annoying to enter password on sending/receiving every message. And after quick search I found very simple solution. Below is detailed instruction.