How to auto-upload an image from django app to aws s3

user_12828566 0
Viewed 1191

When a user creates or registers for a new account on my website, an image is created(generated) and is supposed to be uploaded to the s3 bucket. The image is successfully created(verified by running the ls command on the server in the media directory) but it's not getting uploaded to s3. However, when I try uploading an image for a user account from the admin panel, changes are correctly reflected in s3 (i.e newly uploaded image from admin panel is shown in s3 bucket's directory, but this is not feasible as the users cannot be given admin panel access). I aim to auto-upload the generated image to the s3 bucket when a new account is created.
Here's some related code. views.py

def signup(request):

    if request.method == "POST":
        base_form = UserForm(data=request.POST)
        addnl_form = AddnlForm(data=request.POST)

        if base_form.is_valid() and addnl_form.is_valid():

            usrnm = base_form.cleaned_data['username']
           
            if UserModel.objects.filter(user__username=usrnm).count()==0:
                user = base_form.save()
            user.set_password(user.password)
            user.save()

            #print(img)

            addnl = addnl_form.save(commit=False )
            addnl.user = user
            
            
            
            img = qr.make_image()  #create a qr code image, full code not included.
            img.save('media/qrcodes/%s.png'%usrnm)
           
                
            addnl.qr_gen = 'qrcodes/%s.png'%usrnm
            addnl.save()

        
        else:
            messages.error(request,base_form.errors,addnl_form.errors)
    else:
        base_form = UserForm()
        addnl_form = AddnlForm()
    
    return render(request,'app/signup.html',{'base_form':base_form,'addnl_form':addnl_form} )

models.py

class UserModel(models.Model):
   .
   .
   .
   qr_gen = models.ImageField(upload_to='qrcodes',default=None,null=True,blank=True)

settings.py

DEFAULT_FILE_STORAGE = 'project.storage_backend.MediaStorage'

storage_backend.py

from storages.backends.s3boto3 import S3Boto3Storage


class MediaStorage(S3Boto3Storage):
    location = 'media'
    default_acl = 'public-read'
    file_overwrite = False

UPDATE
Instead of auto-generating, an image and uploading it to s3, if I upload any image in the registration form, even in that case it's successfully uploading to s3, the only case where it fails is when I need to auto-upload without user intervention.
Please help me solve this problem. Thank you.

amazon-web-services amazon-s3 image django python
3 Answers

I would recommend taking a look at django-storages which automates all of this so you should only worry about the form and the view instead of anything else. In there you will find help on how to deal with images easily.

user_20886990

Instead of globally setting media storage settng, set it on the field

class UserModel(models.Model):
    ...
    qr_gen = models.ImageField(upload_to='qrcodes',storage=MediaStorage())
user_57836080

Auto uploading an image directly to s3 requires one to directly communicate with S3's backend API. Plainly using django-storages or tweaking DEFAULT_FILE_STORAGE path isn't just enough as it only helps to point user-uploaded files to the specified s3 bucket/path. This problem can be tackled using the boto3 library's upload_file method.
Usage example:

import boto3
s3 = boto3.resource('s3')
s3.Bucket('mybucket').upload_file('/tmp/hello.txt', 'hello.txt')

Params:

Filename (str) -- The path to the file to upload.
Key (str) -- The name of the key to upload to.
ExtraArgs (dict) -- Extra arguments that may be passed to the client operation.
Callback (function) -- A method which takes a number of bytes transferred to be periodically called during the upload.
user_128285660
Related