Python multiprocessing: Permission denied

Viewed 46799

I'm getting an error when trying to execute python program that uses multiprocessing package:

  File "/usr/local/lib/python2.6/multiprocessing/__init__.py", line 178, in RLock
    return RLock()
  File "/usr/local/lib/python2.6/multiprocessing/synchronize.py", line 142, in __init__
    SemLock.__init__(self, RECURSIVE_MUTEX, 1, 1)
  File "/usr/local/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__
    sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
OSError: [Errno 13] Permission denied

It looks like the user doesn't have permission to access shared memory. When executing with root privileges it works fine.

Is there any solution to run it as normal user(not root)?

Python version 2.6.2 , OS is Linux 2.6.18 (CentOS release 5.4) and it's VPS machine.

4 Answers

For POSIX semaphores to work, the users need r/w access to shared memory (/dev/shm).

Check the permissions to /dev/shm. On my laptop (Ubuntu) it looks like this:

$ ls -ld /dev/shm
drwxrwxrwt 2 root root          40 2010-01-05 20:34 shm

To permanently set the correct permissions (even after a reboot), add the following to your /etc/fstab:

none /dev/shm tmpfs rw,nosuid,nodev,noexec 0 0

Haven't tried this, just copied from a forum post.

One simple solution without rebooting is

sudo chmod 777 /dev/shm

That solved my problem.

I tried all the recommendations related to chmod and shm, but in my case the solution was:

Using conda navigator:

  • In base-environment run (in order to see the navigator):
    $ anaconda-navigator
    
  • Create a new conda environment: from the button CREATE in the navigator
  • Select the new environment with your mouse
  • Install "notebook": Install it from anaconda-navigator in the new environment

Using command line:

  • Create a new anaconda enviroment (enviroment name "my_new_env"):
    $ conda create --name my_new_env
    
  • Enter to my_new_env:
    $ conda activate my_new_env
    
  • Install Jupyter notebook:
    $ conda install jupyter-core (OR $ conda install notebook)
    

As a summary, don't use snap to install Jupyter notebook.

Related