Can I run multiprocess of subprocesses in python?

Yiffany 0
Viewed 18

I want to process data faster with the JAVA base machine learning app: MOA, so I split my data into many small batches, so the input =[[a,b,c],[d,e,f],...]. for each input I want to process them parallel. Can I use multiprocess's Pool for that?

def batch_process(input):
    ...some pandas processing
    // p = Pool(1000)
    // map to subprocess, can I do that??
    subprocess.run(...)
...
parallel-processing python-3.x python
1 Answers
import threading
def batch_process(input):
    ...some pandas processing
    // p = Pool(1000)
    // map to subprocess, can I do that??    
    t1 = threading.Thread(target=subprocess, args=(10,))
    # starting thread 1
     t1.start()
     ...
Henro Sutrisno Tanjung0
Related