多处理取决于核心数。在你的例子中,线程是你所需要的,线程最简单的接口是ThreadPool。例如。:
from multiprocessing.pool import ThreadPool
threads_count = 10
pool = ThreadPool(threads_count)
def do_job(url)
return requests.get(url)
urls = ['url1', 'url2']
pool.map(do_job, urls)
pool.close()
pool.join()
