4

Python爬虫-第四章-1-多线程多进程并发爬取Ⅰ

 1 year ago
source link: https://blog.51cto.com/mooreyxia/6008906
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Python爬虫-第四章-1-多线程多进程并发爬取Ⅰ

精选 原创

mooreyxia 2023-01-15 21:19:46 博主文章分类:Python 爬虫 ©著作权

文章标签 多线程 多进程 子进程 文章分类 Python 编程语言 阅读数215

多线程多进程用的方式

# Demo Describe:多线程写法

from threading import Thread # 线程
from multiprocessing import Process # 进程


# start--------1,多线程调用的方式一----------------------
def fun1():
for i in range(100):
print('fun()1,', i)


def fun2():
# 创建线程
t = Thread(target=fun1)
# 开启多线程状态,由CPU决定执行具体时间
t.start()
for i in range(100, 200):
print('fun()2,', i)


# fun2()
# end--------1,多线程调用的方式一----------------------

# start--------2,多线程调用的方式二----------------------
class MyThread(Thread):
def run(self):
for i in range(100):
print('子线程运行,', i)


# if __name__ == '__main__':
# t = MyThread()
# t.start()
# for i in range(100):
# print('main,',i)

# end--------2,多线程调用的方式二----------------------

# start--------3,多进程调用的方式一----------------------
def funProcess1():
for i in range(100):
print('子进程,', i)


# if __name__ == '__main__':
# p = Process(target=funProcess1)
# p.start()
# for i in range(100):
# print('主进程,',i)

# end--------3,多进程调用的方式一----------------------

# start--------4,线程中增加进程练习----------------------
def funProcess2(name):
for i in range(100):
print(name, i)


if __name__ == '__main__':
t1 = Thread(target=funProcess2, args=('进程一',)) # 传参必须是元组
t1.start()

t2 = Thread(target=funProcess2, args=('进程二',))
t2.start()

# end--------4,线程中增加进程练习----------------------


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK