Study scrapy on windows

Enviroment

• Windows 10
• Python 3.7.3
• Scrapy 1.7.3

Install scrapy

Add pip install source to speed up install process.

1. Add folder “pip” in %APPDATA% folder.
2. Create a file “pip.ini” in the “pip” folder, the content of this file as follows.

[global]
index-url=http://mirrors.aliyun.com/pypi/simple/ 
[install]
trusted-host=mirrors.aliyun.com

Run “cmd.exe” with administrator privilege. And run the following command to upgrade pip to the latest version.

pip install --upgrade pip

Install scrapy with pip by the following command.

pip install Scrapy

Next I will learn how to use scrapy. Coming soon …