Metadata-Version: 2.5
Name: jiuqian-scrapy-pipelines
Version: 0.1.1
Summary: Reusable Scrapy item counting and WeCom notification pipeline
Author: jiuqian
License: MIT
License-File: LICENSE
Requires-Python: >=3.10
Requires-Dist: scrapy<3,>=2.11
Provides-Extra: dev
Requires-Dist: build>=1.2; extra == 'dev'
Requires-Dist: twine>=5; extra == 'dev'
Description-Content-Type: text/markdown

# jiuqian-scrapy-pipelines

Reusable Scrapy pipeline for counting items and sending a completion message to a WeCom bot.

## Install

```bash
pip install jiuqian-scrapy-pipelines
```

## Configure

Set the WeCom bot webhook:

```text
WECHAT_WORK_WEBHOOK=https://qyapi.weixin.qq.com/cgi-bin/webhook/send?key=...
```

Register the pipeline in Scrapy settings:

```python
ITEM_PIPELINES = {
    "jiuqian_scrapy_pipelines.pipelines.ItemCountWeComPipeline": 400,
}

```

create `main.py`

crate .env file

```bash
WECHAT_WORK_WEBHOOK=https://qyapi.weixin.qq.com/cgi-bin/webhook/send?key=...

```

```bash
from scrapy.cmdline import execute
import os
from pathlib import Path
from dotenv import load_dotenv
# settings.py 的上一级目录是包目录，再上一级是项目根目录
BASE_DIR = Path(__file__).resolve().parent
load_dotenv(BASE_DIR / ".env")
dirpath = os.path.dirname(os.path.abspath(__file__))
os.chdir(dirpath)
execute(['scrapy', 'crawl', 'spider那么'])

```

