v0.105.0 — 100+ Production Steps

Ready-to-Use
Pipeline Steps

A comprehensive library of modular components for the wpipe orchestration engine. Stop reinventing the wheel. Import, configure, and run.

Install via PyPI GitHub

100+

Pre-built Steps

8

Step Packs

Sync/Async

Dual Support

100%

wpipe Compatible

Why wpipe-steps?

Productivity Meets Reliability

Don't waste time writing boilerplate for common tasks. Use professional, tested steps.

Zero Config

Most steps work out of the box with sensible defaults. Just import and add to your pipeline.

Sync & Async

Every step comes in both Synchronous and Asynchronous versions to fit your concurrency needs.

Database Ready

Full support for Redis, MySQL, MongoDB, SQLite, ClickHouse, and Cassandra.

Security First

Built-in WAF filtering, Hash generation, and Vault integration for secure pipelines.

Cloud Native

Steps for AWS S3, Docker, Kubernetes, Terraform, Proxmox, and DigitalOcean.

wpipe Native

Designed exclusively for wpipe. Inherits all resilience and checkpointing features.

Available Packs

Explore the Inventory

Organized by functionality. Check the README for the full table with imports and examples.

Connectivity

HTTP, GraphQL, Webhooks, SFTP, RSS, OAuth2.

  • http_request
  • graphql_query
  • webhook_trigger
  • sftp_transfer

Database

MySQL, MongoDB, SQLite, ClickHouse, Cassandra.

  • mysql_query
  • mongo_insert
  • sqlite_audit
  • redis (12 modules)

Security

Fail2Ban, Nmap, Shodan, Hash, Vault, WAF.

  • fail2ban_check
  • nmap_scan
  • waf_filter
  • hash_generator

Infrastructure

S3, Docker, Kubernetes, Terraform, Proxmox.

  • s3_upload
  • docker_container
  • kubernetes_pod_check
  • terraform_apply

HuggingFace (50 Steps)

100% local, no API key required. Text, Audio, Vision, Multimodal.

  • text_classification
  • sentiment_analysis
  • automatic_speech_recognition
  • image_classification
  • video_classification

Communication

Telegram, Slack, Discord, SendGrid, Twilio.

  • telegram_notify
  • slack_alert
  • sendgrid_email
  • twilio_sms

And More...

Data processing, Multimedia, AI, and System tools.

  • CSV/JSON/PDF/Excel
  • Audio/Image Processing
  • 50 HuggingFace Steps (Local)
  • Shell/Resource Mon
View Full Inventory in README
Simple Integration

Import & Run

Since wpipe-steps inherits from wpipe.BaseStep, integration is seamless. Just import your step and add it to the pipeline.

  • Pre-built logic, zero boilerplate
  • Automatic retries and error handling
  • Full async support included
# Install: pip install wpipe-steps

from wpipe import Pipeline
from wpipe_steps.connectivity import HttpRequestStep

# Create pipeline with pre-built steps
pipe = Pipeline(pipeline_name="my_api_call")
pipe.set_steps([
    HttpRequestStep.as_step(
        name="fetch_data",
        url="https://api.example.com"
    )
])

result = pipe.run({})
Wisrovi

Part of the Wisrovi Ecosystem

wpipe-steps is designed to work seamlessly with wpipe and other Wisrovi libraries (wredis, wmysql, wmongo, etc.) to create a complete enterprise-grade data processing suite.

Visit wisrovi.dev

Ready to boost productivity?

Install via PyPI Star on GitHub