Introducing pybgworker — A Lightweight Python Background Worker Without Redis or RabbitMQ

3
calendar_todayschedule1 min read
— Originally published at dev.to

I’ve been working on an open-source project called pybgworker, a lightweight background task worker for Python applications that works without Redis or RabbitMQ, using SQLite instead.

The goal was to make background job processing simple for projects where running extra infrastructure is unnecessary.

✅ Background task execution
✅ Retries & scheduling
✅ Task priorities
✅ Graceful worker shutdown
✅ Crash recovery
✅ Task cancellation
✅ Configurable timeouts
✅ Rate limiting per task
✅ Multiple worker support
✅ No external services required

Example usage:

from pybgworker import task

@task(name="tasks.hello")
def hello(name):
    print("Hello", name)

hello.delay("World")

Run worker:

pybgworker run --app tasks

That’s it — background jobs running.

The package has already crossed ~600 downloads in just 5 days, which was really encouraging, and I’m continuing to improve documentation and features.

I’d love feedback, suggestions, and contributions from the community.

GitHub: Github

PyPI: Pypi

1 Comment

0 votes
🔥 Join developers growing publicly
Share your knowledge, build in public, and grow your developer presence with a global community.

More Posts

I’m a Senior Dev and I’ve Forgotten How to Think Without a Prompt

Karol Modelski - Mar 19

TypeScript Complexity Has Finally Reached the Point of Total Absurdity

Karol Modelski - Apr 23

Dashboard Operasional Armada Rental Mobil dengan Python + FastAPI

Masbadar - Mar 12

The Sovereign Vault — A Comprehensive Guide to Protocol-Driven AI

Ken W. Algerverified - Jun 4

I Wrote a Script to Fix Audible's Unreadable PDF Filenames

snapsynapseverified - Apr 20
chevron_left
131 Points3 Badges
1Posts
0Comments

Related Jobs

View all jobs →

Commenters (This Week)

2 comments
1 comment
1 comment

Contribute meaningful comments to climb the leaderboard and earn badges!