SWGT.io Web Scraper
A utility scraper for Summoners War monster images
Repository: https://github.com/NedkoChulev/swgt-scraper
Project lifespan: 2025-02-11 - 2025-02-16
Key Contributions
Built a Puppeteer-based web scraper
Automated a 4-stage pipeline
Used n8n for scheduling scraper tasks
Dockerized the scraper for ease of deployment
Case study
I built this tool as a backend companion for Toky Boy, my Telegram bot. The goal was to automatically maintain a local library of monster images from swgt.io, ready for use as stickers.
The scraper follows a 4-step process:
- Scrape: Collects image URLs from the monster listing page.
- Validate: Compares the latest scrape to previous data to detect changes.
- Download: Updates the image library when new monsters appear.
- Convert: Transforms PNGs into WebP format for Telegram compatibility.
This system runs autonomously via n8n workflows on my homelab and is fully Dockerized for consistency and portability.
While overkill for its use case, this project gave me valuable experience in building modular automation pipelines, working with headless browsers, and deploying utilities that tie into broader bot ecosystems.