https://ayyzenn.github.io/tags/selenium/Recent content in Selenium on ayyzennHugo -- 0.163.3en-usSat, 07 Mar 2026 00:00:00 +0000https://ayyzenn.github.io/posts/restful-api-web-scraping-pipelines/Sat, 07 Mar 2026 00:00:00 +0000https://ayyzenn.github.io/posts/restful-api-web-scraping-pipelines/<h2 id="what-this-project-is">What This Project Is</h2> <p>I built a backend that scrapes websites, stores data in PostgreSQL and MongoDB, and exposes REST APIs through FastAPI and Flask. I made it as a portfolio piece — something I could demo and actually run on my machine.</p> <hr> <h2 id="1-what-does-this-project-do-simple-explanation">1. What Does This Project Do? (Simple Explanation)</h2> <p><strong>This project is a data aggregator backend.</strong></p> <p>It can:</p> <ul> <li><strong>Scrape</strong> product or article data from websites</li> <li><strong>Store</strong> that data in two databases (PostgreSQL for structured data, MongoDB for flexible logs)</li> <li><strong>Expose REST APIs</strong> so other apps can create, read, update, and delete data</li> <li><strong>Call external APIs</strong> and return the results</li> </ul> <p>You can think of it as:</p>