Serverless Web Scraping

1. Introduction I have past the last several years learning about the data science field as well as software development techniques.

A message Producer for Scrapy Pipeline

1. Introduction Querido Diário is one of the most promising open-source projects that aim to contribute with government transparency and aim to integrate several government gazettes in a way that information could be machine-readable.

Analyzing Pipelines Performance

1. Introduction As well known scrapy is one the most popular frameworks for web scraping regardless of the programming language.