Bernardo Casaleiro

Bernardo Casaleiro

Data Engineer in Coimbra

Projects

2020

primeight is a Python package designed to make the powerful NoSQL Cassandra database system easily available to everyone.

Work Experience

2019 — Now
Lisbon
  • Set up and managed a Cassandra cluster of up to 9 nodes and its backup system.
  • Implemented the Primeight Open Source Python package to standardize how people inside Meight interacted with Cassandra.
  • Set up monitoring and analytics for all services using ELK Stack, which led to an API success rate of over 99.5%.
  • Designed and enforced a plan that reduced AWS costs by 65% while improving the uptime of all systems.
  • Implemented and managed multiple ETL pipelines using Apache Airflow.
  • Designed and implemented multiple API services using FastAPI.
2019 — 2020
Lisbon
  • Developed a pipeline to assess the quality of the received data.
  • Implemented a Complex Event Processor using Siddhi to detect and correct driver mistakes in real-time.
  • Implemented an ETL pipeline to detect the beginning and end of Trips automatically.
2017 — 2018
Lisbon
  • Designed and developed the company’s distributed file system.
  • Developed Object Recognition, OCR, and Action Recognition pipelines and respective curation tools.
  • Designed and trained a deep learning model to perform OCR
    using Keras with Tensorflow.
2015 — 2016
Coimbra
  • Full Stack Web Development using Laravel, Node.js, AngularJS and jQuery
  • Worked on an Android application that helps users pick a public transportation route for the city of Coimbra
2013 — 2015
Coimbra
  • Developed a JavaScript library to simplify map creation using Google Maps.
  • Worked on several web development projects, mainly using Wordpress.

Contact

LinkedIn
GitHub