Work Experience
-
Designed and implemented frameworks for scalable regulatory reporting using Python and Celery
-
Collaborated with stakeholders to ensure compliance with local regulations in multiple countries
-
Improved reporting accuracy and efficiency through optimized SQL queries and robust ETL pipelines
-
Acted as the functional manager of 4 engineers, providing technical guidance, mentoring, and ensuring alignment with project goals and company standards
-
Set up and managed a 9-node Cassandra cluster with backups for reliability and data integrity
-
Developed Primeight, an open-source Python library, standardizing how Meight engineers interact with Cassandra
-
Designed and enforced a plan that reduced AWS costs by 65% while improving the uptime of all systems.
-
Built and maintained multiple ETL pipelines using Apache Airflow, streamlining data processing workflows
-
Designed and deployed RESTful API services using FastAPI, integrating ELK Stack monitoring and analytics to achieve an API success rate of over 99.5%
- Created a pipeline to assess and improve the quality of incoming data, ensuring reliable analytics
- Developed a Complex Event Processor using Siddhi, enabling real-time detection and correction of driver mistakes
- Designed and implemented an ETL pipeline to automate trip segmentation
- Designed and developed a distributed file system to handle large-scale data processing needs
- Built pipelines for Object Recognition, OCR, and Action Recognition, along with tools to curate datasets for training and validation
- Designed and trained a deep learning model for OCR using Keras and TensorFlow
- Full Stack Web Development using Laravel, Node.js, AngularJS and jQuery
- Worked on an Android application that helps users pick a public transportation route for the city of Coimbra
- Developed a JavaScript library to simplify map creation using Google Maps.
- Worked on several web development projects, mainly using Wordpress.