RLAbout Ryad Lotfi
Data Engineer with 6+ years building scalable data platforms on Azure, GCP, and on-premises. Expert in ETL/ELT pipelines (Spark, Airflow, Databricks), SQL/NoSQL optimization, and CI/CD-driven DataOps. Proven ability to architect full data infrastructures from scratch and deliver end-to-end solutions across retail, smart cities, and autonomous vehicle industries. Complementary background in Machine Learning and Deep Learning bridges the gap between raw data and real business impact.
French
Native or bilingual
Can work on-site
Paris (up to 50km)
Experience
- ARISTID Retail TechnologyData EngineerJune 2024 - Today (2 years)Paris, France- Designed and built multi-tenant REST APIs (FastAPI/Python) handling bulk data ingestion and search across MongoDB and PostgreSQL for major retail clients (Auchan, Carrefour, Maxeda, BUT)- Architected a data pipeline platform from end-to-end with Apache Airflow orchestrating 10+ ETL workflows processing diverse data sources (SFTP, APIs, CloudFlare, SAP)- Implemented event-driven architecture using RabbitMQ for real-time asynchronous data processing across multiple client environments- Integrated Apache Spark for large-scale data processing, optimizing execution times for high-volume SDO counter computations- Built a multi-client CI/CD system on GitLab enabling on-demand per-client deployments with automated credential generation and infrastructure provisioning- Developed a monitoring platform for Airflow, APIs, and RabbitMQ with Microsoft Teams alerting- Managed database infrastructure: PgBouncer connection pooling, PostgreSQL stored procedures, MongoDB aggregation framework and transactions optimization- Containerized all services with Docker and managed environments from development to production- Built and maintained an internal Python library (arislib) providing unified connectors for MongoDB, PostgreSQL, S3, Elasticsearch, and SFTP- Led international client integrations: Maxeda (Netherlands - Syndigo/SAP), Rona (Canada), and major French retailers
- NHOODData EngineerJanuary 2023 - June 2024 (1 year and 5 months)Lille, France- Establishment of interface contracts to meet various business requirements;- Development of data flows on Azure Data Factory and Azure Databricks to migrate data from +10 subsidiaries worldwide (Luxembourg, Spain, Portugal, etc.).- Participation in the implementation of the Agile methodology;- Initiation of a git repository on AzureDevops and establishment of best practices for branch and code management;- Added CI/CD pipelines in Azure Devops to the project to test, build, and lint each pull request,- Data retrieval from multiple sources: Oracle DB, MySql, Web Scraping, etc.- Data storage on Azure Data Lake Gen 2 ;- Massive data processing using Pyspark and SparkSql on Azure Databricks;- Stream scheduling using VTOM ;- Code Review ;- Handling of production incidents
- Mobile Tech PeopleData scientistOctober 2021 - June 2022 (8 months)Courbevoie, FranceData Scientist at Mobile Tech People. I manage Postgresql databases, create and manage dashboards, develop Deep Learning Models for temperature forecasting, Vehicle and Pedestrian tracking and detection. I also worked on big data by analysing logs using Spark on Python (Pyspark) and lot more.
Recommendations
Be the first to recommend Ryad Lotfi
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Master of ScienceUniversité de Paris2022Master, Data science
- Master 2 (M2), Computer visionUniversité Pierre et Marie Curie2021Master 2 (M2), Computer vision