Search for a freelancer Post a project

Welcome to Todd's freelance profile!

Malt gives you access to the best freelancers for your projects. Contact Todd to discuss your project or search for other freelancer profiles on Malt.

Todd De Quincey

Lead Data Engineer

Works remotely from Montpellier

  • 43.5985
  • 3.89687
New
Propose a project The project will begin once you accept Todd's quote.
Propose a project The project will begin once you accept Todd's quote.

Location and workplace preferences

Location
Montpellier, France
Remote only
Primarily works remotely

Preferences

Project length
  • ≤ 1 week
  • ≤ 1 month
  • Between 1-3 months
  • Between 3-6 months
  • ≥ 6 months
Company size
  • 1 person
  • 2-10 people
  • 11 - 49 people
  • 50 - 249 people

Verifications

Freelancer code of conduct signed
Read the Malt code of conduct

Verified email

Languages

Categories

Skills (21)

  • BigData
  • Beginner Intermediate Advanced
  • Databases
  • Beginner Intermediate Advanced
  • ETL
    Beginner Intermediate Advanced
  • Data Science
  • Beginner Intermediate Advanced
  • Beginner Intermediate Advanced
  • Frameworks
  • Beginner Intermediate Advanced
  • Operating system
  • Beginner Intermediate Advanced
  • All
  • Beginner Intermediate Advanced

Todd in a few words

A Data Engineer with a robust history in start-up businesses. Highly proficient in Python and SQL, with significant experience in both migrating legacy codebases, as well as implementing greenfield solutions from the ground up using modern best practices and solutions. A proven self-starter with the willingness and ability to independently research and implement best practice solutions. Always willing to learn new skills and take on unknown challenges. Excels in ambitious, entrepreneurial and challenging work environments with a high degree of autonomy.

Experience

Midnite

Tech

Lead Data Engineer

France

April 2022 - Today (2 months)

Lead Data Engineer responsible for the full design and implementation of greenfield data infrastructure
Airflow Python DBT Datawarehouse

Bidnamic

Data Engineer

January 2021 - Today (1 year1 year and 3 months)

Data Engineer working with Python, Airflow, Postgres and AWS to develop a market leading Google Shopping bid optimisation solution.
• Redesigned the entire source data ingestion process and migrated legacy code to new Google Ads API.
• Researched, recommended and implemented best practice of continuous data quality monitoring in pipelines.
• Designed and implemented a standardised library of reusable and fully unit tested data cleaning utilities.
• Designed and implemented company parquet lake to provide analytics capabilities to the wider business, utilising AWS Athena as the query engine.
• Designed internal tooling and components to standardise data lake and parquet lake file paths to provide integrity to the lake structures and underlying data.
• Independently identified performance bottlenecks and delays, recommended and implemented best practice solutions, including SQL query optimisation and implementation of indexes and other best practices.
• Identified Airflow anti-patterns causing performance bottlenecks and system reliability issues, recommended and implemented best practice solutions.
• Migrated legacy exchange rates codebase to a simple, but powerful internally managed system.
• Provided constructive feedback on PR reviews of colleagues and peers.
• Ensured all work was thoroughly unit tested by using a TDD approach.

graze.com

Data Engineer

London, UK

March 2020 - December 2020 (9 months)

Lead Data Engineer responsible for the design, implementation and maintenance of the Unilever UK Insights Hub, an Azure-based big data platform, enabling a shift to a data-driven decision-making process in the UK.
• Researched, designed and implemented best-practices for key technologies in the architecture including Azure Data Lake Storage, Databricks Delta Lake, Spark, Data Factory and Azure SQL Data Warehouse
• Identified limitations of Azure services and designed appropriate solutions to achieve business objectives.
• Designed, implemented and maintained over 24 data pipelines, delivering over 100TB of data to data analysts, data scientists and business-oriented end users.
• Worked with the Data Science team to provide clean and timely data, enabling the timely delivery of business objectives.
• Assisted the CTO in key decisions of the overall architecture of the UK Insights Hub.
• Trained, mentored and assisted with junior members of the data engineering and wider data team.

Infectious Media

Data Engineer

London, UK

August 2019 - March 2020 (7 months)

External recommendations

Check out Todd's recommendations

Education