Welcome to Todd's freelance profile!
Location and workplace preferences
- Location
- Montpellier, France
- Remote only
- Primarily works remotely
Preferences
- Project length
-
- ≤ 1 week
- ≤ 1 month
- Between 1-3 months
- Between 3-6 months
- ≥ 6 months
- Company size
-
- 1 person
- 2-10 people
- 11 - 49 people
- 50 - 249 people
Verifications
Freelancer code of conduct signed
Read the Malt code of conduct
Languages
Categories
Skills (21)
- BigData
-
Beginner Intermediate Advanced
- Databases
-
Beginner Intermediate Advanced
-
Beginner Intermediate Advanced
- Data Science
-
Beginner Intermediate Advanced
-
Beginner Intermediate Advanced
- Frameworks
-
Beginner Intermediate Advanced
- Operating system
-
Beginner Intermediate Advanced
- All
-
Beginner Intermediate Advanced
Todd in a few words
Experience
Midnite
Tech
Lead Data Engineer
Bidnamic
Data Engineer
• Redesigned the entire source data ingestion process and migrated legacy code to new Google Ads API.
• Researched, recommended and implemented best practice of continuous data quality monitoring in pipelines.
• Designed and implemented a standardised library of reusable and fully unit tested data cleaning utilities.
• Designed and implemented company parquet lake to provide analytics capabilities to the wider business, utilising AWS Athena as the query engine.
• Designed internal tooling and components to standardise data lake and parquet lake file paths to provide integrity to the lake structures and underlying data.
• Independently identified performance bottlenecks and delays, recommended and implemented best practice solutions, including SQL query optimisation and implementation of indexes and other best practices.
• Identified Airflow anti-patterns causing performance bottlenecks and system reliability issues, recommended and implemented best practice solutions.
• Migrated legacy exchange rates codebase to a simple, but powerful internally managed system.
• Provided constructive feedback on PR reviews of colleagues and peers.
• Ensured all work was thoroughly unit tested by using a TDD approach.
graze.com
Data Engineer
• Researched, designed and implemented best-practices for key technologies in the architecture including Azure Data Lake Storage, Databricks Delta Lake, Spark, Data Factory and Azure SQL Data Warehouse
• Identified limitations of Azure services and designed appropriate solutions to achieve business objectives.
• Designed, implemented and maintained over 24 data pipelines, delivering over 100TB of data to data analysts, data scientists and business-oriented end users.
• Worked with the Data Science team to provide clean and timely data, enabling the timely delivery of business objectives.
• Assisted the CTO in key decisions of the overall architecture of the UK Insights Hub.
• Trained, mentored and assisted with junior members of the data engineering and wider data team.
Infectious Media
Data Engineer
• Migrated significant portions of legacy in-house ETL solution to Airflow (GCP Composer).
• Designed and developed integrations to key data sources as reusable Airflow plugins.
• Identified opportunities for and developed custom Airflow operators for use in the ETL pipeline, improving code quality and reducing code duplication.
• Recommended and implemented a company code style guide and development best practices of docstrings, unit testing, general code commenting and commit/pull request messages, resulting in significantly more maintainable and understandable code.
• Recommended and implemented a robust testing framework including unit testing of Airflow operators, as well as the implementation of a staging environment to facilitate streamlined end-to end integration testing.
• Identified and rectified several long-standing bugs, improving data quality and performance of the ETL pipelines
• Mentored junior members of the team and participated in the PR review process, providing valuable technical and business expertise and knowledge to the wider team.
• Participated in the interview and selection process of new data engineering candidates for the team.
Qualis Data
Independent Consultant - As a freelancer
• Replaced an Excel-based MI & BI reporting system by designing and implementing a fully automated and interactive PowerBI Dashboard that unified data from multiple sources, including an on-site SQL Server.
• Consulted on multiple mini-projects to develop PowerBI reports and dashboards for client business, working across industries from the commercial and customer-centric to accounting and financial services.
University of Southern Queensland
Post-Graduate Diploma of Data Science Student
• Gained strong programming capabilities in Python, R and C++; building on existing skills in SQL.
• Studying winning methodologies for Data Analysis, Statistical Analysis, Data Mining and Machine Learning.
• Hands-on developing Advanced Relational Databases and handling Big Data.
• Programmed Visualisations, Dashboards and Reports within data science learning streams.
• Developed a deep understanding of the role of Business Intelligence and Data Science in business success.
MyWorkpapers
Product Manager
• A key influencer within the senior management team and driver of the start up and growth phase.
• Initiated and nurtured a billion-Euro strategic relationship with a European distribution partner.
• Product manager to the MyWorkpapers product lifecycle; project managed upgrades and new modules.
• Owned the post-release product vision including pricing strategy, user training and technical support.
• Business analyst to the product lifecycle, responsible for user stories, requirements and test lifecycles.
• An effective analyst responsible for the capture, analysis and reporting of customer metrics and KPIs.
Crowe Horwath International
Audit Manager
• Instrumental in growing the audit division annual revenue by +30%.
• Achieved 85% of all engagement under budget and on-time to exceed client expectations.
• Gained exposure to accounting, audit and commercial operations and solved tough process problems.
• Utilised MI data to identify weaknesses in the business and plan for change and improvement.
External recommendations
Check out Todd's recommendations