Client project · Jun 2024 to Jan 2025

Multi-source data quality

A seven-month contract to collect, clean, and standardize data from three online platforms.

What I did

  • Collected and prepared data from three platforms using Python.
  • Standardized job roles, experience levels, currencies, and rate types.
  • Found and fixed a serious duplicate-data problem, then added checks to reduce the risk of recurrence.
  • Managed requirements, revisions, delivery notes, and the final documentation directly with the client.

Result

The client received one consistent dataset with more than 140,000 analysis-ready records and a documented workflow for future updates.

The client later used the delivered data foundation to build a freelance pricing model.

View the flow
Data preparation process: collect three sources, standardize fields, check repeated records, and document the handoff.
Application flow
Tools

Python, pandas, Scrapy, Playwright, and Beautiful Soup.

Confidential

Raw datasets, source URLs, delivery files, and supporting documentation are confidential.