Cloud Data Pipelines and Warehouse Development

About the project

Senior Data Engineer Needed for Cloud Data Pipelines and Data Warehouse We are looking for an experienced Senior Data Engineer to help design, build, improve, and maintain our data platform. The selected freelancer will work with our team to develop reliable data pipelines, integrate multiple data sources, improve data quality, and prepare analytics-ready datasets. Responsibilities: • Design and develop scalable ETL and ELT pipelines • Integrate data from APIs, databases, files, and third-party platforms • Build and optimize data warehouse models • Write efficient Python and SQL code • Configure workflow orchestration, monitoring, logging, and error handling • Troubleshoot pipeline failures and performance issues • Implement data-quality checks and validation processes • Document the architecture, pipelines, and deployment procedures • Communicate progress and technical risks clearly through Freelancer.com Required experience: • Strong professional experience in data engineering • Advanced Python and SQL skills • Experience with ETL and ELT pipeline development • Experience with relational databases and data warehouses • Experience with at least one cloud platform, preferably AWS, Azure, or Google Cloud • Experience with tools such as Airflow, dbt, Spark, Kafka, Snowflake, or Databricks • Strong understanding of data modeling, data quality, and pipeline monitoring • Ability to work independently and deliver production-quality work Initial scope: 1. Review the current data sources and architecture. 2. Recommend an appropriate technical approach. 3. Build or improve the required data pipelines. 4. Add validation, monitoring, and error handling. 5. Provide technical documentation and knowledge transfer. Please include the following in your bid: 1. A brief description of similar data-engineering projects you have completed. 2. The cloud platforms and data tools you have used professionally. 3. An example of a difficult pipeline or performance problem you solved. 4. Your availability and preferred working hours. 5. Your hourly rate or estimated cost based on the proposed approach. Please do not include external contact information in your bid. All communication, files, milestones, and payments will be handled through Freelancer.com. This may become an ongoing engagement for a freelancer who delivers reliable work and communicates consistently.

Skills required