Data Pipeline Engineer at TMP Worldwide

amazon-web-servicespythonetlkafka-consumer-apisql
Published 12 days ago

The programmatic team at TMP is seeking a Data Pipeline Engineer to support building new data products and services.


The Team



  • TMP Programmatic works on data services across the programmatic platform within TMP, and supports building customer-facing data visualization products

  • The team has extensive experience in ETL development and works with large scale data in real time


About the Job



  • Providing technical support for all data pipeline environments

  • Set up, configure, maintain and enhance proper infrastructure to support a large scale data analytics environment

  • Evaluate the technical tradeoffs of every decision

  • Build and maintain ETL pipelines utilizing Python 

  • Work with Cloud Computing Platforms (AWS), Kafka and other open-source technologies

  • Conduct data modeling, schema design, and SQL development

  • Ingest and aggregate data from both internal and external data sources

  • Collaborate with Product Owner and domain experts to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation

  • Assist with the development and review of technical and end user documentation including ETL workflows, research, and data analysis

  • Work with Product team to define data collection and engineering frameworks

  • Responsible for daily integrity checks, performing deployments and releases 

  • Own meaningful parts of our service, have an impact, grow with the company


Desired Technical Qualifications 



  • Excellent and proven knowledge of Python 

  • Excellent and proven knowledge of  SQL

  • Excellent and proven knowledge of streaming technologies, such as Kafka or Kinesis

  • Excellent and proven knowledge of queue-based infrastructures such as AWS SQS, SNS, etc.

  • Good knowledge of the following technologies is a bonus: 

    • Postgres on Amazon RDS

    • Amazon Redshift

    • Docker



  • Proficiency in Git, JIRA, and Teamcity are a plus

  • 2-4+ years in a production environment a plus



Flexible Location (Remote Hubs): 


Berlin, Germany | Lisbon, Portugal | London, England | Paris, France | USA

Apply
👉 Please reference you found the job on Remote People as thank you to us, this helps us get more companies to post here!
When applying for jobs, you should NEVER have to pay to apply.

Are you hiring ?

Post a Job Offer

And reach thousands of people that are willing to work for you

POST A JOB OFFER
now
FREE