The Job

As a Senior Python engineer using PySpark you will be instrumental in shaping our clients data landscape on this critical project by:

• Designing and Implementing Robust Data Pipelines: You'll identify data sources, evaluate data quality, and architect both real-time and batch data ingestion pipelines, then build and deploy them efficiently.
• Crafting API and Data Layer Solutions: You will define essential API endpoints and design effective data layers that meet functional requirements.
• Driving Seamless System Integrations: You'll analyze existing external systems to design scalable micro service architectures, including their development and deployment infrastructure. This involves designing real-time data integrations and planning data migration strategies (e.g., MongoDB to SQL) or proposing alternative data exposure methods.
• Ensuring Data Integrity and Performance: You will develop comprehensive test plans (functional, performance, etc.) and conduct thorough unit testing for all data pipelines and APIs. You'll also play a key role in supporting the broader testing process, triaging issues, and diagnosing bottlenecks.

About you

You will be advances with Python (at least 4 years of heavy use, Be able to demonstrate experience of designing and building mirco-services, have experience of batch and real-time data pipelines and be advanced with SQL. The icing on the cake will be Loading and extracting data from MongoDB

The company

You will be working for a consulting company that prides it's self on high quality outputs and brilliant team. They work in conjunction with a leading software vendor to deliver cutting edge technical solutions to clients around the world. This assignment is for a leading US bank.

What else

As part of this contract you will get a lot of training directly from one of the worlds most respected software houses.

Duration

12 month contract

Rate

$100 per hour

What should you do now

Click the link and send me your Profile showing me your your strong Python skills.