Senior Spark & Python Developer Job at Mavens Guild, McLean, VA

bzNFR2hxZnEyV0xhL01aYldhVkpKaXV3OVE9PQ==
  • Mavens Guild
  • McLean, VA

Job Description

What we would like to see:

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer:

  • Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL

  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools

  • Design and develop automation of data flow tasks and end-to-end process testing

  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems

  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem

  • Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services

What you will need to bring to the table:

  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark

  • 5+ years experience as a Java programmer

  • 3+ years experience programming in Python (PySpark API)

  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3

  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams

  • Experience with continuous integration tools like Jenkins

  • Experience working in a distributed computing infrastructure like Hadoop and/or Spark

  • Critical and analytical approach to solving technical problems 

  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike

Job Tags

Contract work,

Similar Jobs

University of Cincinnati

Research Assistant, Luo Lab, College of Medicine, Department of Molecular & Cellular Biosciences Job at University of Cincinnati

 ...ranks among the nations best urban public research universities. Home to more than 53,600...  ...of patients. A full-time Research Assistant position is available in the laboratory...  ...Comprehensive health coverage (medical, dental, vision, prescription) Flexible spending... 

J.S. Held LLC

Senior Forensic Engineer Job at J.S. Held LLC

 ...Description The Team and Job Summary J.S. Held is seeking a highly experienced and technically accomplished Senior Forensic Engineer to serve as asenior-level contributor within our Forensic Architecture & Engineering practice. This role is ideal for a... 

War Child USA

Fundraising Consultant Job at War Child USA

 ...resilience, self-reliance, and self-determination. War Child USA is globally recognized for our grassroots, community-driven model of humanitarian action thats rooted in collaboration and entirely locally led. We have developed a solid track record of long-term, sustainable... 

Prototek Digital Manufacturing

Production Assistant Job at Prototek Digital Manufacturing

 ...variety of customer end markets, including aerospace, defense, medical, robotics, electronics, consumer, and general industrial....  ...volume production parts in CNC. This may include assisting with 3D printing, casting, and finishing. This position will work closely with... 

Creative Health Care Management (CHCM)

Travel Nurse - Pediatric Intensive Care Unit (PICU) Job at Creative Health Care Management (CHCM)

 ...seeking a dedicated Travel Nurse for the Pediatric Intensive Care Unit (PICU) in East Orange, NJ. Responsibilities include...  ...vital signs, administering medications, and collaborating with healthcare teams to develop and implement care plans. Skills needed include...