Senior Python Spark Engineer, Mastercard

Salary not provided
SQL
AWS
Python
Kafka
Hadoop
Azure
Spark
RabbitMQ
Hive
Git
Unix
Mid and Senior level
Dublin
Mastercard

Global payments technology company

Open for applications

Mastercard

Global payments technology company

1001+ employees

FintechB2CB2BBankingPaymentsCredit cards

Open for applications

Salary not provided
SQL
AWS
Python
Kafka
Hadoop
Azure
Spark
RabbitMQ
Hive
Git
Unix
Mid and Senior level
Dublin

1001+ employees

FintechB2CB2BBankingPaymentsCredit cards

Company mission

To connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible.

Role

Who you are

  • As engineering culture is important to us, a great candidate will be intellectually curious and honest, passionate and hungry to expand his skills, and a great team player with a high sense of ownership of the delivered software, while developing high-quality team-oriented solutions to complex software engineering problems
  • 4-6 years’ experience working in software application development as a programmer
  • Strong and solid knowledge of software engineering principles and practices. University degree in Computer Science or equivalent is a MUST. Advanced degree preferred
  • Strong experience developing Spark applications using Python
  • Expertise with Big Data Hadoop platforms like Databricks, Cloudera, Teradata, etc. and solid fundamental understanding of the Hadoop architecture
  • Demonstrated professional expertise in understanding and implementing OO design patterns, developing container-based applications in a microservices architecture, using the state-of-the-art software engineering best practices
  • Experience working with relational and NoSQL databases (such as tuning and optimizing complex queries for highly scalable systems) and query languages (specifically Hive/SparkSQL and ANSI SQL)
  • Experience building large scale Spark applications & data pipelines, ideally with Batch processing running on Hadoop clusters
  • Creativity and passion for tackling challenging data problems and willingness to work in a start-up environment
  • Experience with Git or other similar version control software
  • Experience and commitment in developing high quality, robust, scalable, and maintainable software. Knowledge of testing frameworks, CI/CD, test automation, and software monitoring and alerting
  • Experience working in a high performant collaborative agile team environment
  • Curious, and eager to learn, willing to expand its technical skills while helping other team members to grow
  • Strong communication and interpersonal skills

Desirable

  • Experience with messaging queues such as Kafka, RabbitMQ or JMS and reactive architecture paradigm
  • Experience designing and developing highly available fault tolerant software
  • Experience in architecture and development of data models and data dictionaries in big data systems
  • Familiar with at least one large cloud computing provider like Azure, AWS, or IBM cloud, in this order of preference
  • Experience designing and implementing highly secure software and solutions. Knowledge with secure vulnerability tools such as Checkmarx, Snyk or Nexus IQ
  • Proven hands-on coding experience with data analytics platforms and workflow engines, including SPSS, Knime, RapidMiner, SAS, Dataiku etc
  • Experience in operating a UNIX shell and reading and developing simple shell scripts
  • 1-2 years’ experience designing software systems, and mentoring junior software engineers

What the job involves

  • Founded by Mastercard and IBM in 2018, Trūata specializes in privacy-enhancing technologies for privacy risk assessment, de-identification, and true anonymization of data
  • Trūata is now recruiting for a Senior Python Spark Engineer for our Analytics Platform team.
  • As a Senior Software Engineer, you will be required to architect and build Truata’s Core Platform to support advanced GDPR compliant big data and data analytic applications
  • You will be a member of a highly capable software team designing and developing applications for big data handling, data wrangling, anonymization, and data analytics
  • Our PaaS solutions will be deployed in cloud native environments providing highly scalable and secure data management
  • This role is meant to be computer programming intensive
  • Participate in the architecture, design and implementation of customer oriented big data analytics platform using Python based on Spark
  • Ensure the long-term quality in term of architectural designs and code quality
  • Communicate frequently with product management, data pipelines, data science and other teams to coordinate work efforts
  • Full software lifecycle participation including design, development, testing, bug fixing, cloud deployment, and maintenance process automation
  • Participate in a highly collaborative Agile Scrum team-based software development process

Our take

Mastercard is in the global payments business, and operates the world's fastest payments processing network. Its products and solutions have become central to everyday commerce across the world, in activities ranging from shopping and travelling to running businesses.

As the economy has become more and more digitised, Mastercard has been a leading player in helping businesses and individuals across the globe embrace card payments and digital banking. One of the world's largest companies, its revenue has seen consistent gain in the last 20 years.

The challenge for modern payments companies is that payments are always changing, as seen in the astronomical rise of contactless payments over the last decade. Mastercard's acquisition of blockchain systems, and an overall focus on leveraging its technology towards a digital economy, has placed the company in good stead to keep up to date with current trends, like cryptocurrency, in the digitised payments world.

Steph headshot

Steph

Company Specialist

Insights

Some candidates hear
back within 2 weeks

21% employee growth in 12 months

Company

Company benefits

  • Gym membership
  • Share purchase options
  • Extra holiday purchase optional
  • Work from home opportunities
  • Health insurance

Company values

  • Trust - integrity, respect, openness
  • Agility - urgency and value through innovation
  • Partnership - working as one team for the benefit of all
  • Initiative - taking bold and thoughtful actions

Company HQ

Purchase, Harrison, NY

Founders

Michael Miebach

(CEO, not founder)

Has served in a variety of roles at the company, including President and CPO. Currently Board Member at IBM, Accion, the World Resources Institute, the US-India Strategic Partnership Forum, and the Metropolitan Opera. They are also a Trustee of USCIB.


People progressing

Joined as VP in 2008, promoted 4 times in 11 years to their current position of Executive Vice President.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 150 more jobs at Mastercard