Senior Data Engineer

Year    Bengaluru, Karnataka, India

Job Description


Company Description
Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive. When you join Visa, you join a culture of purpose and belonging – where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world – helping unlock financial access to enable the future of money movement. Join Visa: A Network Working for Everyone.


Visa Corporate IT (CIT) group has embarked on a major transformation journey. We are transforming ourselves into a true engineering organization where we put customer experience and end user support first. As part of this strategy, we are consolidating several of our Operational functions into a single area focused on providing world-class operational support to our End users. Visa s Engineering, Applications and Analytics team is looking for curious, creative, and technology experts to join our growing team. We focus on delivering and supporting integrated platforms that enables Visa s finance applications, which are used by Visa business partners to service Visa clients globally. We also develop analytics and reporting by using revenue data.
The successful candidate is expected to be expert in bigdata technologies. The selected candidate will be fully responsible for both service delivery and operational excellence of services built using Hadoop technologies. RESPONSIBILITIES

  • Implement scalable architectural models for data processing and storage.
  • Build framework for data ingestion from multiple heterogeneous sources in batch & real-time mode.
  • Build framework for data analytics, search, and aggregation.
  • Optimize existing data processing pipelines,
  • Data Integration, Processing & Governance.
  • Analytics & Visualizations.
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office two days a week, Tuesdays and Wednesdays with a general guidepost of being in the office 50% of the time based on business needs.

Qualifications

MUST HAVE EXPERIENCES :

  • Bachelor s degree in Computer Science or related fields and 5 or more years relevant experience.
  • Expert level skills writing and optimizing complex SQL.
  • Knowledge of data warehousing concepts.
  • Experience in data mining, profiling, and analysis.
  • Experience with complex data modelling, ETL design, and using large databases in a business environment.
  • Proficiency with Linux command line and systems administration.
  • Experience with languages like Python or Java.
  • Experience with Big Data technologies such as HDFS/Hive/Spark/Nifi/Kafka.
  • Proven ability to develop unconventional solutions Sees opportunities to innovate and leads the way.
  • Provide right and faster solution for any issues.
  • Excellent verbal and written communication Proven interpersonal skills and ability to convey key insights from complex analyses in summarized business terms Ability to effectively communicate with technical teams.
  • Ability to work with shifting deadlines in a fast-paced environment.

PREFERRED QUALIFICATIONS :

  • Authoritative in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Demonstrate efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
  • Knowledge of Engineering and Operational Excellence using standard methodologies.

Additional Information

Visa has adopted a COVID-19 vaccination policy. As a condition of employment, all employees based in the country where this job is located are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD2875463
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bengaluru, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year