Job Description

Company Profile:

We're Hiring at CGI for our GCC - Right Here in Hyderabad!

Join us at the intersection of technology, finance, and innovation. You will be working to support the PNC Financial Services Group, one of the top-tier financial institutions in the U.S. You'll help shape digital solutions for a global enterprise--from the ground up.

This is more than a job. It's your opportunity to:

Work on cutting-edge technologies Collaborate with global teams Build a career with purpose and impact

Ready to build the future of banking? Let's talk.



Job Title: Lead Analyst - Lead Bigdata Developer with Python, PySpark & SQL

Position Title: Lead Analyst - Lead Bigdata Developer with Python, PySpark & SQL

Experience: 8+ Years

Category: Technology/Software Development

Main location: Hyderabad

Shift Timings: General Shift

Employment Type: Full Time-Permanent

Position ID: J0325-2096



Job Summary:

CGI is looking for a Lead Big Data Developer who will design, build, and optimize large-scale data pipelines and processing systems. The ideal candidate is a hands-on technologist with deep expertise in Python, PySpark, and SQL, capable of leading data initiatives, mentoring team members, and ensuring delivery of high-performance data solutions across the organization.

Your future duties and responsibilities

Lead the design and development of scalable, efficient, and reliable data pipelines using PySpark, Python, and SQL. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. Optimize data workflows for performance, scalability, and cost efficiency in big data environments (e.g., Databricks, EMR, GCP DataProc, or similar). Implement data ingestion, transformation, and aggregation processes from multiple structured and unstructured sources. Ensure data quality, integrity, and consistency through validation, testing, and monitoring frameworks. Work with cloud-based data platforms (AWS, Azure, or GCP) and leverage tools like S3, Delta Lake, or Snowflake. Design and enforce best practices for coding, version control, and CI/CD within the data engineering team. Provide technical leadership and mentorship to junior and mid-level developers. Collaborate with DevOps and DataOps teams for deployment and operationalization of data solutions. Stay updated with the latest technologies and trends in the big data ecosystem.

Required qualifications to be successful in this role

Required Skills & Experience:-

8+ years of experience in data engineering or big data development, with at least 3+ years in a lead or senior role. Strong proficiency in Python for data processing, scripting, and automation. Advanced hands-on experience with PySpark (RDD, DataFrame, and Spark SQL APIs). Deep expertise in SQL (query optimization, analytical functions, performance tuning). Strong understanding of distributed data processing and data lake architectures. Experience working with Hadoop ecosystem (Hive, HDFS, Spark, Kafka, etc.). Hands-on experience with cloud platforms (AWS, Azure, or GCP) and data orchestration tools (Airflow, ADF, etc.). Solid understanding of data modeling, ETL design, and performance optimization. Experience with version control (Git) and CI/CD pipelines for data projects. Excellent communication and leadership skills, with the ability to guide cross-functional teams.


Preferred Qualifications:-

Experience with Delta Lake / Apache Iceberg / Hudi. Knowledge of containerization and orchestration (Docker, Kubernetes). Exposure to machine learning pipelines or data science integration. Certification in AWS Big Data / GCP Data Engineer / Azure Data Engineer is a plus.


Education:-

Bachelor's or master's degree in computer science, Information Technology, or a related field.


#LI-SP40

Together, as owners, let's turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because...



You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.



Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.



You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.




Come join our team--one of the largest IT and business consulting services firms in the world.