Job Description

Job Title: Senior Data Engineer

Company: ThoughtWorks

Years of Exp: 5+ years (ideal for mid-to-senior level)

Location: Hyderabad, India

Role Type: Full-Time Role

Salary: As per industry standards

Eligibility: Bachelor’s/Master’s degree in Computer Science, Data Engineering, Information Technology, or related field; relevant work experience in data engineering with distributed systems and cloud platforms.

Role Overview

As a Data Engineer, you will design, build, and operate modern data architectures and pipelines that enable clients to unlock insights from their data. You will work closely with data scientists, software developers, and stakeholders to deliver scalable, secure, and high-quality data solutions. This role requires hands-on expertise with distributed computing, cloud platforms, and data modeling, along with strong collaboration and problem-solving skills.

Key Responsibilities

• Develop and operate modern data architectures to meet business objectives.
• Build and maintain scalable data pipelines to solve complex data challenges.
• Collaborate with data scientists to design scalable implementations of their models.
• Write clean, test-driven, and iterative code; apply CI/CD practices to deploy and operate pipelines.
• Leverage distributed storage and computing technologies across cloud environments (AWS/Azure).
• Design and implement data models using modern data engineering tools and techniques.
• Ensure data quality, governance, security, and privacy in all deliverables.
• Create data visualizations and communicate insights effectively.
• Coach, mentor, and collaborate with teammates, driving best practices in data engineering.

Skills and Qualifications

Technical Skills

• Strong programming skills in Python, Scala, Spark, and PySpark.
• Experience with cloud platforms (AWS, Azure) and Databricks.
• Hands-on experience with distributed storage, data lakes, and modern data engineering tools.
• Proficient in data modeling techniques and database systems (SQL, NoSQL).
• Experience deploying large-scale data pipelines in production environments.
• Familiarity with data visualization tools and techniques.
• Understanding of data governance, security, and privacy strategies.

Professional Skills

• Strong stakeholder management and client-facing communication skills.
• Resilient in ambiguous situations with problem-solving agility.
• Ability to manage risks and conflicts effectively.
• Passion for mentoring, motivating, and influencing teams toward excellence.
• Open to change and adaptable to evolving project needs.