C
Hiring companyCaterpillar
Verified today
Software Engineer, Data Engineering
Chennai,Tamil Nadu,India Full-time On-site
About the role
Data Engineering team at Caterpillar builds and operates state-of-the‑state digital platforms for heavy‑equipment data. The Software Engineer designs and implements near real‑time data pipelines, develops large data lakes and warehouses, and ensures robust, scalable solutions using Python, Snowflake, and AWS services. Works onsite five days a week in Chennai or Bangalore, with relocation assistance available.
What you’ll do
- Develop end‑to‑end near real‑time data movement solutions
- Build and maintain large data lakes and warehouses
- Design scalable architecture for data platforms
- Collaborate with internal customers to define requirements
- Mentor junior developers and promote best practices
- Perform integrated testing and customer acceptance testing
- Deploy software using cloud services and CI/CD pipelines
- Identify and drive improvements in code quality and performance
What you’ll bring
- 5+ years software development experience
- 3+ years designing data pipelines in Python
- Experience with Snowflake or similar data warehouse
- Proficiency with AWS services (Kafka/Kinesis, SQS, SNS, Lambda, DynamoDB)
- Experience with CI/CD tools (Azure DevOps, Jenkins, GoCD)
- Strong SQL and NoSQL database skills
- Object‑oriented programming and algorithm fundamentals
- Test‑driven and behavior‑driven development
Skills
PythonData PipelinesSnowflakeAWSCI/CDSQLNoSQLObject‑Oriented
Benefits
Relocation assistance