Job Description
Excite your career at Paytm Labs as a Senior Data Engineer. Work with massive datasets, optimize data pipelines, and enhance fraud detection techniques in a hybrid model.
In this role based in our Toronto office, you will collaborate with the Platform Engineering Team to create robust data pipelines and manage high-volume data ingestion using advanced technologies. You will apply your expertise in Spark, Kafka, and data structuring to ensure seamless data flow and reliable storage solutions while embracing problem-solving skills to address challenges head-on.
Key Responsibilities:
• Develop reusable experimental and production data pipelines
• Optimize feature pipelines for speed and efficiency
• Tune and master daily frameworks and technologies
• Ensure data safety and flow using ingestion platforms
• Shape data structures for efficient storage and transit
Requirements:
• Degree in Computer Science or related field
• Proficient in Spark, Scala, Python, or...
In this role based in our Toronto office, you will collaborate with the Platform Engineering Team to create robust data pipelines and manage high-volume data ingestion using advanced technologies. You will apply your expertise in Spark, Kafka, and data structuring to ensure seamless data flow and reliable storage solutions while embracing problem-solving skills to address challenges head-on.
Key Responsibilities:
• Develop reusable experimental and production data pipelines
• Optimize feature pipelines for speed and efficiency
• Tune and master daily frameworks and technologies
• Ensure data safety and flow using ingestion platforms
• Shape data structures for efficient storage and transit
Requirements:
• Degree in Computer Science or related field
• Proficient in Spark, Scala, Python, or...