資深資料工程師 Sr. Data Engineer, VSX

We are in search of a Senior Data Engineer to join our team. In this role, you will be responsible for designing and optimizing our data pipelines, with a focus on planning the architecture for user data return from the product end.

Responsibilities:

• Design and manage data pipelines, ensuring high quality and reliability.

• Take charge of planning the architecture for user data return from the product end.

• Develop and maintain data processing and ETL pipelines using tools like Apache Spark, Kafka, and AWS Glue.

• Collaborate closely with data scientists and analysts to ensure data is easily accessible for analysis and reporting.

• Optimize data infrastructure for performance, scalability, and reliability.

• Work with cross-functional teams to solve technical challenges in data processing, storage, and access.

• Implement data security and compliance measures.

• Mentor and coach junior engineers in the team.

Requirements:

• Bachelor’s degree or higher in Computer Science or a related field.

• At least 5 years of experience in Data Engineering.

• Familiarity with big data technologies such as Hadoop, Spark, and Hive.

• Experience with data processing and ETL tools like Apache Beam, Apache NiFi, or Talend.

• Proficiency in cloud platforms like AWS, GCP, or Azure.

• Strong skills in SQL and NoSQL databases.

• Experience in data warehousing and data modeling.

• Familiarity with data visualization tools like Tableau or Power BI.

• Excellent problem-solving skills and the ability to work independently.

• Strong communication and collaboration skills.