Data Engineer (Spark/SQL: 6546)

Job ID 21406
Job Type
Haken
Salary
JPY 3,700 - JPY 4,000 per hour
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
July 1, 2024
Location
Tokyo
Job Type
Haken
Salary
JPY 3,700 - JPY 4,000 per hour
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
July 1, 2024
Location
Tokyo

Description

A Global IT Services company is looking for a Data Engineer.

 

Responsibilities

- Responsible for design and development of data pipeline

- Responsible for maintenance and operation of the data pipeline

- Working with customer service team and product team to add more features and address customer use cases on accessing the data

- Working with other engineering teams to improve the performance and reliability of services responsible for accessing the data

 

 

【Company Details】
Our client is a Global company with a strong presence across several business divisions. It has enjoyed sustained growth both domestically and overseas, including US and Europe. It proud itself of a diverse and international environment and a strong focus on equal opportunities, which translates into plenty of career opportunities. Given the variety of businesses, it deals with a strong variety of technologies so it is a great place to expand your skills!

Also, employees are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!

 

【Working Hours】
9:00 - 17:30 (Mon-Fri)


【Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays

 

【Services / Benefits】
Social insurance, Skillhouse Benefit, No smoking indoors allowed (Designated smoking area), Commutation Allowance, Free Cafeteria, and Casual clothes are acceptable

Required Skills

- Extensive experience on building streaming and/or batch applications for processing data such as Spark, Flink and SQL

- Able to create a spark application from scratch to production grade

- Able to understand and modify existing spark applications to add new features and/or fix bugs

- Able to tune Spark applications’ performance challenges by either utilizing various configurations, JVM tuning, and/or code refactoring

- Able to work with the team using various project management methodologies like SCRUM, Sprint, Kanban, etc.

- Working experience on handling production-related operations

- Ability to do QA or investigate data discrepancies using SQL or Spark