Lead Data Engineer (P3)
Lead Data Engineer (P3)
Job type:
Permanent
Specialization:
Data and Analytics
Language Level:
Japanese Level - High Intermediate (JLPT Level 2),English Level - Advanced (TOEIC 860)
Location:
東京都
Salary:
¥8,500,000.00 - ¥11,000,000.00 Yearly
Job Reference:
477273
A world's leading Life Insurance firm is looking for a talented Lead Data Engineer in the Data Platform & Strategy Department.
Responsibilities:
Platform Development:
- Develop and maintain core data platform components using AWS and Databricks.
- Implement data pipelines and transformation workflow.
- Build and optimize data ingestion patterns for various data sources.
- Create and maintain automated testing and deployment processes.
- Implement monitoring and alerting solution for platform components.
Technical Implementation:
- Write high-quality, maintainable code following best practices.
- Strong hands-on experience with Infrastructure as Code with proficiency in using Terraform for infrastructure provisioning, ability to implement infrastructure testing, validation, best practices and standards and optimization techniques.
- Implement security and compliance requirements in platform components.
- Optimize performance of data processing workflows.
- Create technical documentation for platform components and project solution architecture.
- Participate in code reviews and technical discussions.
Collaboration & Knowledge sharing:
- Work closely with other Data Engineers or other developers to ensure consistent implementation patterns that leverage or challenge existing patterns.
- Share technical knowledge and best practices with team members.
- Collaborate with cross-functional stakeholders to understand their requirements and translate it into compliant solution architecture design.
- Participate in technical design discussions and provide implementation feedback.
- Communicate effectively with project managers and business stakeholders.
- Provide accurate estimates and progress updates
- Escalate risks and blockers appropriately.
Required Skills:
- Bachelor’s or Master’s degree in computer science, or related technical field.
- 6+ years of experience in data engineering and software development.
- Strong expertise in Cloud Platforms (AWS preferred) and data processing frameworks.
- Advanced knowledge of Python (preferred), Scala, or Java, SQL (preferred),
- Knowledge in data processing frameworks (Spark preferred).
- Advanced experience with modern SQL Warehouse (Databricks preferred, Snowflake, Big Query), columnar format handling (Parquet / Delta format, ORC preferred), and modern data architecture (Lakehouse preferred).
- Experience with DBT (Data Build Tool) and data modeling methodologies.
- Experience with CI/CD/CO practices and DevOps tools (JIRA, Jenkins, Terraform/AWS CDK for IaC).
- Solid understanding of data modeling and data architecture principles.
- Experience with real-time data processing and streaming technologies.
- Behavioral skills
- Strong analytical and problem-solving skills.
- Excellent attention to detail and quality focus.
- Ability to work effectively in an agile environment.
- Good communication skills.
Why should you apply:
- Our client is one of the biggest global insurance companies in the world.
- You will be working with the international team, and
- With best technologies in insurance domain.
- 50% WFH and 50% Work from Office
Company Details:
One of the world's largest insurance - financial groups, trusted by over 50 million customers. The company provides various financial protections including general insurance, life insurance, retirement funds, and inheritance throughout the lifetime for individual customers, small businesses, and large companies.
Working Hours: 9:00 – 17:00 (Mon-Fri)
Working Style: Hybrid (2 days in office & 3 days’ work from home every week)
Holidays: Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
Services/Benefits: Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.
Interview Process: 3~4 times
1st Technical interview will be online
2nd Technical and Management round will be f2f in Office
3rd HR Round will be online
Share this job
