[Data Engineer] As an engineer for our in-house data platform, responsible for everything from design to operation of the platform supporting generative AI utilization. Gain practical experience in data management handling diverse data using the latest technologies.English summary from Japanese

Must-haves

• Experience in designing, developing, and operating data pipelines on Databricks
• Experience using dbt, SQL, and Python for data pipeline processing
• Experience in building and improving data management platforms
• Experience in designing data platforms and data management platforms for generative AI/AI agent utilization

Nice-to-haves

• Experience in data catalog maintenance and continuous improvement
• Experience in data processing and cleansing for diverse big data
• Experience in building and operating data platforms using tools like Databricks and dbt
• Practical knowledge and experience in data platforms/data management supporting generative AI/AI agent utilization

Tech stack