Company Description

N digital is a new venture within the Large Corporation, focusing on the Personal Financial Management scene for the Indonesian market. We deploy a future-back approach in defining what game we should play within the industry and making sure we can get ahead of the pack by genuinely believing in the art of the possible. We have access to a large corporation's resources and networks, but with the velocity of a start-up. Our team is energetic and committed, and we expect the same from every person we hire.

Job Description

Description

Design and build highly scalable pipeline (end-to-end) for large volumes of complex data processing and analysis
Build and develop large data warehouses, high performance data processing pipelines, and ETL tools
Ensure high data integrity and quality from various data sources
Design and implement process improvements, build automated processes, optimize data delivery and re-designing infrastructure for larger scalability
Work with machine learning systems in production
Understanding of software design principles and best practices (test driven development, source control management etc.)
Able to clearly articulate pros and cons of different technologies, solutions and platforms
Able to document use cases, solutions and recommendations

Qualifications

Solid experience and knowledge on Google Cloud Platform (or any of the major cloud solution providers such as AWS, Azure, AliCloud) for data management: Composer, Pubsub, Google Storage, Dataflow, Big Query and Data Fusion, or equivalent
Savvy with Airflow, or a diverse set of data technologies: Redshift, Elastic Search, PostgreSQL, Spark, Hadoop, Kubernetes
Fluency in Python, SQL, Java or equivalent
Understanding of SQL & NoSQL databases and other manipulation tools
Ability to work with stream-processing systems: Storm, Spark-streaming, etc.
Able to benchmark systems, analyse performance and bottlenecks and propose solutions to resolve them
Excellent written and verbal communication, able to switch between technical and plain language when discussing work
Able to work in teams, understand and empathize with all major stakeholders, take the lead on initiatives and direct and manage data engineers
Able to work in a fast-paced agile development environment