As the Data Engineer, your roles & responsibilities include:
Project Development
- Assist in scoping and designing projects and solutions.
- Analyse user requirements and create high-level design documents from the business specification documents.
- Identify the client- and server-side responsibilities of a solution and articulate the pros and cons of various solutions.
- Documents and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code and comments (ERD, data flow diagram, server architecture, etc).
Data management & ETL
- Making large and/or complex data more accessible, understandable and usable
- Transforming, improving and integrating data, depending on the business requirements
- Delivering the data in a useful and appealing way to users / clients
- Design, test, and implement data integration software
- Monitoring performance and advising any necessary infrastructure changes
- Perform ETL, API, support data assessment and data cleansing
- Create script to ingest and transform data for loading to support data science, web and app development teams
- Liaise with data warehouse data engineer on the data consolidation and ETL automation.
To be a Successful Candidate, you will need to possess:
- Knowledge of Database Management Systems in AWS cloud platform: MSSQL, MySQL, PostgreSQL (At least one of it)
- Knowledge of OS/Platforms: Amazon Web Services
- Knowledge of languages: SQL like scripting and programming
- Experience working with and creating data architectures.
- Experience with integration of data from multiple data sources
- Knowledge of various ETL techniques and frameworks
- Working knowledge of MS Package Excel, Word and PowerPoint
- Great communication skills – ability to present findings in a cohesive manner
- Good written and verbal communication skills.
- A drive to learn and master new technologies and techniques.
- Ability to communicate ideas, comments and feedback in a constructive and precise manner
- Good team player especially within a cross functional project team
- Excellent attention to detail
- Ability to adhere to tight deadlines and handle multiple projects that may overlap
- Willing to be based at Shah Alam Office
Vacancy posted 7 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!