We’re looking for a skilled and motivated Data Engineer to join our team! As a Data Engineer, you will be responsible for developing, constructing, testing, and maintaining architectures, such as databases and large-scale processing systems, to support our data processing needs.
Expereince : 3 to 5 years
Location : Noida
Qualification : Bachelor’s degree in one of the fields (most common) : Computer Science, Information Technology,Data Science,Software Engineering,Mathematics or Statistics .
Optional but beneficial: Master’s degree in Data Engineering, Data Science, or related fields.
Required Skills :
- Proficiency in SQL & Python for data processing, data manipulation, and scripting.
- Experience with big data technologies such as Spark, Kafka, Cloud tech stack etc.
- Experience with tools and best practices for developing and managing data engineering pipelines, data lakes and warehouses, such as ETL tools, job management and data management tools, especially open-source tools
- Strong understanding of database technologies (SQL, NoSQL) and data modelling and data base schema design principles.
- Experience with containerization (Docker, Kubernetes) is a plus.
Responsibilities :
- Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems using Python.
- Design, develop, and maintain robust and scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources.
- Implement data integration solutions to extract, load, and transform data from disparate systems and databases.
- Develop and optimize ETL processes to cleanse, transform, and enrich raw data for analysis and reporting purposes.
- Ensure data quality and integrity throughout the ETL lifecycle through validation and error-handling mechanisms.
- Ensure architecture will support the requirements of the business.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
- Implement data security and privacy measures.
- Monitor and optimize performance of the data infrastructure.
To know more about us: https://algo8.ai/
To drop your resume :
Intrested candidate requested to fill the form on this link : https://forms.gle/Y2NkF6fwb35MXd6a9
…