Company Description
Antern Technologies is a product and engineering services company with over a decade of experience in building scalable digital platforms and enterprise solutions. The company specializes in designing AI-driven products and custom technology solutions that enable organizations to modernize systems, boost efficiency, and achieve measurable business performance. Antern also provides end-to-end services such as offshore development and global capability center setup to help scale innovation effectively.
Role Description
This is a part-time remote role for a Big Data (Data Engineer with at least 10 years) of experience who can screen given candidates. The Data Engineer will be responsible for designing, building, and maintaining data pipelines and implementing Extract, Transform, Load (ETL) processes.
Secondary Skill 1: Data engineer (Building / Optimizing Data pipeline
Secondary Skill 2: Pyspark
Secondary Skill 3: Kafka
Secondary Skill 4: Cloud (AWS, Azure, GCP)
Secondary Skill 5: SQL
Client Inputs:
- Title – Big Data Exp – 10 Years Mandatory Skills to Evaluate During the Interview – PySpark, Cloud (GCP OR AWS), SQL
- JD:- Seeking a Skilled Data Engineer with 7 to 10 years of experience in building large-scale data pipelines, ETL processes, and data warehouse solutions.
- Proven expertise in developing multi-terabyte scalable Big Data solutions using Python, SQL, Spark, Airflow, Databricks, and Kafka.
- Adept at designing and optimizing data architectures to support advanced analytics and business intelligence.
- Programming Languages – Python(Must have), SQL
- Big Data Technologies – Spark, PySpark, Spark SQL
- Streaming Technologies – Kafka, Spark Structured Streaming
- Cloud Computing – GCP, Databricks, Snowflake, AWS
- Data Engineering Tools – ETL/ELT Data Pipelines
…