Big Data Developer

Job Title: Big Data Developer

Job Type: Full-time

Experience: 3-6 years

Job Description:

Looking for an experienced Big Data Developer to develop, maintain, and optimize

our big data solutions. The ideal candidate will have strong expertise in Java, Spark,

API development, and a deep understanding of data engineering and big data tools.

Key Responsibilities:

- Design, develop, and maintain big data solutions using Java and Apache Spark.

- Develop and manage APIs for data ingestion, processing, and extraction.

- Collaborate with data scientists, data analysts, and other stakeholders to

understand data requirements and deliver efficient solutions.

- Optimize and tune big data workflows for performance and scalability.

- Implement data engineering best practices to ensure data quality, integrity, and

security.

- Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase,

Kafka, and others as needed.

- Troubleshoot and resolve issues related to data processing and workflows.

- Stay updated with the latest trends and advancements in big data technologies and

tools.

Required Qualifications:

- Bachelor's or Master's degree in Computer Science, Information Technology, or a

related field.

- 4-8 years of experience in big data development and data engineering.

- Proficiency in Java and experience with Apache Spark.

- Experience in API development and integration.

- Strong understanding of data engineering principles and big data concepts.

- Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka.

- Experience with SQL and NoSQL databases.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills.

Preferred Qualifications:

- Experience with cloud platforms such as, Spark, Data/Delta lakes, Modern Data

stack.

- Knowledge of containerization technologies like Docker and Kubernetes.

- Experience with continuous integration and continuous deployment (CI/CD)

pipelines.

- Familiarity with machine learning frameworks and libraries.