Big Data Specialist Programmer

Bigdata specialist programmer

• Knowledge of more than one technology • Basics of Architecture and Design fundamentals • Knowledge of Testing tools • Knowledge of agile methodologies • Understanding of Project life cycle activities on development and maintenance projects • Understanding of one or more Estimation methodologies, Knowledge of Quality processes • Basics of business domain to understand the business requirements • Analytical abilities, Strong Technical Skills, Good communication skills • Good understanding of the technology and domain • Ability to demonstrate a sound understanding of software quality assurance principles, SOLID design principles and modelling methods • Awareness of latest technologies and trends • Excellent problem solving, analytical and debugging skills Key Responsibilities: - Lead the design and implementation of big data solutions using Spark, Pyspark, Hive, and Scala. - Collaborate with cross-functional teams to develop scalable data architectures and pipelines. - Optimize data processing workflows to ensure high performance and reliability. - Mentor and guide junior engineers, fostering a culture of continuous learning and improvement. - Ensure data security and compliance with industry standards. Minimum Qualifications: - Bachelor's degree in Technology (B.Tech) or related field. - Proven experience in big data technologies such as Spark, Pyspark, Hive, and Scala. - Strong analytical and problem-solving skills. Preferred Qualifications: - Experience with Kafka for real-time data processing. - Demonstrated leadership skills in managing technology projects. - Ability to work effectively in a collaborative team environment. - Track record of delivering high-quality data solutions. Good to have skills: Flask, Pandas, Data Analysis, Springboot, Microservices