Tech Stalwart Solution - Python Developer

Developer is needed in Bengaluru, India.

Client: Tech Stalwart Solution

Location: Bengaluru, Karnataka, India

Contract: Contractor

Job Description

As a Python PySpark Developer in Bangalore, you will be responsible for designing, developing, and optimizing PySpark applications for large-scale data processing. You will work on data ingestion, transformation, and storage processes, implement efficient algorithms for distributed computing, and collaborate with teams to integrate data-driven solutions into business processes. Troubleshooting performance issues and ensuring data pipeline reliability will also be part of your role.

Requirements

• Bachelor’s/Master’s degree in Computer Science, Engineering, or a related field.

• 3-10 years of proven experience in Python development with a focus on PySpark.

• Strong understanding of distributed computing principles and Apache Spark.

• Proficiency in SQL and experience with relational databases (MySQL, PostgreSQL, etc.).

• Experience with data serialization formats such as JSON, Parquet, Avro.

• Familiarity with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) is a plus.

• Excellent problem-solving skills and ability to work independently or as part of a team.

• Good communication skills with the ability to collaborate effectively with stakeholders.

Preferred Qualifications

• Certification in Apache Spark or related technologies.

• Experience with stream processing frameworks like Apache Kafka.

• Knowledge of machine learning frameworks (e.g., TensorFlow, PyTorch) for data analysis.