Lead Software Engineer (Big Data and Azure)

Accelerate your career with PradeepIT, a globally recognized IT Consulting firm. We're headquartered in Bengaluru, India, and work with leading brands and Fortune 500 companies.

Requirements

• 8 to 12 years in Big Data & Data related technology experience
• Expert level understanding of distributed computing principles
• Expert level knowledge and experience in Apache Spark
• Hands on experience in Azure Databricks, Data Factory, Data Lake store/Blob storage, SQL DB
• Experience in creating Big data Pipelines with Azure components
• Hands on programing with Python
• Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
• Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
• Experience with messaging systems, such as Kafka or RabbitMQ
• Good understanding of Big Data querying tools, such as Hive, and Impala
• Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
• Good understanding of SQL queries, joins, stored procedures, relational schemas
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of ETL techniques and frameworks
• Performance tuning of Spark Jobs
• Experience with designing and implementing Big data solutions
• Practitioner of AGILE methodology