The ideal candidate is an experienced software engineer who enjoys programming and creating data solutions in cloud.  

You will be responsible for expanding and optimizing our client’s data platform in Cloud. 

You will collaborate with global team of architects, data engineers on building, optimizing and maintaining the data platform.  

• Data warehousing and business intelligence experience 
• Solid Azure data engineering experience (data factory, data lake, store, azure sql database, data bricks, Synapse, event hub, Power BI)
• Data engineer, ETL developer, MSBI developer, report developer, BI developer prior to that 
• Solid Spark development (Hadoop Spark, databricks, Synapse). Need Spark expert 
• 1-2 years in building dynamic and configurable pipelines in data factory 
• Strong experience building data lake layers (raw, cleansed, curated, published, certified, silver, bronze, gold) 
• 1-2 years of experience with JSON data, parquet files, delta lake format, AVRO 
• 1-2 years of experience with API data ingestion, SaaS platforms, oData Feeds 
• 1-2 full end to end experience of data lake and data warehouse 
• Expert SQL background (query building, stored procedure, optimizing performance) 
• 1 Large scale data warehouse experience (5 TB or more, 100 million plus records) 

Roles and Responsibilities:

• Designing, implementing, and delivering batch as well as streaming data pipelines.
• Experience in building Data warehouse using different data modeling techniques.
• Analyze data requirements, complex source data, data model and determine the best methods in extracting, transforming and loading the data.
• Writing clean and concise code that is well-tested, easy to maintain, and consistent.
• Clearly communicate technical information to both technical resources and business stakeholders.
• Work in collaborative and Agile environment to deliver data products.
• Keeping tab on the latest trends and developments in the field of Business Intelligence, Business Analytics, Big Data, Data Science and Enterprise Data Architecture, along other related topics, with interest and focus on Microsoft Azure related technology stack.
• Conceptualizing small, relevant R&D initiatives to build delivery capabilities as well as create showcase demos for our capabilities.
• Ensuring that client deliveries are made on time, with quality.
• Continually and proactively work towards improving the organization’s ability to service its existing and future clients better and faster