ETL Developer (Warangal)

• Looking for an ETL Developer with expertise in DataStage, Azure Data Factory (ADF), and Microsoft SQL Server for managing and integrating data within an organization. These roles involve designing, developing, and maintaining data pipelines to extract, transform, and load data from various sources into target systems for analysis and reporting.
• **Key responsibilities include:**

Data Extraction: Extracting data from various sources and ensuring consistency and completeness.

Data Transformation: Cleaning, validating, and applying business rules to transform data into a usable format.

Data Loading: Loading transformed data into target systems and designing data models and workflows.

ETL Process Management: Designing, developing, implementing, and maintaining ETL processes and infrastructure.

• Performance Optimization: Tuning ETL processes, monitoring jobs, and troubleshooting issues.

Data Quality and Governance: Ensuring data quality, integrity, and compliance with regulations.

Collaboration and Documentation: Working with stakeholders and documenting ETL workflows.

Tool-Specific Responsibilities: Utilizing DataStage for complex ETL processes, using ADF for scalable cloud-based integration, and developing data warehouse solutions with SQL Server.

Develop DataStage Sequencers and Parallel jobs using different stages like Aggregator, Join, Merge, Lookup, Source dataset, External Filter, Row generator, Column Generator, Change Capture, Copy, Funnel, Short, Peek stages

• Work with the end user to get data requirements, performing complex data mapping and developing/maintaining ETL programs to support FCBs enterprise data warehouse

Provide timely resolution for integration-related production issues, including root cause analysis and follow the Change management procedures and policies.

Resource needs to be a data pipeline expert, ensuring that data is extracted, transformed, and loaded efficiently and accurately into the appropriate systems to support business intelligence and analytics efforts.

The role is vital for enabling data-driven decision-making by ensuring effective data flow and availability.

• **Mandatory skills** :
• Education: Bachelor s degree in computer and information technology or a related field, such as engineering.
• Minimum 7 years of development experience in DataStage (Version V8.5 or higher) with experience in processing high volume jobs
• 7+ years experience in Advanced Infosphere DataStage Design and ADF Development.
• 3+ years in DB2 UDB Administration and Support
• 2+ years Report Solution/Design experiences.
• Experience DataStage 11.3 and 8.7 is a must
• Strong experience with UNIX and shell scripting
• Mastery level on DataStage 8.7 server and parallel versions
• Write ETL Technical Specifications
• 3+yrs Azure Data Factory (ADF)/ Microsoft SQL Server Jobs:
• Using ADF connectors to connect to various data sources and destinations.
• Implementing data flows within ADF for complex transformations.
• Scheduling and monitoring ADF pipelines.
• Creating and managing pipelines in ADF to orchestrate data movement and transformation
• Creating and managing SQL Server Agent jobs for automated tasks, including ETL processes.
• Writing and optimizing SQL queries for data extraction and transformation.
• Using SSIS packages for complex ETL operations within SQL Server.
• Troubleshooting and resolving issues related to SQL Server jobs and SSIS packages.