Data Engineer III

Position Summary...The Data Engineer III is responsible for designing, building, and optimizing scalable big data pipelines, architectures, and datasets that enable advanced analytics and data-driven decision-making. This role involves developing efficient data transformation and processing frameworks, managing data structures, metadata, dependencies, and workloads, and ensuring the reliability and performance of the data ecosystem. The engineer will also work extensively with unstructured datasets, applying analytical techniques to extract insights and improve data accessibility across the organization.

What you'll do...

• Data Modeling: Designing and implementing data models to support structured and unstructured datasets, ensuring data integrity and efficiency.
• Data Extraction: Developing and optimizing data extraction processes from various sources including databases, APIs, and logs.
• Data Cleaning: Preprocessing and cleaning data to remove inconsistencies and improve data quality.
• Data Screening: Implementing data validation and quality checks to ensure accuracy and completeness of data.
• Data Exploration: Conducting exploratory data analysis to understand patterns, trends, and correlations in the data.
• Data Visualization: Creating visualizations using tools like Tableau, PowerBI, or Looker to communicate insights and findings effectively.
• Big Data Technologies: Utilizing tools and frameworks such as Spark, Spark SQL, PySpark, HDFS, and MapReduce for processing large datasets efficiently.
• Cloud Services: Leveraging cloud platforms like GCP, Azure/AWS, Databricks, Azure HD Insights, ADF for data storage, processing, and analytics.
• Data Querying: Writing advanced SQL queries to extract and manipulate data from relational databases and other data stores.
• Data Pipeline Development: Building and optimizing scalable data pipelines and architectures to move and transform data across systems.
• Data Transformation: Developing processes for data transformation, structure, metadata, dependency, and workload management.
• Enterprise Software Development: Contributing to the development of enterprise-level software products related to data engineering and analytics.

What you'll bring:

• Cross-functional Collaboration: Working closely with cross-functional teams including data scientists, analysts, and software engineers to achieve common goals.
• Programming Languages: Proficiency in at least one scripting language like Python or Scala for automation, data manipulation, and tool development.
• Agile Environment: Collaborating effectively in an Agile environment, participating in sprints, and adapting to changing
• Analytical Skills: Applying strong analytical skills to work with complex and unstructured datasets, extracting valuable insights and actionable information. project requirements.
• Big Data Data Stores: Implementing and managing highly scalable big data stores to efficiently store and access large volumes of data.
• Data Value Extraction: Manipulating, processing, and extracting value from large, diverse datasets to drive business decisions and innovation.
• Big Data Technologies: Experience utilizing tools and frameworks such as Spark, Spark SQL, PySpark, HDFS, and MapReduce for processing large datasets efficiently.
• Cloud Services: Experience leveraging cloud platforms like GCP, Azure/AWS, Databricks, Azure HD Insights, ADF for data storage, processing, and analytics.

About Walmart General/Not Function Specific

Sam Walton opened the first Sam's Club in 1983 to meet a growing need among customers who wanted to buy merchandise in bulk. Since then, Sam's Club has grown rapidly, opening more than 600 clubs in the U.S. and 100 clubs internationally. By offering affordable, wholesale merchandise to members, Sam's Club helps make saving simple for families and small business owners. Sam's Club employs about 110,000 associates in the U.S. The average club is 134,000 square feet and offers bulk groceries and general merchandise. Most clubs also have specialty services, such as a pharmacy, an optical department, a photo center, or a tire and battery center. ​​​Future Ways of Working:

Our company's success can be attributed to our employees. While technology has allowed us to be effective while working remotely, there is no substitute for being in the office together; it helps to shape our culture, collaborate, innovate, build relationships, and move more quickly. We strive to provide flexibility in order to promote a healthy work-life balance but recognize that in-person interactions are important to our culture and shared success. We'll meet in person on a regular and purposeful basis.

Benefits

Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.

Equal Opportunity Employer:

Walmart, Inc. is an Equal