Data Engineer

<section id="comp-km6xx8tr" class="comp-km6xx8tr CohWsy wixui-column-strip"> <div class="V5AUxf" data-testid="columns"> <div id="comp-km6xx8v2" class="comp-km6xx8v2 YzqVVZ wixui-column-strip__column"> <div id="bgLayers_comp-km6xx8v2" class="MW5IWV CJOjs7" data-hook="bgLayers" data-motion-part="BG_LAYER comp-km6xx8v2"> <div id="bgMedia_comp-km6xx8v2" class="VgO9Yg" data-motion-part="BG_MEDIA comp-km6xx8v2"></div> </div> <div class="" data-mesh-id="comp-km6xx8v2inlineContent" data-testid="inline-content"> <div data-mesh-id="comp-km6xx8v2inlineContent-gridContainer" data-testid="mesh-container-content"> <div id="comp-km6xymr7" class="MMl86N zQ9jDz qvSjx3 Vq6kJx comp-km6xymr7 wixui-rich-text" data-testid="richTextElement"> <p>The Data Engineer will leverage their development skills and experience, to support the successful designing, ingesting, cleansing, transformation, loading, and display of significant amounts of data.</p> <p></p> <h2>Roles and Responsibilities</h2> <p></p> <ul> <li>Designing, implementing, and optimizing data extraction, cleansing, transformation, loading, replication/distribution, and large-scale ingest systems in a Big Data environment</li> <li>Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond</li> <li>Developing custom solutions/code to ingest and exploit new and existing data sources</li> <li>Developing data profiling, deduping logic, and matching logic for analysis</li> <li>Organizing and maintaining Data Layer documentation, so others are able to understand and use it. &nbsp;Also, work closely with data scientists to craft data pipelines which serve the development of modern AI/ML workflows</li> <li>Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods</li> <li>Effectively articulating the risks and constraints associated with software solutions, based on environment</li> </ul> <h2>Required Skills</h2> <ul> <li>High School Diploma/GED with 2+ years of relevant software development/programming experience.</li> <li>Demonstrated data analysis, parsing, and programming language experience (e.g. Python, Java) coupled with significant SQL/database experience.</li> <li>Experience with the full data lifecycle, from ingest through display, in a Big Data environment.</li> <li>Hands-on experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs.</li> <li>Experience with data pipelining systems (e.g. Apache Airflow) and developing/performing ETL tasks in a Linux environment.</li> <li>TS/SCI clearance with a polygraph Bachelor's degree in Computer Science</li> </ul> <h2>Desired Skills</h2> <ul> <li>Experience deploying systems that leverage AI/ML technology</li> <li>Experience publishing results in BI dashboards.</li> </ul> </div> </div> </div> </div> </div> </section>