Data Engineer- SME
At a glance
Mid-level Data Engineering role at SOSi. Huntsville · full-time · $73,046–$151,710 base.
dataroles summary, based on the employer's posting.
What you'll do
- Build and support the pipelines, ETL processes, and storage that move data through analytical systems
- Shape end-to-end data architectures, then connect software components into working systems
- Create services and infrastructure for machine learning workflows, including automated MLOps processes
- Write maintainable Python and other code, and set up CI/CD with DevSecOps practices
- Document software systems and share technical practices across teams
What you bring
- An active Top Secret clearance with eligibility for SCI access
- At least seven years in data engineering, data science, or an advanced analytics role
- Hands-on data engineering or software development experience, with Python, Git, YAML, Docker, and SQL
- Working knowledge of CI/CD, Agile methods, back-end services, software design, and system integration
Who this fits
This role suits a mid-career data engineer who can build data systems and support machine learning workflows. The job is on-site in Huntsville, and may involve consecutive nights or weekends.
From the employer
Founded in 1989, SOSi is among the largest private, founder-owned technology and services integrators in the defense and government services industry. We deliver tailored solutions, tested leadership, and trusted results to enable national security missions worldwide.
Overview
SOSi is seeking an expert Data Engineer to join our analytics team working on an innovative MLOps workload leveraging cutting-edge technologies and supporting a government customer in Huntsville, Alabama. This role will be responsible for delivering automation to key national security missions interacting with petabyte-scale data on supercomputing resources.
In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis. You will leverage scientific techniques to transform petabyte-scale data into insightful data products to enable data-driven decisions. You will partner with Data Scientists to refactor manual workflows to produce highly automated MLOPs based workloads. You will perform using Scrumban techniques and be embedded with end users.
The team will work with technologies including:
- Open source, commercial, and government software packages such as PyTorch, TensorFlow, GitLab, Atlassian Suite, Linux, and Microsoft Suite
- SQL and NOSQL databases such as PostgreSQL, Wevaiate, Neo4j, and MongoDB
- Microservice architecture and containerization with Docker and Kubernetes
- Apache products such as Kafka, Airflow, and Spark
- Leverage GitOps patterns and CI/CD with tools like GitLab, Argo, and Harness
Essential Job Duties
- Build and maintain data pipelines, ETL processes, and storage systems
- Design end-to-end data architectures and infrastructure
- Lead teams building complex data pipelines and ML systems
- Develop services and extend infrastructure to enable machine learning workflows
- Integrate software components into functional data systems
- Write clean, testable, maintainable code in Python and other languages
- Implement CI/CD pipelines and DevSecOps best practices
- Create technical documentation for software systems
- Collaborate across teams to share knowledge and leading practices
- Top Secret Security Clearance with SCI eligibility
- At least 7 years of experience as a Data Engineer/Scientist or advanced analytical role
- Experience in data engineering and/or software development
- Expertise with Python, GIT, YAML, Docker, and SQL
- Knowledge of CI/CD and Agile methodologies
- Experience developing back-end systems and services
- Understanding of software design and system integration
Preferred Qualifications
- Significant Experience with Petabyte scale data sets
- Significant Experience with large-scale, multi-INT analytics
- BS or MS in Computer Science, Statistics, Mathematics, Physics or a quantitative field
Work Environment
- Working conditions are normal for an office environment.
- Fast paced, deadline-oriented environment.
- May require periods of non-traditional working hours including consecutive nights or weekends (if applicable).
Working at SOSi
All interested individuals will receive consideration and will not be discriminated against for any reason.
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering$70k+
Find me workBy the team behind dataroles.