Sr. Data Platform Engineer
At a glance
Senior Data Engineering role at Real Time Medical Systems. Columbia · full-time · no salary stated · we estimate $142,500–$193,650 across the United States.
Real Time Medical Systems has not published a salary for this role. The figure below is our estimate, not theirs.
dataroles summary, based on the employer's posting.
What you'll do
- Build and tune batch and streaming pipelines with Python, PySpark and SQL
- Move data from SQL Server to PostgreSQL, handling schema conversion, performance tuning and validation
- Automate AWS infrastructure with Terraform and review workloads for better speed and cost efficiency
- Create data quality, monitoring and reconciliation frameworks, and apply testing, CI/CD and code review practices
- Turn stakeholder needs into scalable designs, support production through a rotating on-call schedule, and mentor teammates
What you bring
- At least five years in data or software engineering roles
- Strong Python and PySpark skills for processing large data volumes, plus substantial SQL development experience
- Practical experience with AWS data services and Terraform, Terragrunt or comparable infrastructure automation
- Experience with SQL Server and PostgreSQL, including database tuning and migration work
- A bachelor's degree and working knowledge of C# for application or data integrations
Who this fits
This senior individual-contributor role suits someone who can work independently, collaborate remotely, and shift between competing priorities. You’ll need to take part in a rotating production-support schedule and be based within the United States. Travel is minimal.
From the employer
Sr. Data Platform Engineer
Job purpose summary
Real Time’s suite of Interventional Analytics solutions enables post-acute facilities to seamlessly collaborate with their partner hospitals, health systems, ACOs, and managed care plans to improve care, reduce costs, and achieve a level of interoperability.
Real Time is seeking a Senior Data Platform Engineer with deep hands-on experience across AWS, Terraform, Python, PySpark, SQL Server, PostgreSQL, and C#. This role will focus on designing and optimizing cloud-native data solutions, driving performance and cost efficiency, and enabling large-scale migrations from legacy SQL Server systems to modern PostgreSQL-based architectures.
The ideal candidate thrives in independent, dynamic environments, is comfortable shifting between multiple projects, and can balance long-term architecture with short-term deliverables.
Duties and responsibilities
- Design, build, and optimize data pipelines (batch and streaming) using PySpark, Python, and SQL
- Lead and support SQL Server → PostgreSQL migration efforts, including schema translation, performance tuning, and data validation
- Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.)
- Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements
- Develop frameworks for data quality, monitoring, and reconciliation
- Collaborate with business stakeholders and other engineers to translate requirements into scalable solutions
- Apply software engineering best practices (version control, CI/CD, testing, code reviews) to data engineering workflows
- Contribute to standards, best practices, and technical mentorship across the team
- Participate in a rotating on-call schedule to provide production support, ensuring reliability of data platforms with minimal disruption to business operations
Additional Duties and Responsibilities
- Maintain regular and punctual attendance.
- Any other assigned tasks
- Comply with all company policies and procedures.
- 5+ years of professional experience in data engineering or software engineering roles
- Advanced skills with Python and PySpark for large-scale data processing
- Strong SQL development experience, including query tuning and ETL/ELT design
- Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC)
- Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation
- Familiarity with SQL Server and PostgreSQL, including database optimization and migration patterns
- Working knowledge of C# for application/data integrations
- Strong grasp of data modeling, architecture, and governance best practices
- Excellent problem-solving skills, ability to self-manage, and comfort working in environments with changing priorities
- Bachelor’s degree required
- Excellent verbal, written and presentation skills.
- Ability to thrive in a fast paced, deadline driven environment.
- AWS certification (Solutions Architect, Data Analytics, or DevOps) a plus
- Data visualization experience with Tableau, PowerBI, MicroStrategy, etc. also a plus
- Experience working in the healthcare industry a plus
- You must love what you do! You will be working with other talented and passionate individuals who enjoy working and solving problems together!
Additional Qualifications
- Independent contributor who can also collaborate effectively in a remote environment
- Strong communication skills, both technical and business-oriented
- Comfortable balancing multiple priorities without losing quality
- Reliability and responsiveness when participating in the on-call rotation, with a proactive and calm approach to production issues
- Positive, solution-oriented mindset - able to tackle tasks with optimism
Working conditions
Position requires minimal amount of travel.
Remote/Work from anywhere work environment within the United States.
Physical requirements
Remaining in a stationary position, often sitting for prolonged periods.
Direct reports
None
Why you'll love it here:
- You’ll be part of a team that helps save lives every day, and improves the lives of 100,000s of people!
- Competitive base salary
- Ongoing training and coaching for career development
- Comprehensive medical, dental and vision coverage with significant company contribution
- Disability insurance
- 401(k) retirement savings program
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.