Big Data Engineer

Location: Remote-US, California US


This position is no longer open.

Job Number: 3202

Position Title: Data Engineer

External Description:

Position Summary:

The Data Engineer will develop a new data engineering platform that leverage a new cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed. You will also be assisting with integrating the SQL data warehouse platform as our primary processing platform to create the curated enterprise data model for the company to leverage. You will be part of a team building the next generation data platform and to drive the adoption of new technologies and new practices in existing implementations. You will be responsible for designing and implementing the complex ETL pipelines in cloud data platform and other solutions to support the rapidly growing and dynamic business demand for data and use it to deliver the data as service which will have an immediate influence on day-to-day decision making.

General Duties/Responsibilities (May include but are not limited to):

  • Interfacing with business customers, gathering requirements and developing new datasets in data platform
  • Building and migrating the complex ETL/EDI pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically
  • Identifying the data quality issues to address them immediately to provide great user experience
  • Extracting and combining data from various heterogeneous data sources
  • Designing, implementing, and supporting a platform that can provide ad-hoc access to large datasets
  • Modelling data and metadata to support machine learning and AI

Supervisory responsibilities:


Minimum Requirements:

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily.  The requirements listed below are representative of the knowledge, skill, and/or ability required.  Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.


1.       Minimum Experience:

a.       3+ years relevant experience in cloud based data engineering.

b.       Requires Spark and Scala experience

c.       Demonstrated ability in data modeling, ETL development, EDI Development and data warehousing.

d.       Data Warehousing Experience with SQL Server, Oracle, Redshift, Teradata, etc.

e.       Experience with Big Data Technologies (NoSQL databases, Hadoop, Hive, Hbase, Pig, Spark, Elasticsearch etc.)

f.        Experience in using Python, .net, Java and/or other data engineering languages

g.       Knowledge and experience of SQL Server and SSIS.

h.       Experience with X12(837,834,278) and HL7 transactions

2.       Education/Licensure:

a.       Bachelors or Masters in Computer Science, Engineering, Mathematics, Statistics, or related field

3.       Other:

a.       Excellent communication, analytical and collaborative problem-solving skills

b.       Building and migrating the complex ETL/EDI pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically

c.       Preferred

 i.      A Healthcare domain and data experience

ii.      Healthcare EDI experience is a plus

iii.      API development experience is a plus

iv.      Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.

v.      Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets

vi.      Experience building data products incrementally and integrating and managing datasets from multiple sources

vii.      Experience leading large-scale data warehousing and analytics projects, including using Azure or AWS technologies – SQL Server, Redshift, S3, EC2, Data-pipeline, Data Lake, Data Factory and other big data technologies

viii.      Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space

ix.      Linux/UNIX including to process large data sets.

x.      Experience with Azure, AWS or GCP is a plus

xi.      Microsoft Azure Certification is a plus

xii.      Demonstrable track record dealing well with ambiguity, prioritizing needs, and delivering results in an agile, dynamic startup environment

xiii.      Problem solving skills and Ability to meet deadlines are a must

xiv.      Microsoft Azure Certification is a plus

xv.      Python and Java are a plus

xvi.      Experience with X12(837,834,278) and HL7 transactions preferred

  1. Work Environment
    1. The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job.  Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Essential Physical Functions:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.  Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.


  1. While performing the duties of this job, the employee is regularly required to talk or hear. The employee regularly is required to stand, walk, sit, use hand to finger, handle or feel objects, tools, or controls; and reach with hands and arms.
  2. The employee frequently lifts and/or moves up to 10 pounds. Specific vision abilities required by this job include close vision and the ability to adjust focus.

Alignment Healthcare, LLC is proud to practice Equal Employment Opportunity and Affirmative Action. We are looking for diversity in qualified candidates for employment: Minority/Female/Disable/Protected Veteran.

If you require any reasonable accommodation under the Americans with Disabilities Act (ADA) in completing the online application, interviewing, completing any pre-employment testing or otherwise participating in the employee selection process, please contact [email protected].

City: Remote-US

State: California

Location City: Remote-US

Location State: California

Community / Marketing Title: Big Data Engineer

Company Profile:

By leveraging our world-class technology platform, innovative care delivery models, deep physician partnerships and our serving heart culture, Alignment Health is revolutionizing health care for seniors! From member experience professionals and clinicians, to data scientists and operations leaders, we have built a talented and passionate team that is deeply committed to our mission of transforming health care for the seniors we serve. Ready to join us?

At Alignment, delivering exceptional care to seniors starts with ensuring an exceptional experience for our over 1,300 employees. At the center of our employee experience is a culture where employees at all levels and across all teams are encouraged to share their unique ideas and perspectives. After all, when you can bring your authentic self to work, whether that’s in a clinical setting, our corporate office or a home office, creativity and innovation flourish! Another important part of the Alignment culture is a belief in continuous learning and growth. As a result, in this fast-growing company, you will find ample support to grow your skills and your career – with us.

EEO Employer Verbiage:


Please note: All clinical positions are contingent upon successful engagement with Alignment Health’s COVID-19 Vaccination program (fully vaccinated with documented proof or approved exception/deferral).

Alignment Health is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, age, protected veteran status, gender identity, or sexual orientation.

*DISCLAIMER: Please beware of recruitment phishing scams affecting Alignment Health and other employers where individuals receive fraudulent employment-related offers in exchange for money or other sensitive personal information. Please be advised that Alignment Health and its subsidiaries will never ask you for a credit card, send you a check, or ask you for any type of payment as part of consideration for employment with our company. If you feel that you have been the victim of a scam such as this, please report the incident to the Federal Trade Commission at If you would like to verify the legitimacy of an email sent by or on behalf of Alignment Health’s talent acquisition team, please email [email protected].