Data Platform Engineer (3-4 Month Contract)
Plymouth Meeting, PA 
Share
Posted 1 day ago
Job Description
Job Details
Job Location
Remote - ,
Remote Type
Fully Remote
Position Type
Contractor
Education Level
2 Year Degree
 
Travel Percentage
None
Job Shift
Day
Job Category
Information Technology

A Data Platform Engineer (3-4 Month Contract) at ECRI Institute will design, build, operate and support public cloud hosted dynamic data pipelines and lakes in the Azure public cloud, using Azure Databricks and related technologies such as Apache Spark, Beam and Airflow. These pipelines retrieve and process streams and batches of health care specific information in multiple formats and schemas such as XML, JSON, RSS, scraped structured and unstructured information and human readable text from HTML, PDFs, and other document types.

The Data Platform Engineer will work with ECRI data specialists by using data virtualization such as Apache Drill, search, and analytics to curate the ingestion processing and continually review, improve, and refine the ingestion of data from sources captured daily. This ingestion curation work will be facilitated by business rules and dictionaries maintained by the ECRI data specialists.

Applicants with analytical experience may also be responsible for additional data pipelines that apply Natural Language Processing, normalization, categorization, tagging, and taxonomies to records that are streamed to relational databases. In this case an understanding of data modeling, ontologies and R may be useful.

ESSENTIAL FUNCTIONS

Reasonable Accommodations Statement

To accomplish this job successfully, an individual must be able to perform, with or without reasonable accommodation, each essential function satisfactorily. Reasonable accommodations may be made to help enable qualified individuals with disabilities to perform the essential functions.

Essential Functions Statements(s)

  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Assist in gathering and document business requirements.
  • Support and work with cross-functional teams.
  • Participate in team meetings and code reviews.
  • Work independently and within a team when needed.

Minimum Requirements:

  • 3-5 years hands on experience in Python and at least three modern languages and frameworks such as: C#, Java, Node.JS, .NET Core, Swift, Kotlin, Rust.
  • 3-5 years hands on experience with data pipelines and related disciplines.
  • Experience with relational SQL and NoSQL databases.
  • Experience with agile methodologies.

Critical Skills

  • Ability to communicate effectively, be able to present findings, easily communicate complex ideas, translate the data into an understandable document, learn from others, and adopt standards.
  • Ability to analyze large amounts of data: facts, figures, and numbers to find conclusions and actionable recommendations to business groups.
  • Ability to troubleshoot and effectively diagnose and fix problems.
  • Attention to Details.

Beneficial Additional Knowledge and Skills (not required):

  • Microsoft Azure public cloud related technologies.
  • Familiarity with DevOps technologies such as Containers, Kubernetes, Chef, Puppet, Ansible.
  • Familiarity with CI/CD pipelines.
  • Relational Data Modeling
  • Ontologies
  • R (the programming language)

Education

  • Associate/Bachelors degree in Computer Science or related major.

OR:

  • Equivalent professional experience.

PHYSICAL DEMANDS

N (Not Applicable)

Activity is not applicable to this position.

O (Occasionally)

Position requires this activity up to 33% of the time (0 - 2.5+ hrs/day)

F (Frequently)

Position requires this activity from 33% - 66% of the time (2.5 - 5.5+ hrs/day)

C (Constantly)

Position requires this activity more than 66% of the time (5.5+ hrs/day)

Physical Demands

Stand

OAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA Lift/Carry

Walk

FAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AA10 lbs or lessAAAAA O

Sit

CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 11-20 lbsAAAAAAAAAAAA N

Manually Manipulate

CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 21-50 lbsAAAAAAAAAAAA N

Grasp

OAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAA51-100 lbsAAAAAAAAAA N

Reach Outward

OAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA Over 100 lbsAAAAAA N

Reach Above Shoulder

N

Speak

CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA Push/Pull

Climb

NAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 12 lbs or lessAAAAA ANAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA

Crawl

NAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 13-25 lbsAAAAAAAAAAAA N

Squat or Kneel

NAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 26-40 lbsA AAAAAAAAAAAN

Bend

NAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 41-100 lbsAAAAAAAAAA N

Other Physical Requirements

  • Vision (Near)

WORK ENVIRONMENT

AAAAAA Typical Office Environment

A

#LI-Remote

Equal Opportunity Employer-Disability and Veteran


EOE Minority/Female/Disability/Veteran

 

Job Summary
Company
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Work Hours (i.e. shift)
Day
Required Education
Associate Degree
Required Experience
3 to 5 years
Email this Job to Yourself or a Friend
Indicates required fields