Primary Role This position will be responsible for implementing ETL design and development plus system administration of applications used to support data integration for the Analytics Center of Excellence (ACE) Foundations team. The ETL Developer will work closely with members of other ACE groups and team members to understand all project requirements that encompass the ETL and data integration realm, as well as contribute to solution development. The ETL Developer will provide technical expertise, implementation and support for ETL/data integration purposes. This position is responsible for ensuring that each solution is extensible, adheres to ACE architectural and industry standards, and is maintainable and operational with minimum manual interference.
Essential Tasks/Responsibilities
Design and document ETL process in support of analytics/data integration projects
Create data extraction, cleansing and load programs to move data into and out of the data environment; including on premise and Azure Cloud environments
Work with Agile team members to document and execute test plans for data loading and data validation scripts. Support the code promotion process through development and production as required.
Develop, implement and maintain schedule/dependency logic for automated ETL processing. Develop monitoring, logging, and error notification processes to ensure data is updated as expected and processing metrics reported.
Participate in the creation and maintenance of standards for coding, documentation, error handling, error notification, logging, etc.
Accountable for conforming to established architectural, developmental, and operational standards and practices including creation of ETL metadata.
Work with other team members in establishing and sharing design and development techniques of the ETL process.
Assist in the maintenance and administration of applications and software used by ACE
Evaluate and recommend database development tools
Assist in application and database performance tuning
Participate in system architecture design
Implement integration and interface tools between transactional and data warehousing systems
Work with Quality Assurance to assist with unit and integrated testing.
Share trouble-shooting and maintenance duties
Education/training
Bachelor's degree in a related field, or four years of equivalent technical experience required
Licensure/Certification:
None required. Preferred certification in development technologies, as appropriate for the position. Experience
Minimum two years of directly related experience is required.
Experience within the Health Care realm is desired.
Skills
Knowledge and experience in relational and dimensional database design techniques.
Experience in SQL, database programming and utilities
Intermediate Postgres, Oracle, and MS SQL server proficiency
Excellent analytical skills required.
Previous experience with data modeling required.
In depth knowledge and experience with ETL development and applying sound ETL techniques and modular system design skills are essential.
Experience with developing sound technical documentation is required.
Ability to identify and resolve data quality issues within the ETL realm.
Understanding of and experience with basic DBA skills such as, physical modeling, table partitioning and indexing is required.
Knowledge of system architecture design
Familiarity with daemon/job scheduling (SSIS, IWS, Airflow, RabbitMQ, etc.)
Previous experience with data warehousing systems design and development a plus.
PL/SQL, UNIX desired
Apache Soir knowledge a plus
Basic IBM IWS ability
FHIR knowledge desired
Experience working with Azure desired
Experience working with APIs
The information above describes the general nature and level of work assigned to this position. It is not intended to be an exhaustive list of all duties and responsibilities required of position incumbents.
Duke is an Affirmative Action/Equal Opportunity Employer committed to providing employment opportunity without regard to an individual's age, color, disability, gender, gender expression, gender identity, genetic information, national origin, race, religion, sex, sexual orientation, or veteran status.
Duke aspires to create a community built on collaboration, innovation, creativity, and belonging. Our collective success depends on the robust exchange of ideas-an exchange that is best when the rich diversity of our perspectives, backgrounds, and experiences flourishes. To achieve this exchange, it is essential that all members of the community feel secure and welcome, that the contributions of all individuals are respected, and that all voices are heard. All members of our community have a responsibility to uphold these values.
Essential Physical Job Functions: Certain jobs at Duke University and Duke University Health System may include essentialjob functions that require specific physical and/or mental abilities. Additional information and provision for requests for reasonable accommodation will be provided by each hiring department.
As a world-class academic and health care system, Duke Health strives to transform medicine and health locally and globally through innovative scientific research, rapid translation of breakthrough discoveries, educating future clinical and scientific leaders, advocating and practicing evidence-based medicine to improve community health, and leading efforts to eliminate health inequalities.