Lead Data Engineer Job at Purple Hires Inc, Madison, WI

  • Purple Hires Inc
  • Madison, WI

Job Description

Position: Lead Data Engineer

Location: Madison WI 53783 - Hybrid - 2-3 Days in Office candidate needs to be within 40 to 45 miles of

3 months contract



Job Description


Primary Accountabilities

Leads an engineering team to meet project deadlines and priorities.
Supervises assigned data engineering team members & activities.
Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
Documents critical workflows and operational support aspects of team's responsibilities
Develops deep understanding of data sources, granularity, availability, and limitations.
Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
Creates maintainable, scalable code to load and manipulate data in the data warehouse.
Facilitates communication upward and across project teams and business stakeholders.



Specialized Knowledge & Skills Requirements
Demonstrated experience providing customer-driven solutions, support or service.

Must have GCP experience for this positon.
In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)
Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions.

Able to employ design patterns and generalize code to address common use cases.
Capable of authoring robust, high quality, reusable code and contributing to the division's inventory of libraries.

Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O.

Solid data understanding and business acumen in the data rich industries like insurance or financial
Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).

Strong understanding of database internals, such as indexes, binary logging, and transactions.
Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.)
Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
Practical experience authoring and consuming web services.

Job Tags

Contract work, Work at office

Similar Jobs

Fairview Health Services

Lead Medical Laboratory Scientist - Technical Job at Fairview Health Services

 ...Diseases Diagnostics Laboratory (IDDL) Lead MLS position at M Health Fairview University of Minnesota Medical Center-East Bank. This...  ...university in chemical, biological, clinical or medical laboratory science, or medical technology. Diploma with field of study listed or... 

Comic Book Resources (CBR)

New Releases Feature Writer | MovieWeb Job at Comic Book Resources (CBR)

 ...This is a paid freelance, remote position MovieWeb is a top destination for fans of television and movies, providing engaging and...  ...Experience and Skills At least 3 years experience in digital journalism or online publishing Strong feature writing and storytelling... 

Hyatt Hotels

Extra Room Attendant Job at Hyatt Hotels

 ...guests preferred. View our Virtual Reality Experience to spend a 'day in the life' of a hospitality professional at a full-service hotel. Salary Range: $31.7795 - $42.3726 per hour Qualifications A true desire to satisfy the needs of others in a fast... 

Kaleidoscope Family Solutions, Inc.

Behavior Support Specialist (BSS) Job at Kaleidoscope Family Solutions, Inc.

 ...Kaleidoscope Family Solutions, Inc. provides community, work, and home based services to adults with special needs. Our team partners...  ...Kaleidoscope (KFS) entity. Professionals contracting through KFS are classified and compensated as self-employed independent contractors.... 

Sunstate Equipment Co.

Class B Truck Drivers Class A and B CDL Hiring Bonus and Much More Job Job at Sunstate Equipment Co.

Class B Truck Drivers Class A and B CDL Hiring Bonus and Much More JobSEMI & ROLLBACK DRIVERS Two Locations:5420 Dahlia Street, Commerce City, CO 8002212550 E. Broncos Parkway, Englewood, CO 80112Where Safety and People are Core Values!At Sunstate, we place...