Remote Lead Data Engineer Job at Global Channel Management, Texas City, TX

  • Global Channel Management
  • Texas City, TX

Job Description

Remote Lead Data Engineer

Dallas, Texas, United States

$ 100.00 - 110.00 (US Dollar)

Remote Lead Data Engineer needs 7+ years experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)

Remote Lead Data Engineer requires:

Strong background in math, statistics, computer science, data science or related discipline

Advanced knowledge one of language: Java, Scala, Python, C#

Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake

Proficient with:

Data mining/programming tools (e.g. SAS, SQL, R, Python)

Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

Data visualization (e.g. Tableau, Looker, MicroStrategy)

Comfortable learning about and deploying new technologies and tools.

Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.

Good written and oral communication skills and ability to present results to non-technical audiences

Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus:

AWS certification

Spark Streaming

Kafka Streaming / Kafka Connect

ELK Stack

Cassandra / MongoDB

CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Remote Lead Data Engineer duties:

Create and manage cloud resources in AWS

Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies

Data processing/transformation using various technologies such as Spark and Cloud Services.

Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations

Job Tags

Similar Jobs

Dutchman Hospitality Group

Host & Hostess Job at Dutchman Hospitality Group

 ...supplemental insurances are available for employees who work at least 30 hours/week. Apply if you are also interested in: Host, Hostess, Restaurant Host, Restaurant Hostess, Guest Services, Customer Service, Hospitality, Front of House, Greeter, Seating Guests,... 

Clean Harbors

Mobile Product Owner Job at Clean Harbors

We are looking for a hands-on Mobile Product Owner to support the day-to-day product management and delivery of enterprise mobile applications. This role will work closely with business stakeholders, UX, engineering, QA, and technology teams to translate business needs... 

Prosidian Consultng

Digital Experience / Portal Architect Job at Prosidian Consultng

 ...Management | Compliance | Business Process | IT Effectiveness | Engineering | Environmental | Sustainability | Human Capital. We help...  ...for public and private, defense and civilian government, and non-profit organizations. Our solution-centric services are deployed across... 

CaseGuard

UI/UX Designer Job at CaseGuard

 ...UI/UX Designer Arlington, VA CaseGuard Studio is seeking a talented user interface designer to join our team. This role offers the opportunity to use superior UX/UI skills to translate high-level requirements into interaction flows and artifacts, transforming them... 

Indigo Dental Staffing

Dental Assistant Job at Indigo Dental Staffing

 ...Why Indigo? No Experience? No Problem! Training available. Career Growth: Work with top dental offices. Flexible Hours: Full-time or part-time options. Perfect Match: We place you in an office that fits your vibe. What You'll Do Assist dentists during...