Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TTZzdDZ6cXRneEdsQ3FCZlpCdDBNdDVPbUE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Cyberbacker

Executive Virtual Assistant - Work From Home Job at Cyberbacker

 ...We are hiring a Virtual Assistant who are skillful and professionally talented. We offer a variety of job opportunities in various fields and business departments that could be a perfect fit for your skills and qualifications. The ideal candidate will be proactive, detail... 

Travel Staff

Manager of Tour Directors Job at Travel Staff

** In-office (Redondo Beach, CA) or Remote** Summary: The Manager of Tour Directors is responsible for overseeing the scheduling, recruiting, training, and performance of our network of freelance Tour Directors. This role ensures that every group departure is staffed... 

Capitol Orthodontics

Data Entry Clerk / Office Assistant - Remote Job at Capitol Orthodontics

 ...Position Overview: Are you looking for a flexible, rewarding opportunity to work from the comfort of your own home? Were seeking motivated...  ...Environment: This fully remote position offers flexible hours, perfect for self-motivated individuals who excel in virtual... 

Winchester Optical, Inc.

Licensed Optician Job at Winchester Optical, Inc.

 ...prepare patients billing information~Comply with all company policies and procedures including HIPAAQualifications~Licensed Optician required~ABO/NCLE certification required~Previous sales experience required~Optical finishing lab experience is a PLUS!~... 

CVS Health

Medical Scribe Job at CVS Health

 ...compassionate. And we do it all with heart, each and every day.Job Description**Company:** Oak Street Health**Title:** Medical Scribe (Full-time in Primary Care Setting)**Role Description**The purpose of a Medical Scribe at Oak Street Health is to support our primary...