Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TTZzdDZ6cXRneEdsQ3FCZlpCdDBNdDVPbUE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Baxter International Inc

Materials Supervisor Job at Baxter International Inc

 ...This is where you save and sustain lives At Baxter, we are deeply connected by our mission. No matter your role at Baxter, your work makes a positive impact on people around the world. Youll feel a sense of purpose throughout the organization, as we know our work... 

Homes of America, LLC

Title Coordinator Job at Homes of America, LLC

 ...As a Title Coordinator , you will be responsible for managing title transfers, organizing our title database, and collaborating with...  ...needed. Create and maintain an organized system for managing the companys existing and new titles. Audit title records to ensure all... 

XPO

Executive Assistant and Office Manager Job at XPO

 ...What youll need to succeed as an Executive Assistant and Office Manager at XPO Minimum qualifications: ~ Bachelor's degree or equivalent related work or military experience ~2 or more years of experience in an administrative or executive support role ~ Proficient... 

Panasonic Avionics Corporation

Golang Network Developer Job at Panasonic Avionics Corporation

 ...job opportunities go to ( **The position:** __Panasonic is developing the next generation of GEO/LEO satellite and 5G cellular...  ...**KNOWLEDGE/SKILL REQUIREMENTS**+ Strong proven experience in Golang+ Deep knowledge and experience in multi-threaded embedded software... 

Intercontinental Exchange Holdings, Inc.

Senior Software Engineer (Node.js/React) Job at Intercontinental Exchange Holdings, Inc.

 ...skills and real passion for innovation to help us develop the next generation mortgage automation solution....  ...for web/mobile applications using the react.js, to experience in backend technology using C#, Java and node.js. Including work on full stack environment from...