The #1 Site for Finance Jobs - search all Finance jobs.

Hadoop Developer/ Kafka Developer

Description

TEKsystems is looking to hire an experience Hadoop Developer at one of our largest clients in the area.

All applicants must have the ability to work on a TEKsystems W2.



Top Skills:* Must have experienced or exposure to Hadoop ecosystem including but not limited to: HDFS, MapReduce, Spark, Sqoop, Oozie, Kafka, Hive, Impala
* Programming experience Python, PySpark, Spark SQL.
* Hands on development of various orchestrations, workflows and transformations based upon the target Hadoop MDM platform.
* Strong experience with Scala, Spark, Hive and Kafka.

Description:
Infrastructure Information Services is looking for top talent to design and build best-in-class Data Management and Integration Services capability over Infrastructure/ITSM data using Hadoop Architecture.
The Data Engineer will innovate and transform the systems integration landscape for the Technology Infrastructure organization, while following industry best practices and providing capability maturity in support of Enterprise Data Management standards. The ideal candidate is an expert in Data Warehousing and Master Data Management Design and Development. Candidate should have a strong understanding of data management concepts and applied DW/MDM development of DB-level routines and objects. Candidate should have experience in migrating traditional Relational Database Management System (RDBMS) to a Hadoop based architecture. In addition have hands on experience developing in many of the Apache Hadoop based tools. It involves hands-on development and support of integrations with multiple systems and ensuring accuracy and quality of data by implementing business and technical reconciliations. Candidate needs to be able to understand macro level requirements and convert them into actionable tasks to deliver a technically sound product. Candidate should be able to work in teams in a collaborative manner.
Major Duties:
* Analyze current RDBMS Master Data Management platform including orchestrations, workflows, transformations and help design a scalable platform based on Hadoop for structured and semi-structure big data.
* Assist in evaluating and developing a right fit replacement language architecture leveraging MapReduce and Spark.
* Hands on development of various orchestrations, workflows and transformations based upon the target Hadoop MDM platform.
* Define standards and guidelines around Scalability, Security, Logging, Auditing, Policy Management and Performance Monitoring and KPI for end-to-end process execution
* Ability to manage multiple priorities

Required Job Skills:
* 10+ years of total IT experience
* Over 5 years of experience developing for Data Warehousing, Data Marts, and/or Master Data Management
* Exposure to Relational Database Management Systems using Oracle, DB2 or SQL Server
* Possesses and demonstrates deep knowledge of the Hadoop Ecosystem
* Experienced exposure to Hadoop ecosystem including but not limited to: HDFS, MapReduce, Spark, Sqoop, Oozie, Kafka, Hive, Impala
* Deep experience on Hadoop Spark, HIVE, Kudu and HDFS with an emphasis on performance tuning and architecture. E.g. partitioning, bucketing and parquet, flat file
* Programming experience Python, PySpark, Spark SQL.
* Object oriented programming concepts
* Expert SQL skills
* Experience in SDLC and best practices for development
* Ability to work against mid-level design documentation, take it to a low-level design, and deliver a solution that meets the success criteria
* Knowledge of packaging and promotion practices for maintaining code in development, test, and production

Desired Job Skills:
* Fundamental knowledge of IT Service Management/ITIL processes and tools
* Data Virtualization using Cisco's Information Server (Composite)
* Experience with Jira & Bitbucket
* Cloudera Manager CDH Administration
* ETL Tool - Syncsort DMX-h
* Autosys and Oozie




About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.



The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please call 888 472-3411 or email [email protected] .com for other accommodation options.

Requirements

 

Job Snapshot

Location US-NC-Charlotte
Employment Type Full-Time
Pay Type Year
Pay Rate N/A
Store Type Banking
Apply

Company Overview

TEKsystems, Inc

We’re partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services and real-world application, we work with progressive leaders to drive change. That’s the power of true partnership. TEKsystems is an Allegis Group company. Learn More

Contact Information

US-NC-Charlotte
Austin Pugh
Snapshot
TEKsystems, Inc
Company:
US-NC-Charlotte
Location:
Full-Time
Employment Type:
Year
Pay Type:
N/A
Pay Rate:
Banking
Store Type:

Description

TEKsystems is looking to hire an experience Hadoop Developer at one of our largest clients in the area.

All applicants must have the ability to work on a TEKsystems W2.



Top Skills:* Must have experienced or exposure to Hadoop ecosystem including but not limited to: HDFS, MapReduce, Spark, Sqoop, Oozie, Kafka, Hive, Impala
* Programming experience Python, PySpark, Spark SQL.
* Hands on development of various orchestrations, workflows and transformations based upon the target Hadoop MDM platform.
* Strong experience with Scala, Spark, Hive and Kafka.

Description:
Infrastructure Information Services is looking for top talent to design and build best-in-class Data Management and Integration Services capability over Infrastructure/ITSM data using Hadoop Architecture.
The Data Engineer will innovate and transform the systems integration landscape for the Technology Infrastructure organization, while following industry best practices and providing capability maturity in support of Enterprise Data Management standards. The ideal candidate is an expert in Data Warehousing and Master Data Management Design and Development. Candidate should have a strong understanding of data management concepts and applied DW/MDM development of DB-level routines and objects. Candidate should have experience in migrating traditional Relational Database Management System (RDBMS) to a Hadoop based architecture. In addition have hands on experience developing in many of the Apache Hadoop based tools. It involves hands-on development and support of integrations with multiple systems and ensuring accuracy and quality of data by implementing business and technical reconciliations. Candidate needs to be able to understand macro level requirements and convert them into actionable tasks to deliver a technically sound product. Candidate should be able to work in teams in a collaborative manner.
Major Duties:
* Analyze current RDBMS Master Data Management platform including orchestrations, workflows, transformations and help design a scalable platform based on Hadoop for structured and semi-structure big data.
* Assist in evaluating and developing a right fit replacement language architecture leveraging MapReduce and Spark.
* Hands on development of various orchestrations, workflows and transformations based upon the target Hadoop MDM platform.
* Define standards and guidelines around Scalability, Security, Logging, Auditing, Policy Management and Performance Monitoring and KPI for end-to-end process execution
* Ability to manage multiple priorities

Required Job Skills:
* 10+ years of total IT experience
* Over 5 years of experience developing for Data Warehousing, Data Marts, and/or Master Data Management
* Exposure to Relational Database Management Systems using Oracle, DB2 or SQL Server
* Possesses and demonstrates deep knowledge of the Hadoop Ecosystem
* Experienced exposure to Hadoop ecosystem including but not limited to: HDFS, MapReduce, Spark, Sqoop, Oozie, Kafka, Hive, Impala
* Deep experience on Hadoop Spark, HIVE, Kudu and HDFS with an emphasis on performance tuning and architecture. E.g. partitioning, bucketing and parquet, flat file
* Programming experience Python, PySpark, Spark SQL.
* Object oriented programming concepts
* Expert SQL skills
* Experience in SDLC and best practices for development
* Ability to work against mid-level design documentation, take it to a low-level design, and deliver a solution that meets the success criteria
* Knowledge of packaging and promotion practices for maintaining code in development, test, and production

Desired Job Skills:
* Fundamental knowledge of IT Service Management/ITIL processes and tools
* Data Virtualization using Cisco's Information Server (Composite)
* Experience with Jira & Bitbucket
* Cloudera Manager CDH Administration
* ETL Tool - Syncsort DMX-h
* Autosys and Oozie




About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.



The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please call 888 472-3411 or email [email protected] .com for other accommodation options.

Requirements

 
MoneyJobs Advice

For your privacy and protection, when applying to a job online: Never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction.Learn More

By applying to a job using moneyjobs.com you are agreeing to comply with and be subject to the workinretail.com Terms and Conditions for use of our website. To use our website, you must agree with theTerms & Conditionsand both meet and comply with their provisions.
Hadoop Developer/ Kafka Developer Apply now