CaryRecruiter Since 2001
the smart solution for Cary jobs

Lead Software Development Engineer - Big Data

Company: Siemens
Location: Cary
Posted on: November 11, 2019

Job Description:

**Job Location:** United States : North Carolina : Cary **Role Value Proposition:** Work and collaborate with a nimble, autonomous, cross-functional team of makers, breakers, doers, and disruptors who love to solve real problems and meet real customer needs. You will be using cutting-edge technologies and frameworks to analyze data, to help create the pipeline, and collaborate with the data science team to enable the innovative work in machine learning and AI. Were looking for eagerness to learn new technologies on the fly and ship to production. More than just a job we hire people who love what they do! **Key Responsibilities:** + Building and Implementing data ingestion and curation process developed using Big data tools such as Spark(Scala/python), Data bricks, Delta lake, Hive, Pig, Spark, HDFS, Oozie,Sqoop,Flume,Zookeeper, Kerberos,Sentry,Impala etc. + Ingesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable and maintainable ETL code. + Monitoring performance and advising any necessary infrastructure changes. + Defining data security principals and policies using Ranger and Kerberos. + Assisting application developers and advising on efficient big data application development using cutting edge technologies. **Essential Business Experience and Technical Skills:** + 6+ years of solutions development experience + **Proficiency and extensive Experience with Spark & Scala, Python and performance as well as Hive database management and Performance tuning is a MUST. (Partitioning / Bucketing )** + **Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.** + Strong analytic skills related to working with unstructured datasets. + Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming and experience in any model management methodologies. **Required:** + Proficiency and extensive experience in HDFS, Hive, Spark,Scala, Python, Databricks/Delta Lake, Flume, Kafka etc. + **Analytical skills to analyze situations and come to optimal and efficient solution based on requirements and performance tuning and problem-solving skills is a must** + **Hive database management and Performance tuning is a MUST. (Partitioning / Bucketing )** + Hands on development experience and high proficiency in Java or , Python, Scala and SQL + Experience designing multi-tenant, containerized Hadoop architecture for memory/CPU management/sharing across different LOBs **Preferred:** + **Proficiency and extensive Experience with Spark & Scala, Python and performance tuning is a MUST** + **Hive database management and Performance tuning is a MUST. (Partitioning / Bucketing )** + **Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.** + Knowledge in data science is a plus + Experience with Informatica PC/BDM 10 and implemented push down processing into Hadoop platform, **is a huge plus** . + Proficiency is using tools Git, Bamboo and other continuous integration and deployment tools + Exposure to data governance principles such as Metadata , Lineage (Colibra/Atlas) etc. **At MetLife, were leading the global transformation of an industry weve long defined. United in purpose, diverse in perspective, were dedicated to making a difference in the lives of our customers.** MetLife is a proud equal opportunity/affirmative action employer committed to attracting, retaining, and maximizing the performance of a diverse and inclusive workforce. It is MetLife's policy to ensure equal employment opportunity without discrimination or harassment based on race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, age, disability, national origin, marital or domestic/civil partnership status, genetic information, citizenship status, uniformed service member or veteran status, or any other characteristic protected by law. MetLife maintains a drug-free workplace. **For immediate consideration, click the button. You will be directed to complete an on-line profile. Upon completion, you will receive an automated confirmation email verifying you have successfully applied to the job.** Requisition #: ****** Categories - Information Technology - Mechanical Engineering - Applied Mechanics Posted: 2019-10-31 Expires: 2019-12-01 Siemens - See more jobs from this location

Keywords: Siemens, Cary , Lead Software Development Engineer - Big Data, IT / Software / Systems , Cary, North Carolina

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


.Net Developer [ all levels needed ]
Description: Responsibilities for Net Developer ul li Write clean, scalable code using .NET programming languages li Remain up to date with the terminology, concepts and best
Company: Vaco Technology
Location: Raleigh
Posted on: 11/17/2019

Java Full Stack Engineer
Description: Veritude is hiring a Java Full Stack Developer to work at Fidelity Investments in Durham, NC br br You will be aligned to the eMoney Wealth Services eWS team in Fidelity Brokerage Technology. You (more...)
Company: Veritude
Location: Durham
Posted on: 11/17/2019

Lead Software Developer
Description: Do you possess broad expertise in C , PHP, MySQL, Node.js, or Ruby on Rails, coupled with significant experience as a Software Developer If so, we may have the ideal role for you with our client in (more...)
Company: Eliassen Group
Location: Raleigh
Posted on: 11/17/2019


Software Engineer 2
Description: RESPONSIBILITIES:Kforce has a client in search of a Software Engineer 2 in Morrisville, North Carolina NC . br br Overview: br br As an expert full-stack software developer, this is a unique (more...)
Company: Kforce
Location: Durham
Posted on: 11/17/2019

Backend Developer (Jr to Mid-level) NO C2C
Description: Backend .Net Developer Note: U.S. Citizens and those authorized to work in the U.S. without sponsorship are encouraged to apply. We are unable to sponsor at this time. These are direct-hire roles with (more...)
Company: Kelly Services
Location: Raleigh
Posted on: 11/17/2019

Tier 2 Technical (satellite/RF) Support Representative
Description: Allbridge delivers one connected experience with all data, video and voice technologies for hospitality, healthcare and higher education organizations. Formerly Bulk TV Internet, DCI Design Communications (more...)
Company: Allbridge
Location: Raleigh
Posted on: 11/17/2019

UX Analyst - Raleigh, NC
Description: Job Environment: ul li Extremely fast paced li Agile ran environment li Flexibility
Company: Vaco Technology
Location: Raleigh
Posted on: 11/17/2019

Software Engineer 2
Description: RESPONSIBILITIES:Kforce has a client in search of a Software Engineer 2 in Morrisville, North Carolina NC .Overview:As an expert full-stack software developer, this is a unique opportunity to leverage (more...)
Company: Kforce Technology Staffing
Location: Durham
Posted on: 11/17/2019

Tier 2 Technical (satellite/RF) Support Representative
Description: Allbridge delivers one connected experience with all data, video and voice technologies for hospitality, healthcare and higher education organizations. Formerly Bulk TV Internet, DCI Design Communications (more...)
Company: Allbridge
Location: Raleigh
Posted on: 11/17/2019

PL/SQL Developer
Description: Please contact Bhavna Khanna at 925 627 4981 or email for any questionsPL/SQL DeveloperLocation: Raleigh, NCFulltime Qualifications: ul li Data warehouse design
Company: The Ascent Services Group
Location: Raleigh
Posted on: 11/17/2019

Log In or Create An Account

Get the latest North Carolina jobs by following @recnetNC on Twitter!

Cary RSS job feeds