CaryRecruiter
the smart solution for Cary jobs

Big Data Engineer

Company: Software Guidance & Assistance
Location: Cary
Posted on: September 14, 2018

Job Description:

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a contract assignment with one of our premier financial services clients in Cary, NC.

We are looking for a Big Data Engineer who will work on the collecting, storing, processing, and analysing of huge sets of data. Transforming the data using Bigdata tools. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Responsibilities:

  • Ingesting huge volumes data from various platforms for Analytics needs.
  • Building and Implementing ETL process developed using Big data tools such as Spark (Scala/python), Hbase, Apache Solr, Kafka, Nifi etc.
  • Monitoring performance and advising any necessary infrastructure changes.
  • Defining data security principles and policies using Ranger and Kerberos.
  • Works with IT and business customers to develop and design requirements to formulate technical design.
  • Supervisory Responsibilities: Leads and motivates project team members that are not direct reports, as well as providing work direction to lower-level staff members
  • Skills to understand the right functional domain knowledge of the business to be able to gather right requirements for the design Required Skills:
    • 10+ years of solutions development experience
    • Proficient understanding of distributed computing principles
    • Experience in building a DataLake using BigData Ecosystems.
    • Management of Hadoop cluster, with all included services preferably Hortonworks.
    • Proficiency with Hadoop v2, MapReduce, HDFS, and related components
    • Proficiency in Unix Scripting
    • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
    • Experience dealing with unstructured data formats while ingesting in to the platform and exposing for consumption purposes.
    • Experience on search applications, such as Apache Solr 6.5+ version. SGA is a Certified Women's Business Enterprise (WBE) celebrating over thirty years of service to our national client base for both permanent placement and consulting opportunities.

      Keywords: Software Guidance & Assistance, Cary , Big Data Engineer, Engineering , Cary, North Carolina

      Click here to apply!

      Didn't find what you're looking for? Search again!


      I'm looking for
      in category
      within


Other Engineering Jobs


Highway Engineer
Description: Raleigh, NC br br We are an engineering recruiting firm with decades of experience and have successfully placed candidates in positions for over 13 years. Our recruiters look forward to reviewing (more...)
Company: On Point LLC
Location: Raleigh
Posted on: 09/21/2018

SiteMinder Engineer
Description: Software Guidance Assistance, Inc., SGA , is searching for a SiteMinder Engineer for a CONTRACT assignment with one of our premier Insurance clients in Cary, NC. This
Company: Software Guidance & Assistance
Location: Cary
Posted on: 09/23/2018

Senior Product Development Engineer
Description: Reynolds American Incorporated is positively transforming the tobacco industry. Were a family of companies that strives for success in everything we do. The future inspires us because our people are igniting (more...)
Company: RAI Innovations Company
Location: Winston Salem
Posted on: 09/23/2018


91B Light-Wheel Vehicle Mechanic
Description:
Company: Army National Guard
Location: Winston Salem
Posted on: 09/21/2018

performance engineer
Description: Description br br This role combines systems architecture and troubleshooting skills, performance testing, experimental methods, tool development and the opportunity to work with emerging changes (more...)
Company: Nutanix
Location: Durham
Posted on: 09/23/2018

91P Artillery Mechanic
Description: Since the Army National Guard relies on an array of electrical systems and components for targeting, aiming, and firing artillery weapons, we need experts to perform the necessary work on our field artillery (more...)
Company: Army National Guard
Location: High Point
Posted on: 09/21/2018

Automotive Service Technician
Description: Auction Direct USA, Used Vehicle Superstore, is seeking Automotive Technicians to join our team Our shop
Company: Marylou Williams
Location: Durham
Posted on: 09/21/2018

Assistant Structural Bridge Engineer (ID# 38392)
Description: Assistant Structural Bridge Engineer ID 38392 Raleigh, NC Category: Bridges Structures
Company: WSP
Location: Raleigh
Posted on: 09/23/2018

Traffic Engineer
Description: VHBs Raleigh, NC office is looking for a Traffic Engineer to join our growing traffic engineering team. VHBs passionate professionals include engineers, scientists, planners, and designers who partner (more...)
Company: VHB
Location: Raleigh
Posted on: 09/23/2018

Senior Traffic Engineer
Description: VHBs growing Raleigh, NC office has an exciting opportunity for a Traffic Engineer to join our Transportation team. VHBs passionate professionals include engineers, scientists, planners, and designers (more...)
Company: VHB
Location: Raleigh
Posted on: 09/23/2018

Log In or Create An Account


Find us on Facebook

Find us on LinkedIn

Get the latest North Carolina jobs by following @recnetNC on Twitter!

Cary RSS job feeds