SanJoseCARecruiter Since 2001
the smart solution for San Jose jobs

Big Data Engineer

Company: Prosimo.io
Location: San Jose
Posted on: July 15, 2019

Job Description:

Big Data Engineer Your Impact - As a senior level Big Data Engineer, you will be an integral member of our Big Data and Analytics team responsible for design and development Partner with data analyst, product owners and data scientists, to better understand requirements, finding bottlenecks, resolutions, etc. Design and develop Big Data solutions in Cloud Design and develop different architectural models for our scalable data processing as well as scalable data storage Build data pipelines and ETL using heterogeneous sources using Dataflow or DataProc Build data ingestion from various source systems to GCP or AWS using Kafka, Flume, Sqoop, Spark Streaming etc. Transform data, using data mapping and data processing in Apache Beam or Spark Responsible to ensure that the platform goes through Continuous Integration (CI) and Continuous Deployment (CD) with DevOps automation Expands and grows data platform capabilities to tackle new data problems and challenges Supports Big Data and batch/real time analytical solutions using groundbreaking technologies like Apache Beam Have the ability to research and assess open source technologies and components to recommend and integrate into the design and implementation Work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services Your Experience Degree in Master of Science in Computer Science or equivalent 5+ years of experience with the Hadoop ecosystem and Big Data technologies 2+ year of experience in Cloud computing Competent in writing Scala, Python or Java code. Development experience in Dataflow or DataProc is a Plus Ability to dynamically adapt to conventional big data frameworks and tools with the use-cases required by the project Experience with building stream-processing systems using solutions such as spark-streaming, Storm or Flink etc. Experience in other open-sources like Druid, Elastic Search, Logstash etc. is a plus Knowledge of design strategies for developing scalable, resilient, always-on data lake Some knowledge of agile(scrum) development methodology is a plus Strong development/automation skills Excellent inter-personal and teamwork skills Can-do attitude on problem solving, quality and ability to execute

Keywords: Prosimo.io, San Jose , Big Data Engineer, Engineering , San Jose, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Facilities Technician
Description: Facilities Technician SUMMARYThe Facilities Technician provides Facilities support and customer service via completion of general to advanced level tasks, repairs, and preventative maintenance, particularly (more...)
Company: Guide Dogs for the Blind
Location: San Rafael
Posted on: 07/23/2019

HVAC Service Technician
Description: Synergy Companies is searching for qualified individuals to become a part of our team Exceptional candidates are encouraged to apply What we have to offer: ul li Salary depends on experience bonuses (more...)
Company: Synergy Companies
Location: Stockton
Posted on: 07/23/2019

Maintenance Technician
Description: br br Our Maintenance Technicians are responsible for ensuring the building, grounds and equipment remain in optimal condition and eliminate down time. You will work as part of a team under the direction (more...)
Company: O'Reilly Auto Parts
Location: Stockton
Posted on: 07/23/2019


DevOps Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring devops engineers. Want to work for a company you love Are you a DevOps (more...)
Company: Hired
Location: San Rafael
Posted on: 07/23/2019

Build/ Release Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring build and release engineers.Want to work for a company you love Are you (more...)
Company: Hired
Location: San Rafael
Posted on: 07/23/2019

Mechanic B
Description: Company DescriptionFoster Farms has been a family-owned and operated company for four generations. Since our founding days back in 1939, we have always been committed to providing consumers with the highest-quality, (more...)
Company: Foster Farms
Location: Turlock
Posted on: 07/23/2019

Electronics Engineer Staff Member for Electro-Optical Payloads
Description: Description:An Electronics Engineer Developing Test Systems will work as part of a team of hardware and software engineers in the complete development lifecycle of Special Test Equipment STE and Electrical (more...)
Company: Lockheed Martin
Location: Sunnyvale
Posted on: 07/23/2019

91B Light-Wheel Vehicle Mechanic
Description: 91B Light-Wheel Vehicle Mechanic br br Job ID: 1076541 br br Job Views: 14 br br Location: MERCED, California, United States br br ZIP Code: 95341 br br Job Category: Mechanic and (more...)
Company: Army National Guard
Location: Merced
Posted on: 07/23/2019

Build/ Release Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring build and release engineers. Want to work for a company you love Are (more...)
Company: Hired
Location: Sunnyvale
Posted on: 07/23/2019

91B Light-Wheel Vehicle Mechanic
Description: 91B Light-Wheel Vehicle Mechanic Job ID: 1076541 Job Views: 14 Location: MERCED, California, United States ZIP Code: 95341 Job Category: Mechanic and Maintenance Posted: 07.19.2019 Age Requirements: Must (more...)
Company: Army National Guard
Location: Merced
Posted on: 07/23/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Jose RSS job feeds