SanJoseCARecruiter Since 2001
the smart solution for San Jose jobs

Staff Data Engineer

Company: Intuit
Location: San Jose
Posted on: July 15, 2019

Job Description:

Staff Data Engineer Overview The SBSEG QuickData Platform Engineering team is enabling data-driven decisions at the highest levels of the company, and we are using big data to personalize user experiences in our products. We have migrated to the AWS Cloud and are looking for a Staff/Sr Engineer to join our QuickData Platform Team. We are looking for a strong Engineer with a passion for automation, ready for an opportunity to tackle the complex problems of scale, which are unique to Intuit, while using your expertise in AWS, platform automation, data monitoring, incident management for a big data and large-scale systems. We are looking for someone who can design, code and maintain high performance and support data infrastructure. Responsibilities Migration to AWS of data pipeline and EMR. Enhancement of a data-monitoring platform to support large-scale pipeline, supporting data Incident, including initial problem analysis, resolution. Be an onshore POC for 24/7 maintenance and support team for AWS Data platform Manage tickets raised by business team Identify opportunities for automation and platform enhancement - design and build solutions Configuration of monitoring agents at the software layer, and the development of meaningful alerts and the escalation procedures Responses to monitoring alerts according to defined playbooks and procedures Creating Tools & Framework to determine Source Discovery, Data Availability and Data Change Tracking. Real Time Application Dashboards showing overall health of the system involved in data pipeline. AWS Capacity Planning to onboard new services like EMR. Perform benchmarking & performance of AWS infrastructure via automation. Contributions to Operational Standards and Requirements Develop run books for problem diagnosis, resolution and escalation. Automate various RTB jobs using scripts/tools to speed execution Qualifications BS in Computer Science. MS Preferred. S. or higher in Computer Science or equivalent knowledge and experience Experience managing infrastructure in AWS. Apt with automating repetitive tasks using Python, Ruby, JavaScript or Bash Experience with CI/CD tools; i.e.. Jenkins Experience designing and deploying systems on AWS Enjoy a fast-paced, rapidly changing work environment Good communication skills and a passion for clean code Experience with SQL and Python(Boto3 Library) Experience with AWS products including EC2, S3, RDS, ElastiCache, ElasticSearch, Kinesis, Lambda, etc Exposure to Big Data on AWS (DataPipeline, Batch, AWS Glue, S3, EMR/EC2) Responsibilities: Be an onshore POC for 24/7 maintenance and support team for AWS Data platform Manage tickets raised by business team Identify opportunities for automation and platform enhancement - design and build solutions Strong Linux/unix background and advanced scripting knowledge in Python/Perl/Go. Extensive Experience in automation, capacity planning & benchmarking/performance testing in AWS Installing, configuring, administering some of the following: Hive,EMR etc. Implement and adhere to continuous integration practices Designing cloud infrastructure that is secure, scalable, and available on AWS Operational mindset with ability to do Problem, SLA and Incident Management. Troubleshoot issues and participate in 24x7 on-call support, ensuring the stability of the production environment. Strong critical thinking ability to assess complex problems, analyze options, navigate diverse perspectives and develop optimal/acceptable solutions Ability to work independently with minimal supervision

Keywords: Intuit, San Jose , Staff Data Engineer, Engineering , San Jose, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Senior Automation Engineer
Description: There's a revolution happening in the 36-billion-dollar database business. Companies and agencies all over the world are realizing that in order to achieve their mission, they need to think differently (more...)
Company: MarkLogic
Location: San Carlos
Posted on: 07/22/2019

Network Engineer
Description: Hot Position Need Locals Job Description Minimum 3 years hands-on expertise in implementing, administering, and troubleshooting
Company: Greatlogics
Location: San Jose
Posted on: 07/22/2019

Front-End Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring front-end developers. Want to work for a company you love Are you a Front-End (more...)
Company: Hired
Location: Stockton
Posted on: 07/22/2019


15N Avionics Mechanic
Description: 15N Avionics Mechanic br br Job ID: 1076646 br br Job Views: 25 br br Location: STOCKTON, California, United States br br ZIP Code: 95206 br br Job Category: Aviation br br Posted: (more...)
Company: Army National Guard
Location: Stockton
Posted on: 07/22/2019

Front-End Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring front-end developers. Want to work for a company you love Are you a Front-End (more...)
Company: Hired
Location: Modesto
Posted on: 07/22/2019

Account Manager - Great Organization - pays up to $80,000
Description: Seeking a dynamic and motivated Account Manager on-site at one of the top tech firms in Silicon Valley. This candidate will be responsible for leading the management and execution of experiential events (more...)
Company:
Location: San Jose
Posted on: 07/22/2019

Security Engineer
Description: Role Programmer Security Engineer Location San Jose, California locals JOB DESCRIPTION Integrate security tooling and practices into the SDLC and CICD pipeline
Company: SSIT Inc
Location: San Jose
Posted on: 07/22/2019

Application Engineering Manager
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring applications developers. Want to work for a company you love Are you (more...)
Company: Hired
Location: Stockton
Posted on: 07/22/2019

Backend Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring backend developers. Want to work for a company you love Are you a Backend (more...)
Company: Hired
Location: Manteca
Posted on: 07/22/2019

Network Engineer
Description: About Altran Altran ranks as the undisputed global leader in Engineering and RD services ERD . The company offers clients an unmatched value proposition to address their transformation and innovation (more...)
Company: Aricent
Location: San Jose
Posted on: 07/22/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Jose RSS job feeds