Senior Data Engineer - Scala/Spark/SQL

Company: Hewlett Packard Enterprise Development LP
Location: San Jose
Posted on: April 8, 2021

Job Description:

Search Hewlett Packard Enterprise Careers At Hewlett Packard Enterprise, we bring together the brightest minds to create breakthrough technology solutions that advance the way people live and work. What sets us apart? Our people and our relentless dedication to helping our customers make their mark on the world. We are a team of doers, dreamers and visionaries; inspired by our purpose and driven by our strategy. We live by our three values: partner, innovate and act. Our legacy inspires us as we forge ahead, always pushing to discover what's next. Every day is a new opportunity to advance and grow ourselves, our company and the industry. Some people call it an obsession, we call it a way of life. What you need to know about the job Job ID: 1081434 Date Posted: 3/31/2021 Primary Location: San Jose, California Other Locations: Andover, Massachusetts, United States of America; Durham, North Carolina, United States of America Job Category: Engineering Schedule: Full time Shift: No shift premium (United States of America) We are currently looking for a Data Engineer to join our growing Infosight Data engineering team within HPE to take on Data engineering and cross-stack analytics challenges. HPE InfoSight collects hundreds of terabytes of operational and diagnostic telemetry from our customers, which enables us to help them get the most out of their IT infrastructure. As part of the Infosight team, you will work on cutting-edge projects, with high visibility.-- If you have the relevant experience, have a passion for quality and good software engineering practices, and enjoy working in a fast-paced, highly rewarding environment, then HPE is the place for you. In this role you will:

• Innovate, design, develop data extraction, transfer and load programs for large data warehouse to achieve near real-time speeds
• Automate data collection, pre-processing, governance, and analysis.
• Work closely with data scientists, platform, and UI teams to implement the data processing logic using Scala, Spark batch, Spark Streaming, Pulsar/kafka,, Kubernetes and akka on AWS.
• Communicate findings clearly and succinctly to technical and non-technical audience. Education and Experience Required:
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent.
  • Typically 6-10 years experience. Minimum Qualifications:
    • Strong programming skills in Scala.
    • Proficient in distributed computing frameworks such as Spark, micro-services, and Kafka.
    • Expertise in writing and understanding complex SQL queries
    • Demonstrates strong attention to detail.
    • Experience with database architecture and design including scalability, performance and high availability .
    • Experience in data cleaning techniques, ETL, and data visualizations.
    • Ability to work independently in a fast-paced, iterative development environment.
    • Strong communication skills and team player #LI-CT HPE is an equal opportunity employer/Female/Minority/Individual with Disabilities/Protected Veteran Status My favorite thing about the culture here is the amount of collaboration that goes on throughout the company. Chris Rasberry Finance Project Manager With a company as vast as HPE, you never know what's going to come up, so it keeps you on your toes, excited for the next challenge. Kristine Steeter AMS HR Operations and Global Services VP Related Content Shape the Future of Business Explore insights and resources to help IT pros shape the future of business. Experience a day in the life of Hewlett Packard Enterprise employees. Find out what it's like to work
      in San Jose Hewlett Packard Enterprise advances the way people live and work. What sets us apart? Our people. Our people's relentless commitment to partner, innovate, and act. Sign Up for Alerts Join our talent community and get HPE news and job alerts delivered to your inbox.
      Search for a category or location (or both), select a suggestion and then click "Sign Up." For information on the processing of personal data by HPE please refer to the HPE Recruitment Notice and HPE Privacy Statement . You can always withdraw or modify your consent to receive marketing and sales communication from HPE. This can be done by using the opt-out and preference mechanism at the bottom of our email marketing communication or by following this link to unsubscribe.

Keywords: Hewlett Packard Enterprise Development LP, San Jose , Senior Data Engineer - Scala/Spark/SQL, IT / Software / Systems , San Jose, California