Location: San Jose
Posted on: February 15, 2019
Hadoop Data Engineer for Creating Data Ingestion, design, development of analytics in Hadoop using HIVE, SQOOP, SPARK, OOZIE, SQL. This is additional ask in existing project but work will be driven independently.The Challenge!The Adobe IDS Data Engineering team is looking for innovative data and software engineers to build and evolve our industry leading data products and applications that empower Adobe's Data Driven Operating Model and next generation customer experiences. What you'll do * Designing, develop & tune data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis on performance, reliability and scalability and most of all quality.* Analyze the business needs, profile large data sets and build custom data models and applications to drive the Adobe business decision making and customers experience* Develop and extend design patterns, processes, standards, frameworks and reusable components for various data engineering functions/areas.* Collaborate with key stakeholders including business team, engineering leads, architects, BSA's & program managers. * MS in Computer Science / related technical field with 10+(level 5) years of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworks* Strong SQL, ETL, scripting and or programming skills with a preference towards Python, Java, Scala, shell scripting* Demonstrated ability to clearly form and communicate ideas to both technical and non-technical audiences. * Strong problem-solving skills with an ability to isolate, deconstruct and resolve complex data / engineering challenges* Results driven with attention to detail, strong sense of ownership, and a commitment to up-leveling the broader IDS engineering team through mentoring, innovation and thought leadershipDesired skils:* Familiarity with streaming applications* Experience in development methodologies like Agile / Scrum* Strong Experience with Hadoop ETL/ Data Ingestion: Sqoop, Flume, Hive, Spark, Hbase* Strong experience on SQL and PLSQL * Experience in Hadoop Data Consumption and Other Components: Hive, Hue HBase, , Spark, Pig, Impala, Presto* Experience monitoring, troubleshooting and tuning services and applications and operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, and basics of memory, CPU, OS, storage, and networks.* Experience in Design & Development of API framework using Python/Java is a Plus About TEKsystems: We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. - provided by Dice Hadoop Engineer
Keywords: TEKsystems, San Jose , Hadoop Engineer, Engineering , San Jose, California
Didn't find what you're looking for? Search again!