SanJoseCARecruiter Since 2001
the smart solution for San Jose jobs

Senior Data Engineer

Company: Meda Agency Inc.
Location: San Jose
Posted on: March 18, 2023

Job Description:

The CompanyOur partner is comprised of a group of experts in artificial intelligence, intellectual property, and Web3 technology. They are California-based, with a remote-first team distributed across the United States, Canada, and Europe. Blockchain technology has unlocked powerful new ways to create and trade digital assets. But with this change, it's easier than ever for bad actors to defraud consumers. Our partner is building tools to protect the community, and make every interaction with a digital asset safe and transparent. -The RoleWe're on the hunt for an innovative, structured problem solver, and technical specialist passionate about building systems at scale. You will be among the first to tap into massive blockchain datasets, to construct data infrastructure that makes possible analytics, data science, machine learning, and AI workloads.You are the data domain specialist and you will partner with a cross-functional team of product engineers, analytics specialists, and machine learning engineers to unify data infrastructure across the product suite. Requirements may be vague, but the iterations will be rapid, and you must take thoughtful and calculated risks. Your work will take place at the interface of the AI, blockchain, and intellectual property domains, so you must be a quick learner with an affinity for many types of knowledge. -Responsibilities

Index multiple blockchain data standards into responsive data environments, and tune those environments to power real-time query infrastructure.Design and optimize data storage schemas to make terabytes of data readily accessible to our API.Design, build, test, and maintain scalable data pipelines and microservices sourcing both first-party and third-party datasets and deploying distributed (cloud) structures and other applicable storage forms such as vector databases and relational databases.Build utilities, user-defined functions, libraries, and frameworks to better enable data flow patterns.Mentor other engineers while serving as technical lead, contributing to and directing the execution of complex projects.Utilize and advance continuous integration and deployment frameworks.Research, evaluate and utilize new technologies/tools/frameworks centered around high-volume data processingRequirements
3+ years experience working as a data engineerExperience with modern databases (PostgreSQL, Redshift, Dynamo DB, Mongo DB, or similar)Proficient in database schema design, and analytical and operational data modelingProven experience working with large datasets and big data ecosystems for computing (spark, Kafka, Hive, or similar), orchestration tools (dagster, airflow, oozie, luigi), and storage(S3, Hadoop, DBFS)Proficient in one or more programming languages such as Python, Java, Scala, etc., and rock-solid SQL skillsExperience building CI/CD pipelines with services like Bitbucket Pipelines or GitHub Actions.Extensive analytical skills, excellent communication, and organizational skills and the ability to prioritize multiple tasksAn MS in Computer Science or equivalent experienceAn open mind to work in ambiguity and openness to finding creative solutions Bonus if you have:
Understanding of artificial intelligence, machine learning, and other big data techniquesB2B software design experienceExperience with Web3 toolingPowered by JazzHR

Keywords: Meda Agency Inc., San Jose , Senior Data Engineer, Engineering , San Jose, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Jose RSS job feeds