Apr 20, 2023
Senior Data Engineer
Full-Time
Remote, US
AZ, CA, CO, DE, FL, MD, MN, NC, NV, NY, TX, VA, WA, WI
California, United States
Irvine Office
Remote, US
NY
Remote, US
CA
Remote, Japan
n/a
TensorIoT is an AWS Advanced Consulting Partner and is currently seeking a high-performing, detail-oriented, and results-driven Senior Data Engineer to join our growing team! This role would engineer, build, deploy, and maintain robust big data solutions and platforms for business needs.
As a Senior Data Engineer, you will:
Responsible for gathering, maintaining, planning, developing and implementing data solutions and tools to support business units across our organization.
Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Documents work and processes and apply best-in-class data governance policies.
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Works closely with a team of frontend developers, product and business managers, analysts, and PMO.
Designs data integrations and data quality framework.
Designs and evaluates open source and vendor tools for data lineage.
Works closely with all business units to develop strategy for long term data platform architecture.
Manage from start to finish a portfolio of data integration and BI projects, working as the liaison between the business, IT, Digital Transformation teams and third party providers.
Design rich data visualizations to communicate complex ideas to leaders.
Lead integration of external vendor data, evaluate new solutions, and set process standards.
Provides key support for vendor management.
Lead the planning and execution of assigned projects.
n/a
We're looking for someone who has:
BS or MS degree in Computer Science or a related technical field
Project management and leadership skills are essential
2+ years of Python development experience
2+ years of SQL experience
2+ years of experience with schema design and dimensional data modeling
2+ years of experience with machine learning
Ability in managing and communicating data warehouse plans to internal clients
Experience designing, building, and maintaining data processing systems
Strong analytical and logical skills, curiosity, organization, attention to details, and discipline are crucial for this position
Ability to perform technical deep-dives into code, networking, systems and storage configuration
Hands-on experience developing cloud data infrastructure
Proficient in Python, SQL, and popular cloud platforms (Microsoft Azure, AWS, or Google - GCP)
Technical hands-on skills in machine learning (regression, classification, clustering, dimensionality reduction), deep learning (CNN, RNN/LSTM), time series data, optimization, anomaly detection, statistical algorithms, and data engineering
Excellent understanding of machine learning techniques and algorithms, such as k-NN, Naive Bayes, SVM, Decision Forests, etc.
Good applied statistics skills, such as distributions, statistical testing, regression, etc.
Bonus points for someone with:
Experience with big data technologies such as Hadoop, R, and Java / MapReduce a plus
Experience with NoSQL databases, such as MongoDB, Cassandra, HBase, DynamoDB a plus
SAP BI HANA knowledge and QlikSense reporting is a plus
Working knowledge of relational databases
Familiar with microservices architecture
Good knowledge of Restful API development, know how to design and develop Restful API
Git code management practices (GitHub)
Experience in writing unit tests to ensure code quality
Current understanding of best practices regarding system security measures
Experience in data engineering and design architecture
Demonstrated experience with agile development methods. Agile at scale is a plus.
n/a
n/a
n/a
n/a
What we offer:
Competitive salary based on experience
Flexible work hours and the ability to work from home
Health insurance
Annual physical exam
What we offer:
Competitive salary based on experience
Medical, dental, vision, and life insurance
401k plan with matching
Uncapped PTO
Flexible work hours and the ability to work from home
About TensorIoT
TensorIoT is an AWS Advanced Consulting Partner. We help companies realize the value and efficiency of the AWS ecosystem. From building PoCs and MVPs to production-ready applications, we are tackling complex business problems every day and developing solutions to drive customer success.
TensorIoT's founders helped build world-class IoT and AI platforms at AWS and Google, and are now creating solutions to simplify the way enterprises incorporate edge devices and their data into their day to day operations. Our mission is to help connect devices and make them intelligent. Our founders firmly believe in the transformative potential of smarter devices to enhance our quality of life, and we're just getting started!
TensorIoT is proud to be an equal opportunity employer. This means that we are committed to diversity and inclusion, and encourage people from all backgrounds to apply. We do not tolerate discrimination or harassment of any kind, and make our hiring decisions based solely on qualifications, merit, and business needs at the time.