Data Engineer - with Arity
Looking for a candidate to provide Data Architecture, security, design, data quality strategies, system availabilities, logical and physical data modelling. Hortonworks data flow Nifl, Kafka, Storm, Atlas
Don't miss this opportunity to join a team where your innovative thinking and technology skills can improve the safety of those on the road and further enhance the car-ownership experience.
The Data Engineer will set and provide data architecture direction to support business objectives and requirements that align with roadmaps, standards, and best practices; focusing on security, design, data quality, strategies, system availability and resiliency. This position is responsible for working closely with all areas in the company and outside to ensure we are treating data as an asset.
Product Owner for our Metadata and data provenance tool - Hortonworks Atlas.
Create and establish a common Business Vocabulary/Taxonomy for the business.
Ensure existing data/information assets are identified, stewarded, governed and leveraged across the enterprise.
Build/Extend a canonical schema for all A2A and B2B integration layers.
Build and Maintain Entity Relationship Diagrams for our Product Teams.
Know and apply Industry standards as they relate to our business (ie. GeoJSON, IoT/Sensor API, etc.).
Develop and document data architectural solutions and recommendations for business products.
Close calibration with product managers and lead engineers.
Design API/Service Layer interfaces.
Identify gaps within existing data architecture and recommend alternative solutions.
Participate in the definition of technical standards and guidelines that pertain to data and information-use, security, access and governance.
Technical Experiences Required
Proven experience with logical/physical data modelling across a number of different data management platforms. Ideal candidate should be able to data model relational and document/object styles;
Require at least 1-3 years of designing at least one of the following Avro/JSON/XML file formats;
Working knowledge of API Management is preferred, leveraging Apigee is a plus;
Experience with Hortonworks DataFlow (NifI, Kafka, Storm, Atlas) and Hortonworks DataPlatform (Yarn HDFS) is preferred;
Experience with GeoSpatial functionality and data modelling techniques to support GeoSpatial solutions (GeoJSON) is recommended;
Possess at least 1 year of experience leveraging Cloud Services (IaaS, PaaS). AWS Certification is preferred;
Skilled with data integration issues and integration patterns.
Employment Type: Permanent
Work Hours: Full Time
Pay: $110,000 to $130,000 USD
Pay Period: Annual
Other Pay Info: Bonus
Click here to apply
Please mention that you saw the job on Sensors Mag