Data Engineer
Job Description
Within E&O, our Data Engineering team use Microsoft Azure Data Services to produce quality data that assists our organization in making important decisions enable operations across the Microsoft sales organization.
We are looking for talented and motivated data engineers that are interested in helping our organization empower learners through producing valuable data that can be used to understand the needs of the organization to make the right decisions.
Responsibilities
? Data Requirements and Modeling.
? Data Management and Transformation.
? Design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, data collecting, and related functions.
? Produce high-quality, well-tested, and secure code.
? Develop and maintain software designed to improve data governance and security.
? Develop processes designed to ensure Data Security and Data Quality.
? Work collaboratively with teammates in a fast-paced environment.
? Work to help build an… inclusive working environment.
Qualifications
Basic Qualifications:
? BS/MS in Computer Science, Data Analytics, Data Management, Information System or related technical field or equivalent training & experience.
? 3+ years building and maintaining end-to-end data systems and supporting services.
? 3+ years Incorporating data processing and workflow management tools into pipeline design.
? 3+ years? experience in ETL/ELT, Data warehousing, and/ or Business Intelligence Development.
? 3+ years using SQL to understand data and to investigate data issues or problems and provide solutions.
? 2+ years working with cloud data technologies.
? Experience with data modelling.
? Experience with or knowledge of structured, semi-structured, and unstructured data.
? A strong understanding of data warehousing and ETL concepts.
? A strong understanding of the value of Data and the benefits of a data-driven organizational culture.
? Excellent Problem-solving skills and software development habits.
? A passion for understanding data and data exploration using querying languages such as SQL.
? Excellent written and verbal communication skills.
? Good communication and collaboration skills.
? Passion for producing high quality Data products.
? Strong intellectual curiosity and passion for learning new technologies.
Preferred Qualifications
? Experience utilizing a variety of data stores, including data warehouses, RDBMSes, in-memory caches, and searchable document Databases.
? Experience working with large data sets in SQL/Data Bricks/PySparkSQL/Azure Data Factory or similar.
? Experience work with No-SQL storage and databases such as Azure Storage/ Data Lakes/ Or Cosmos DB.
? Experience with creating, editing and administering PowerBI data Models.
? Experience implementing data systems in Python/C#/Scala or similar.
? Strong design, implementation and testing skills.
? Developing for continuous integration and automated deployments.
? Experience developing on cloud platforms (i.e., AWS, Azure) in a continuous delivery environment.
? 1+ years software development using languages like JavaScript, Java, or C#.
? Ability to provide technical leadership to other developers.
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations
