Azure Data Engineer Job at Datamaxis, Remote

cUhuVytESnlhaTZRS0dRMDk5Zk4ydFVtU0E9PQ==
  • Datamaxis
  • Remote

Job Description

Job Summary:

Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, SQL knowledge is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.

Minimum Qualifications and Job Requirements:

* Bachelor's degree in CS.
· 7 years of hands-on experience in designing and developing distributed data pipelines.
· 5 years of hands-on experience in Azure data service technologies.
· 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
· Experience with data integration with APIs, Web services, Queues
· Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.

Essential Job Functions:

  • Understand requirements and engage with team to design and deliver projects.
  • Design and implement data lake house projects within azure.
  • Design and develop application lifecycle utilizing Microsoft Azure technologies
  • Participate in design and planning and necessary documentation
  • Participate in Agile ceremonies including daily standups, scrum, retrospectives, demos, code reviews.
  • Hands on with Python/SQL development and Azure data pipelines
  • Engage with team to develop and deliver cross functional products
  • · Key Skills
  • a. Data Engineering and SQL
  • b. Python
  • c. PySpark
  • d. Azure Data lake and ADF
  • e. Databricks
  • f. CICD
  • g. Strong communication

* Document and maintain project artifacts.
* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
* Complete training as required for Privacy, Code of Conduct etc.
* Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
* Adhere to the company's compliance program.
* Safeguard the company's intellectual property, information, and assets.
* Other duties as assigned.

Job Tags

Full time,

Similar Jobs

Lensa

Amazon Fulfillment Center Warehouse Associate Job at Lensa

 ...DirectEmployers to promote this job for Amazon. Clicking "Apply Now" or "Read more" on Lensa...  ...merch, make-on-demand, customer returns, Prime Now, and general fulfillment. You will be...  ..., for our super-fast (2-hour or less) delivery service. Duties & Responsibilities... 

Search Force

Freight Broker Job at Search Force

 ...Exciting Opportunity for Ambitious Freight Brokers! Are you an active and driven Freight Broker eager to take your career to new heights? Look no further! Join our dynamic team at (HFS) and unlock your full potential in the booming logistics industry. Why Choose... 

Arts Hacker

CFO & Co-CEO for Arts Center (Hybrid) (Madison) Job at Arts Hacker

 ...This hybrid role will involve providing strategic leadership for all finance and operations functions while partnering with the Co-CEOs and Board of Directors. Ideal candidates will have extensive experience in nonprofit management, strategic financial oversight, and... 

Arise Virtual Solutions Inc.

Fintech Customer Support Representative Job at Arise Virtual Solutions Inc.

 ...Certification is now paid! If you have worked in customer services and...  ...with working outside of the home. The Arise Platform has...  ...a Fintech Customer Support Representative: Receive inbound calls...  ...through virtual channels (email, chat, video calls). No degree...