Job description

Data Engineer

Location: Dallas TX (Need only Locals) (Hybrid work model)

Responsibilities:

• Work with business stakeholders, Business Systems Analysts and Developers to ensure quality delivery of software.

• Interact with key business functions to confirm data quality policies and governed attributes.

• Follow quality management best practices and processes to bring consistency and completeness to integration service testing

• Designing and managing the testing AWS environments of data workflows during development and deployment of data products

• Provide assistance to the team in Test Estimation & Test Planning

• Design, development of Reports and dashboards.

• Analyzing and evaluating data sources, data volume, and business rules.

• Proficiency with SQL, familiarity with Python, Scala, Athena, EMR, Redshift and AWS.

• No SQL data and unstructured data experience.

• Extensive experience in programming tools like Map Reduce to HIVEQL

• Experience in data science platforms like Sage Maker/Machine Learning Studio/ H2O.

• Should be well versed with the Data flow and Test Strategy for Cloud/ On Prem ETL Testing.

• Interpret and analyses data from various source systems to support data integration and data reporting needs.

• Experience in testing Database Application to validate source to destination data movement and transformation.

• Work with team leads to prioritize business and information needs.

• Develop complex SQL scripts (Primarily Advanced SQL) for Cloud ETL and On prem.

• Develop and summarize Data Quality analysis and dashboards.

• Knowledge of Data modeling and Data warehousing concepts with emphasis on Cloud/ On Prem ETL.

• Execute testing of data analytic and data integration on time and within budget.

• Work with team leads to prioritize business and information needs

• Troubleshoot & determine best resolution for data issues and anomalies

• Experience in Functional Testing, Regression Testing, System Testing, Integration Testing & End to End testing.

• Has deep understanding of data architecture & data modeling best practices and guidelines for different data and analytic platforms

Requirements:

• Experienced in large-scale application development testing – Cloud/ On Prem Data warehouse, Data Lake, Data science

• Experience with multi-year, large-scale projects

• Expert technical skills with hands-on testing experience using SQL queries.

• Extensive experience with both data migration and data transformation testing

• Extensive experience DBMS like Oracle, Teradata, SQL Server, DB2, Redshift, Postgres and Sybase.

• Extensive testing Experience with SQL/Unix/Linux.

• Extensive experience testing Cloud/On Prem ETL (e.g. Abinito, Informatica, SSIS, DataStage, Alteryx, Glu)

• Extensive experience using Python scripting and AWS and Cloud Technologies.

• Extensive experience using Athena, EMR , Redshift and AWS and Cloud Technologies

• API/RESTAssured automation, building reusable frameworks, and good technical expertise/acumen

• Java/Java Script - Implement core Java, Integration, Core Java and API.

• Functional/UI/ Selenium - BDD/Cucumber, Specflow, Data Validation/Kafka, Big Data, also automation experience using Cypress.

• AWS/Cloud - Jenkins/ Gitlab/ EC2 machine, S3 and building Jenkins and CI/CD pipelines, SauceLabs.

• API/Rest API - Rest API and Micro Services using JSON, SoapUI

• Extensive experience in DevOps/Data Ops space.

• Strong experience in working with DevOps and build pipelines.

• Strong experience of AWS data services including Redshift, Glue, Kinesis, Kafka (MSK) and EMR/ Spark, Sage Maker etc…

• Experience with technologies like Kubeflow, EKS, Docker

• Extensive experience using No SQL data and unstructured data experience like MongoDB, Cassandra, Redis, Zookeeper.

• Extensive experience in Map reduce using tools like Hadoop, Hive, Pig, Kafka, S4, Map R.

• Experience using Jenkins and Gitlab

• Experience using both Waterfall and Agile methodologies.

• Experience in testing storage tools like S3, HDFS

• Experience with one or more industry-standard defect or Test Case management Tools

• Great communication skills (regularly interacts with cross functional team members)

Good to Have:

• Good to have Java knowledge

• Knowledge of integrating with Test Management Tools

• Knowledge in Salesforce

Job Type: Contract

Salary: $60.00 - $65.00 per hour

Schedule:

• 8 hour shift

Ability to commute/relocate:

• Dallas, TX 75051: Reliably commute or planning to relocate before starting work (Required)

Experience:

• Data Engineer: 3 years (Required)
• SQL queries: 4 years (Required)
• Data warehouse, Data Lake: 4 years (Required)
• Python, Scala, Athena, EMR: 3 years (Required)
• core Java, Integration, Core Java: 3 years (Required)
• DevOps/Data Ops: 3 years (Required)
• like Hadoop, Hive, Pig, Kafka: 3 years (Required)
• Jenkins and Gitlab: 3 years (Required)
• ETL: 3 years (Required)
• total it: 8 years (Required)

Work Location: Hybrid remote in Dallas, TX 75051

adamanda.ca is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, adamanda.ca provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, adamanda.ca is the ideal place to find your next job.