As a Lead Software Engineer specializing in modern data engineering, you will play a crucial role in our data ecosystem, leveraging your expertise in AWS tools, scripting, data analytics, and software development.
Collaborating with cross-functional teams, you will be responsible for designing, implementing, and maintaining data pipelines, ensuring seamless integration between on-premises and cloud-based environments.
Your role will involve working closely with data analysts, QA engineers, architects, and DevOps teams to meet project goals efficiently and effectively.
The Software Engineer works under the guidance of senior team members, operating under a clear framework of accountability with substantial autonomy.
The successful candidate will develop a strong domain knowledge of the relevant business area/s, managing key.
Responsibilities:
Develop and maintain data pipelines between on-prem relational databases and AWS cloud environment using AWS tools such as DMS, Glue, Redshift, and cloud databases.
Utilize strong scripting skills in Python for automation and data manipulation tasks.
Collaborate with CICD DevOps teams using tools like GitLab for continuous integration and deployment.
Participate in Agile framework practices, assisting with project planning, estimation, and design.
Evaluate business needs, translate them into technical requirements, and document artifacts accordingly.
Monitor, maintain, and enhance data and application processes, ensuring adherence to SLAs and process compliance.
Proactively identify and implement process improvements to optimize data workflows and enhance efficiency.
Participate in end-to-end implementation of large-scale software development projects, ensuring high-quality deliverables.
Interpret and analyze data sets using statistical techniques, providing valuable insights to support business decision-making.
Build dashboards and reports using BI solutions like Tableau to visualize data trends and patterns.
Demonstrate strong expertise in cloud core technologies and stay updated with emerging trends in data engineering.
You Have:
Experience in software engineering with a focus on data engineering.
3-5 yrs experience in scripting languages such as Python for automation and data manipulation tasks.
Experience with AWS tools including DMS, Glue, Redshift, and cloud databases.
Strong data analytics skills with experience in interpreting and profiling data sets.
Experience building dashboards and reports using BI solutions like Tableau.
Familiarity with CICD practices and tools like GitLab for version control and deployment.
Hands-on experience working in Agile framework environments.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Strong problem-solving skills and attention to detail.
Proven ability to manage multiple projects and priorities simultaneously.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.