Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
Kelly Science & Clinical is seeking a Medical Laboratory Scientist - Microbiology for a Direct Hire position at cutting-edge biotech company in Pendleton, OR . If youre passionate about bringing the latest scientific discoveries to life and are ready to take the...
...Job Description: SpaceNav is looking for a skilled and committed Technical Project Engineer to become a key member of our innovative team. In this key leadership role, you will lead and manage engineering initiatives across multiple contracts, ensuring on-time delivery...
...Haul automotive parts in dry van trailers with newer trucks. Haul no-touch, mostly drop-and-hook freight. Work with onsite leaders... ...and detention pay. ~$1,500 sign-on bonus for experienced drivers. Qualifications Valid Class A Commercial Drivers License...
...customer complaints/requests in a calm and refined manner Multitasking capabilities that include but not limited to email, phone, chat, web support Ability to reference detailed reports connected to individual and field performance Written documentation skills...
...candidates and hiring teams Support onboarding and documentation processes as needed Qualifications: Previous experience with HRIS systems ; ADP experience strongly preferred Proficient in Microsoft Office and general computer systems (must be computer...