This job has expired.
RESPONSIBILITIES:
Kforce has a client that is seeking a GCP Data Engineer in Bolingbrook, IL.Summary:The GCP Data Engineer will be responsible for designing, developing, and deploying data pipelines and processes within Google Cloud Platform (GCP). This role is pivotal in upgrading GCP infrastructure and ensuring smooth operation of both batch and real-time data ingestion pipelines. The Engineer will work across different teams, collaborate with offshore resources, and be self-sufficient in driving projects forward. The position requires strong technical skills in GCP and related technologies, with a focus on data pipeline development, cloud storage, and Python scripting.Key Responsibilities:Development (70%):- Design and implement batch and real-time ingestion pipelines using Google Cloud Platform services such as Dataflow, Dataproc, and BigQuery
- Write and optimize Python scripts in Spark, leveraging GCP's Spark Engine (Dataproc)
- Utilize Cloud Functions for data ingestion and processing tasks
- Work with Cloud security for building security frameworks and perform vulnerability assessment to detect/resolve platform security issues
- Develop Data Engineering pipelines for Data Ingestion into GCP Platform/Big Query
- Build and maintain scalable data pipelines to handle high-volume data (e.g., 150 million rows)
- Create dashboards in Looker for Big Query performance monitoring, slots management, user queries
- Work with Platform Architects for building new capabilities/frameworks or setting up policies/guidelines for development teams
- Develop and manage APIs on the Apigee platform and utilize Cloud Functions for API management
- Build microservices and integrate with REST APIs to support data ingestion and processing needs
- Provide technical support for existing data pipelines and systems
- Collaborate with offshore engineers and various teams to gather requirements and ensure smooth deployment and integration
REQUIREMENTS:
- Bachelor's degree in Computer Science, Engineering, or a related field
- 6+ years of experience in data engineering, with a focus on GCP technologies
- Proficiency in GCP services, including Dataflow, Dataproc, Pub/Sub, BigQuery, and Cloud Storage
- Experience in building and maintaining data pipelines using Python and Spark
- Strong experience with BigQuery including SQL and Stored Procedures
- Hands-on experience with real-time ingestion frameworks like Kafka or similar
- Experience with Spark on GCP (Dataproc) and strong Python scripting skills
- Familiarity with REST APIs and microservices architecture
- Experience with high-volume data processing (GB-level)
- Previous experience working in a similar role with GCP stack technologies
- Ability to gather and analyze requirements effectively
- Strong coding, development, testing, and deployment skills
- Familiarity with the Software Development Life Cycle (SDLC)
- Excellent collaboration skills and ability to work across multiple teams
- Strong problem-solving abilities and a proactive approach to identifying and resolving issues
- Experience with API development on the Apigee platform or similar
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
This job has expired.
Get Hired Faster
Subscribe to job alerts and upload your resume!
*By registering with our site, you agree to our
Terms and Privacy Policy.
More Recruitment Consultancy jobs
|
|
|
|
|
|