Lead Software Engineer- Data Engineer job opportunity at Clarivate.



DateMore Than 30 Days Ago bot
Clarivate Lead Software Engineer- Data Engineer
Experience: 6-years
Pattern: full-time
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreeOND
loacation IND - Bangalore (DRG), India
loacation IND - Bangalor..........India

We are looking for a Lead Data Engineer for Bangalore location. Design and develop the database schemas as well as scripts for importing and exporting data utilizing AWS Glue tasks. In an agile environment, the data engineer will work closely with the development team. About You – experience, education, skills, and accomplishments Bachelor’s degree in computer science, Engineering, or a related field. Minimum 6 years’ experience working in Data Engineering Good experience in building massively scalable distributed data processing solutions Good experience of database design & development. Experience in building and optimizing/fine tuning complex transformations in data pipelines Building Data Pipelines & ETL jobs using cloud-native technologies & design patterns Experience in designing resilient systems & creating disaster recovery plans Working in Agile Scrum or Kanban teams & deploying solutions using Continuous Delivery best practices Using automated database migration tools & have strong opinions on version control best practices for SQL scripts. Technical Skills Big Data Apache PySpark Databricks Snowflake AWS Glue AWS EMR Tables formats: Delta table, Iceberg File formats: Parquet RDBMS - PostgreSQL Languages            Proficient in: Python Proficient in SQL Proficient in PySpark Cloud Technologies and Tools Experience in designing cloud-based data pipelines & solutions AWS: EMR, AWS Glue, S3, EC2, RDS, Aurora PostgreSQL, Lambda. It would be great if you also have:  Exposure to GenAI technologies is an added advantage. Experience in Agile/Scrum environments and collaboration with distributed teams across regions. Ability to manage and coordinate work with other team members What will you be doing in this role? Technical Leadership & Project Execution Provide technical thought leadership, compare different technologies to meet business requirements and cost control drivers. Work with Business and IT groups to design and deliver a data lake platform. Produce & maintain the overall solution design for the entire Data Lake Platform. Execution of data strategy, help in the design and architecture of solutions on the platform Enforce technical best practices for Big Data management and solutions, from software selection to technical architectures and implementation processes.  Document and publish best practices, guidelines, and training information.  Ensures all functional solutions and components of the Data Lake platform service are designed and implemented in a way to always meet SLAs.  Contributes to the continuous improvement of the support & delivery functions by maintaining awareness of technology developments and making appropriate recommendations to enhance application services. Focus on data quality throughout the ETL & data pipelines, driving improvements to data management processes, data storage, and data security to meet the needs of the business and customers You will interact with Product and the Technology Development leads and Managers directly to understand the business problem. Define and implement our test platform strategy on Cloud, have a meaningful impact on our customers, and working in our high energy, innovative, fast-paced Agile culture. You will be key member in architectural decisions, and application workflows. You will also create technical documentation for the broader team. You will drive effective feedback gathering from customers and translate into clear technical requirements for their solutions.  About the Team     RWD DRG Fusion team operates on a global scale, working seamlessly with Product team and delivering solutions upfront. We believe in the power of collaboration and diversity to drive success. As a part of our team, you'll have the opportunity to contribute to impactful projects, exchange ideas with talented individuals, and be at the forefront of exciting challenges. Hours of Work Fulltime in IST zone 40 h/week Hybrid working model At Clarivate, we are committed to providing equal employment opportunities for all   qualified persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.

Other Ai Matches

remote-jobserver Remote
Senior Statistician - HTA Applicants are expected to have a solid experience in handling Job related tasks
Senior Software Engineer - Java Applicants are expected to have a solid experience in handling Job related tasks
Technical Support Analyst (US Shift) Applicants are expected to have a solid experience in handling Job related tasks
IP Admin Analyst (French speaking) Applicants are expected to have a solid experience in handling Job related tasks
アソシエイトコンサルタント(コマーシャルコンサルティング )(Associate Consultant, Commercial Consulting) Applicants are expected to have a solid experience in handling Commercial Consulting) related tasks
Senior Trademarks Paralegal Analyst Applicants are expected to have a solid experience in handling Job related tasks
マネージャー(コマーシャルコンサルティング) (Manager, Commercial Consulting) Applicants are expected to have a solid experience in handling Commercial Consulting) related tasks
Tax Analyst Applicants are expected to have a solid experience in handling Job related tasks
Associate Content Support Analyst Applicants are expected to have a solid experience in handling Job related tasks
Lead Software Engineer, Ruby on Rails/C++ Applicants are expected to have a solid experience in handling Ruby on Rails/C++ related tasks
Lead Infrastructure/Network Engineer Applicants are expected to have a solid experience in handling Job related tasks
IP Admin Senior Analyst (Patent Paralegal) Applicants are expected to have a solid experience in handling Job related tasks
Manager, Software Engineering - Bigdata Applicants are expected to have a solid experience in handling Software Engineering - Bigdata related tasks
Manager, Database Administration Applicants are expected to have a solid experience in handling Database Administration related tasks
Technical Solution Consultant Applicants are expected to have a solid experience in handling Job related tasks
Patent Search Senior Analyst Applicants are expected to have a solid experience in handling Job related tasks
Senior Account Manager Applicants are expected to have a solid experience in handling Job related tasks
Associate Healthcare Research & Data Analyst Applicants are expected to have a solid experience in handling Job related tasks
Futures Technology Engineer Applicants are expected to have a solid experience in handling Job related tasks
STEM Content Analyst - Molecular Interactions Applicants are expected to have a solid experience in handling Job related tasks
Healthcare Research & Data Analyst (MedTech) Applicants are expected to have a solid experience in handling Job related tasks
Manager, Software Engineering Applicants are expected to have a solid experience in handling Software Engineering related tasks
Business Process Consultant Applicants are expected to have a solid experience in handling Job related tasks