COSMOS - Data Engineer IV position at The University of Arkansas System Division of Agriculture.| United States Of America

_{More Than 30 Days Ago} bot

The University of Arkansas System Division of Agriculture COSMOS - Data Engineer IV

Experience: 4-years

Pattern: full-time

Country:

Copy Link Report

OND

Little Rock....United States Of America

Current University of Arkansas System employees, including student employees and graduate assistants, need to log in to Workday via MyApps.Microsoft.com , then access Find Jobs from the Workday search bar to view and apply for open positions. Students at University of Arkansas System two-year institutions will also view open positions and apply within Workday by searching for “Find Jobs for Students”. All Job Postings will close at 12:01 a.m. CT on the specified Closing Date (if designated). If you close the browser or exit your application prior to submitting, the application process will be saved as a draft. You will be able to access and complete the application through “My Draft Applications” located on your Candidate Home page. Closing Date: Type of Position: Professional Staff (Non-Classified) Workstudy Position: No Job Type: Regular Work Shift: Sponsorship Available: No Institution Name: University of Arkansas at Little Rock The University of Arkansas at Little Rock is a metropolitan research university that provides an accessible, quality education through flexible learning and unparalleled internship opportunities. At UA Little Rock, we prepare our more than 8,900 students to be innovators and responsible leaders in their fields. Committed to its metropolitan research university mission, UA Little Rock is a driving force in Little Rock's thriving cultural community and a major component of the city and state's growing profile as a regional leader in research, technology transfer, economic development, and job creation. Below you will find the details for the position including any supplementary documentation and questions you should review before applying for the opening. To apply for the position, please click the Apply link/button. If you have a disability and need assistance with the hiring process please contact Human Resources at 501-916-3180 . For general application assistance or if you have questions about a job posting, please contact Human Resources at 501-916-3180 . Department: COSMOS Department's Website: https://cosmos.ualr.edu/ Summary of Job Duties: The Data Engineer IV position is a full-time provisional with the COSMOS Research Center (cosmos.ualr.edu) at the University of Arkansas and is funded through a grant or contract. The position renewal is contingent upon continued grant funding and satisfactory job performance. The Data Engineer IV will collect, manage, and convert raw data into usable information for analytics and decision-making. This role requires comprehensive data analysis skills, developing and maintaining datasets, improving data quality and efficiency through leveraging data systems and pipelines, interpreting trends and patterns of data, complex data reports, and building algorithms and prototypes. In addition, the other responsibilities include leading the development of social media data collection pipelines, inference methods and infrastructure, classification methods and infrastructure, and visualization dashboards. The Data Engineer IV will collaborate with researchers, participate in research projects, and interact with other developers at the COSMOS research center and partner organizations to achieve the best possible performance metrics across various projects. Excellent communication and problem-solving skills are essential for this on-campus position as the data engineer's role is to find opportunities to contribute to cutting-edge research in the exciting field of social computing. This position is governed by state and federal laws, and agency/institution policy. The position reports to: Dr. Nitin Agarwal (nxagarwal@ualr.edu), Maulden-Entergy Endowed Chair and Distinguished Professor and Director, COSMOS Research Center, UA-Little Rock. Qualifications: Required Education and/or Experience: The candidate must have a master's degree in Computer Science, Information Science, or a related discipline; The candidate must have 4+ years of experience as a data engineer/software developer/software engineer/database administrator, or other similar roles; or a PhD degree in Computer Science, Information Science, or a related discipline; The candidate must have 2+ years of experience leading a team of data engineers. Job Duties and Responsibilities: Lead a team of data engineers; Collecting and analyzing raw data from various sources including social media platforms; Organize and maintain datasets; Improving data quality and process efficiency; Design and manage data ETL pipelines that encompass the journey of data from source to destination systems processing 10 million+ data points daily, utilizing Kafka for real-time data streaming and MongoDB for NoSQL storage across Kubernetes clusters; Design and deploy scalable microservices in Python and Golang, leveraging FlaskAPI, GraphQL, and Docker, ensuring sub-second response times and efficient concurrency with goroutines. Migrate large amounts of data from legacy databases to MongoDB to achieve sub-second access latencies and optimize storage for unstructured data through Elasticsearch integration; Setup and manage the infrastructure required for ingestion, processing, and storage of data; Evaluate the model needs and objectives, interpret trends and patterns of data; Conduct complex data analysis and report on results; Prepare data for analysis and reporting by transforming and cleansing it; Combine raw information from different sources; Explore ways to enhance data quality and reliability; Identify opportunities for data acquisition; Develop analytical tools and programs; Collaborate with teams at COSMOS on several projects; Managing services and operational infrastructure for system reliability and resiliency; Creating continuous integration continuous deployment (CI/CD) pipelines with Jenkins and GitLab CI for automating service/system deployment; Integrate Prometheus for monitoring, Grafana for real-time dashboarding/visualization, and log analysis with Kibana sourced from Elasticsearch; Front-end development (HTML/CSS, JavaScript, Node.js, etc.); Training machine learning (ML) models on datasets; Creating continuous integration continuous deployment (CI/CD) pipelines with Jenkins and GitLab CI for automating service/system deployment; Integrate Prometheus for monitoring, Grafana for real-time dashboarding/visualization, and log analysis with Kibana sourced from Elasticsearch; Front-end development (HTML/CSS, JavaScript, Node.js, etc.); Deploying machine learning (ML) models; Enhance the system’s fault tolerance by incorporating alerting mechanisms; Develop frameworks like Spring Boot, React; Work on other tasks as asked. Knowledge, Skills, and Abilities: Expert proficiency level in working with data models, data pipelines, ETL processes, data stores, data mining, and segmentation techniques; Expert proficiency level in working with programming/scripting languages (e.g., Java and Python); Expert proficiency level in working with data integration platforms and SQL database design; Expert proficiency level in working with numerical, analytical, and data security skills; Expert proficiency level in collecting raw data from various social media platforms; Expert proficiency level in creating CI/CD pipelines; Expert proficiency level with front-end development (HTML/CSS, JavaScript, Node.js, etc.); Expert proficiency level with training and deploying machine learning (ML) models on datasets; Ability to lead a large team of data engineers (5+ members); Expert proficiency level with Kafka and MongoDB for NoSQL storage across Kubernetes clusters; Expert proficiency level with microservices, Python, Golang, FlaskAPI, GraphQL, and Docker; Expert proficiency level with Elasticsearch, Grafana, Prometheus, and Kibana. Expert proficiency level in data modeling concepts (ERD, Dimensional Modeling, Data Vault) and data APIs (RESTful API); Expert proficiency level in data processing software (e.g., Hadoop, Spark, TensorFlow, Pig, Hive) and algorithms (e.g., MapReduce, Flume); Expert proficiency level in cloud platforms (AWS, Azure, GCP) and data warehousing solutions (Snowflake, Amazon Red Shift, Google BigQuery, Azure Synapse); Expert proficiency level in technical communications. Additional Information: Salary Information: $95,000 Required Documents to Apply: Resume Optional Documents: Special Instructions to Applicants: Recruitment Contact Information: Dr. Nitin Agarwal (nxagarwal@ualr.edu) Maulden-Energy Chair and Donaghey Distinguished Professor Director, COSMOS Research Center All application materials must be uploaded to the University of Arkansas System Career Site https://uasys.wd5.myworkdayjobs.com/UASYS Please do not send to listed recruitment contact. Pre-employment Screening Requirements: Criminal Background Check, Sex Offender Registry The University of Arkansas at Little Rock is committed to providing a safe campus community. We conduct background checks for applicants being considered for employment. Background checks include a criminal background check and a sex offender registry check. For certain positions, there may also be a financial (credit) background check, a Motor Vehicle Registry ( MVR ) check, and/or drug screening. Required checks are identified in the position listing. A criminal conviction or arrest pending adjudication or adverse financial history information alone shall not disqualify an applicant in the absence of a relationship to the requirements of the position. Background check information will be used in a confidential, non-discriminatory manner consistent with state and federal law. The University of Arkansas is an equal opportunity institution. The University does not discriminate in its education programs or activities (including in admission and employment) on the basis of any category or status protected by law, including age, race, color, national origin, disability, religion, protected veteran status, military service, genetic information, sex, sexual preference, or pregnancy. Federal law prohibits the University from discriminating on these bases. Questions or concerns about the application of Title IX, which prohibits discrimination on the basis of sex, may be sent to the University's Title IX Coordinator and to the U.S. Department of Education Office for Civil Rights. Persons must have proof of legal authority to work in the United States on the first day of employment. All application information is subject to public disclosure under the Arkansas Freedom of Information Act. Constant Physical Activity: Hearing, Manipulate items with fingers, including keyboarding, Repetitive Motion, Sitting, Standing, Talking, Walking Frequent Physical Activity: Hearing, Manipulate items with fingers, including keyboarding, Repetitive Motion, Sitting, Standing, Talking, Walking Occasional Physical Activity: Hearing, Manipulate items with fingers, including keyboarding, Repetitive Motion, Sitting, Standing, Talking, Walking Benefits Eligible: Yes

COSMOS - Data Engineer IV job opportunity at The University of Arkansas System Division of Agriculture.

Saved Jobs

No Job Saved

Other Ai Matches