Overview:
The Senior Data Engineer will be responsible for the extraction, processing, cleansing, analysis, automation and deployment of client data, third-party data sources, and internal data sources. As a Senior Data Engineer, this person will be accessing confidential data on a daily basis, therefore must maintain the highest level of adherence to ID Analytics, Inc. security policies and practices.
Responsibilities:
* Manage data operations issues and adapt to constantly changing procedures and client requirements.
* Oversee and perform the updating, indexing, distribution, and maintenance of all current versions of all flat file data sources.
* Track, verify, and implement data quality checks from all data sources.
* Provide technical leadership on new Data Management projects and the re-structuring of the current data architecture. Design and architect new data workflows.
* Design, architect, and code scripts to automate new processes and editing current scripts to maximize optimization.
* Process and update third party data sources.
* Engineer and code to specifications outlined in requirements documents.
* Analyze and run statistics on data quality and present results.
* Analyze current processes and workflows and provide solutions to improve performance, efficiency, robustness, and flexibility.
* Provide technical guidance and leadership to other members of team.
* Work closely with Data Scientists to properly align Data Management and Analytics teams.
* Other duties as assigned.
Qualifications:
* Bachelor’s degree in computer science or an engineering/technical field plus 5 years work experience. Experience may be substituted for the education requirement.
* Database experience (MySQL and NoSQL preferred).
* Software Development background preferred.
* Experience with distributed file systems preferred.
* Strong understanding of UNIX/Linux System architecture and commands.
* Coding and/or scripting skills. Strong working knowledge of Java and experience with Perl, Awk, Python, and shell scripting.
* Intermediate to strong knowledge of analyzing and presenting statistics.
* The ability to translate business requirements into technical requirements and code design. Must be able to lead the department’s technical responsibilities for projects that involve multiple teams.
* Ability to set and manage multiple tasks and to correctly prioritize those tasks.
* Strong troubleshooting and logic skills.
* Attention to detail and demonstrated commitment to data quality.
* Ability to work effectively in a team environment, as well as independently with limited supervision.
* Excellent written communication and oral communication skills.
* Applicants selected for this position will require background screening and the ability to maintain a security clearance. Applicants selected for a security clearance will be subject to a security investigation and must meet eligibility requirements for access to classified information.
ID Analytics, Inc. is an Equal Opportunity Employer, AA/M/F/IWD/Protected Veterans.
Options :
This brief summary is not an all-inclusive description of job duties. Other job duties and responsibilities may also be assigned by the incumbent’s supervisor at any time based upon Company need.
ID Analytics, Inc. is an Equal Opportunity Employer, AA/M/F/IWD/Protected Veterans.
Apply for this job online
Refer a friend to this job
Email this job
Go back to the welcome page
Need further assistance?
Applicant Tracking Software
*Job ID:* 2014-1910
*# of Openings:* 1
*Job Location:* US-CA-San Diego
*Category:* Information Technology
*Work Eligibility:* Does not require work sponsorship