Education: Technical Training in Data Design or Database Architecture or Metadata Management Platforms.
Experience: Eighteen (18) years of hands-on experience architecting software solutions for IT projects, to include these areas: Designed and built relational databases in a data warehouse environment, which includes data design, database architecture, and metadata repository creation. Performed data access analysis design, and archive/recovery design and implementation.
Key Skills:
- Advanced understanding of and ability to apply principles, theories, and concepts of all-things data – databases, data integration, data governance, data science, advanced analytics & reporting, cloud-based data management, and artificial intelligence/machine learning.
- The ability to understand business objectives for data and engineer business solutions that leverage current and innovative data technology capabilities and provide valuable insights to relevant stakeholders.
- The ability to set architectural direction and standards while applying analytical, engineering, hardware, and software design theories to develop/maintain organizational strategy.
- Experience building application and\or data architecture roadmaps.
- Experience designing, integrating, and managing complex applications & data solutions.
- Experience working in a fast-paced, competitive information technology organization.
NIWC Specific Skills/Responsibilities:
- Experience Engineer ELT pipelining for data ingest and egress processes in a Databricks Lakehouse Architecture with consistent performance and scalability using established Data Framework
- Experience with Medallion Architecture utilizing Landing Zone and Bronze, Silver and Gold delta tables.
- Expert experience with SPARKS, Python and Databricks SQL in ELT pipeline development to include knowledge of Databricks, Python, and PySpark
- Have experience writing and tuning complex SQL queries used in the ELT development
- Architecting, implementing and Enhance ELT Framework to include Structured Streaming.
- Experience with the AWS preferably GovCloud, and Data Ingest/Transformation/Settings processes.
- Experience with AWS Services like Relational Database Services (RDS), Data Migration Service (DMS), CloudFormation, Terraform, S3 bucket, lambda function, SNS and Event Viewer.
- Architecting, implementing, and supporting software and data technology, in the cloud.
- Have worked on teams that practice Agile methodologies.
- Experience working with Databricks Workspace Notebooks
- Perform Data Engineering on Databricks Development and Production Environments.
- Understanding of programming and data engineering concepts and best practice.
- Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
- Create Standard Operation Procedure (SOP) for onboarding new application solutions.
- Provide assistance and guidance on implementing current Data Management Solutions.
- Provide technical advice to Data Engineering and BI Modernization Efforts.
- Provide management feedback from research and investigation to latest trends in Data Management Systems.
- Troubleshoot, fix, tune and enhance the end to end ELT Pipeline Processes.
- Ability to work both independently and collaboratively.
- Experience using GIT, JIRA/ServiceNow, and Microsoft tools (365 Office, Excel, Teams).
- Consulting with leadership, peers, teammates, and business partners to appreciate current and anticipate future software and data technology needs.
Security Clearance: Must be a U.S. Citizen with an active secuirty clearance and the ability to obtain T5 eligibility
Certification: Must have at least one of the following: CCNA (Cisco Certified Network Associate Security), CySA+ (CompTIA Cybersecurity Analyst), GICSP (Global Industrial Cyber Security Professional), GSEC (GIAC Security Essentials Certification), CompTIA Security+ CE, CND (Certified Network Defender), or SSCP (Systems Security Certified Practitioner) or the ability to obtain one within 3 months of hire date.
“Ishpi Information Technologies, Inc. is an Equal Opportunity Employer. All qualified candidates will be considered without regard to legally protected characteristics.
Pay Rate:
The annual base salary range for this position is $120,000 - $130,000 . Please note that any salary information disclosed is a general guideline only. Ishpi considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/ training, key skills as well as market and business considerations when extending an offer.
Expression of Interest: By applying to this job, you are expressing interest in this position and could be considered for other career opportunities where similar skills and requirements have been identified as a match. Should this match be identified, you may be contacted for this and future openings.