|
Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Technical Lead Location(s): New York, NY Job Description We are seeking an experienced Technical Lead with 10-14 years of experience to provide end-to-end technical delivery leadership for an enterprise AI-enabled intelligence solution. The candidate will serve as the primary technical interface with stakeholders and coordinate closely with offshore engineering teams. The role requires strong hands-on expertise in Azure Databricks, data engineering, Generative AI, Machine Learning, intelligent document processing, and enterprise integration. The Technical Lead will collaborate with Technical Architects, Business Analysts, SMEs, and engineering teams to drive technical decisions, resolve dependencies, maintain delivery quality, and support the solution lifecycle from design and development through testing, deployment, and production stabilization. Key Responsibilities
- Lead the design, architecture, implementation, and optimization of enterprise-scale data engineering solutions supporting Business Intelligence, AI/ML, and Generative AI initiatives.
- Document data architectures, data models, data mappings, transformation logic, integration patterns, quality standards, metadata frameworks, and data lineage.
- Develop trusted, reusable, and high-quality datasets for reporting, analytics, monitoring, and AI product development.
- Enable AI and Generative AI use cases through scalable data preparation, feature engineering, metadata management, vectorization, indexing, and governance.
- Collaborate with business stakeholders, data engineers, AI engineers, solution architects, and enterprise architecture teams to understand data requirements and AI adoption goals.
- Design and implement data pipelines supporting structured, semi-structured, unstructured, streaming, and external data sources.
- Support advanced AI architectures, including Retrieval-Augmented Generation (RAG), semantic search, vector databases, intelligent document processing, and enterprise knowledge management.
- Establish data engineering standards, coding best practices, CI/CD frameworks, Infrastructure-as-Code practices, monitoring strategies, and operational governance processes.
- Implement data quality, lineage, governance, security, privacy, compliance, and Responsible AI controls.
- Lead performance optimization, scalability improvements, resiliency enhancements, and cloud cost management initiatives.
- Monitor, troubleshoot, and continuously improve data integration and processing workflows.
- Provide technical leadership, mentorship, solution guidance, and code reviews to engineering teams.
- Participate in architecture reviews, technical design discussions, technology evaluations, and strategic roadmap planning.
- Research emerging data engineering, AI, data integration, and cloud technologies and recommend platform improvements.
Technical Skills & Qualifications
- Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent work experience.
- 10+ years of experience in data integration, data engineering, or data architecture.
- Extensive experience designing and implementing enterprise-scale data engineering and integration solutions for analytics, ML, AI, and GenAI workloads using Databricks.
- Strong hands-on expertise in Python, SQL, PySpark, and the Databricks platform.
- Proven experience building and modernizing enterprise Databricks data platforms on Azure, AWS, or GCP.
- Strong understanding of data preparation, feature engineering, data quality management, and governance for AI and GenAI solutions.
- Deep understanding of Data Lakes, Lakehouse architectures, Data Warehouses, Data Marts, and enterprise data ecosystems.
- Experience designing and implementing ETL/ELT pipelines, API-based integrations, cloud-native data services, and workflow orchestration frameworks.
- Strong expertise in data modeling, data mapping, data transformation, metadata management, master data management, and enterprise data governance.
- Experience building data products and datasets supporting AI model training, feature stores, fine-tuning, model monitoring, MLOps, and production inference.
- Experience implementing CI/CD pipelines, Infrastructure-as-Code, source control, and DevOps practices using Azure DevOps, Git, Terraform, or similar technologies.
- Knowledge of Azure OpenAI, Azure AI Search, Microsoft Fabric, Microsoft Foundry, Databricks, or comparable AI and cloud-native data platforms.
- Familiarity with vector databases, embeddings, semantic search, knowledge retrieval architectures, and LLM data ecosystems.
- Experience designing data pipelines and indexing frameworks supporting RAG and enterprise AI search solutions.
- Understanding of AI governance, explainability, model monitoring, and enterprise AI lifecycle management.
- Experience supporting AI agents, copilots, intelligent document processing, enterprise search, and knowledge management platforms is highly desirable.
- Strong understanding of security, privacy, compliance, data governance, and Responsible AI principles.
- Experience implementing data lineage, monitoring, observability, data quality controls, and operational support frameworks.
- Ability to optimize data platforms for performance, scalability, resiliency, maintainability, and cost efficiency.
- Excellent communication, stakeholder management, technical leadership, and mentoring skills.
- Ability to collaborate effectively across business and technology teams.
Ampcus is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veterans or individuals with disabilities.
|