Data & Analytics Solutions Architect (Hadoop + Big Data)
Tata Consultancy Services· enterprise· Oct 10, 2026 · 17d ago
new york city, NY
In office
Full-time
Principal
$130K–$170K
14+ years exp
Job description
Loaction: NJ/NYC/Dallas TX/Charlotte, NC
Must Have Technical/Functional Skills
· 14+ years of experience in Enterprise Data Architecture, Hadoop Ecosystem, Big Data Engineering, and Data Platform Modernization.
· Strong hands-on expertise in Hadoop, HDFS, YARN, Hive, Spark, PySpark, Kafka, SQL, Python, Java, and Scala.
· Experience designing and implementing large-scale Big Data and Data Lake architectures supporting analytics, reporting, and AI workloads.
· Strong understanding of Hadoop platform architecture, including HDFS, YARN, high availability, cluster management, workload optimization, and scalability.
· Expertise in batch and distributed data processing using Spark, Hive, HBase, and MapReduce frameworks.
· Experience building data ingestion and streaming solutions using Kafka and Hadoop ecosystem tools.
· Strong knowledge of Data Engineering practices, including ETL/ELT, data integration, data quality, metadata management, lineage, observability, and DataOps.
· Experience with Data Lake, Data Warehousing, Enterprise Data Models, Master Data, and Data Governance frameworks. · Strong understanding of security and governance controls, including Kerberos, Ranger, encryption, privacy, auditability, compliance, and controlled data access.
· Proven experience in architecture definition, HLD/LLD creation, migration planning, technical governance, production readiness, and performance optimization.
· Experience supporting platform modernization, cloud adoption, solutioning, effort estimation, and client-facing technical discussions.
· Good understanding of BFSI regulatory, security, privacy, resilience, and audit requirements.
· Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Management, or a related discipline.
· Preferred certifications in Hadoop, Spark, Cloud Data Engineering, Enterprise Architecture, Data Management, Security, or Big Data Platforms.
Roles & Responsibilities
· Engage with business and technology stakeholders to understand business objectives, data platform requirements, and modernization goals.
· Define end-to-end architecture for Hadoop and Big Data platforms supporting analytics, reporting, and AI workloads.
· Design scalable, secure, and high-performance Hadoop ecosystems using HDFS, YARN, Spark, Kafka, Hive, and related technologies.
· Architect data ingestion, batch processing, streaming, and data lake solutions for enterprise- scale environments.
· Define data models, data lake zones, governance frameworks, metadata management, lineage, and security standards.
· Lead Hadoop modernization, migration, and platform optimization initiatives to improve performance, scalability, and operational efficiency.
· Establish architecture standards, reusable frameworks, engineering best practices, and DataOps operating models.
· Provide technical leadership across solution design, implementation, testing, migration, deployment, and production support activities.
· Conduct architecture reviews, identify risks and dependencies, and guide teams on mitigation strategies and best practices.
· Drive performance tuning, capacity planning, reliability improvements, and infrastructure cost optimization.
· Collaborate with data en gineers, platform teams, architects, vendors, and client stakeholders to deliver enterprise data solutions.
· Support solutioning, RFP responses, effort estimation, technical presentations, and client workshops.
· Mentor architects and engineers and contribute to hiring, capability development, and knowledge-sharing initiatives.
· Develop reusable accelerators, reference architectures, implementation frameworks, and technical best practices for Big Data platforms.
Generic Managerial Skills, If any
· Strong leadership and stakeholder management skills with the ability to work effectively across business, engineering, architecture, and delivery teams.
· Excellent communication and presentation skills for technical, business, and executive audiences.
· Strong problem-solving and consulting mindset with the ability to evaluate options and recommend practical solutions.
· Ability to lead cross-functional and distributed teams in a collaborative environment.
· High ownership, accountability, and attention to detail with a focus on quality delivery.
· Strong planning, prioritization, and decision-making skills while managing multiple initiatives and stakeholders.
· Experience mentoring architects and engineers and driving adoption of best practices.
· Ability to proactively manage risks, dependencies, and escalations to ensure successful project delivery.
· Strong client-facing experience supporting workshops, architecture reviews, solution presentations, and executive discussions.
· Adaptability to work in fast-paced environments with evolving business and technology priorities
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $130,000 - $170,000 a year
</div
Application prep
Use the role’s language and application details while tailoring your materials.
Keywords to mirror
sqlpythonjavaai
- Platform
- careers-page
- Effort
- medium
Benefits
Benefits detected in the listing.
Dental
Vision
401k
Parental Leave