Kafka Architect

MUDALS TECHNOLOGIES

Job Description

Job Title: Kafka / MSK Architect – Enterprise Messaging Platform

Experience: 10–12+ Years

Location: Hyderabad, India (On-site)

Company: Mudals Technologies

Job Summary:

We are seeking an experienced Kafka / MSK Architect to lead the design, implementation, and governance of an enterprise-wide messaging platform spanning on-premises OpenShift and AWS MSK environments. This role will be responsible for defining platform architecture, standards, security, scalability, and operational excellence for a multi-tenant Kafka ecosystem supporting multiple business and engineering teams. The ideal candidate will possess deep expertise in Kafka, AWS cloud services, distributed systems, and platform engineering while driving enterprise adoption of event-driven architecture practices.

Key Responsibilities:

Kafka Platform Architecture

• Lead the architecture and design of a centralized enterprise Kafka platform across on-prem OpenShift and AWS MSK environments.

• Define platform standards, reference architectures, and best practices for Kafka adoption across multiple teams.

• Design scalable, highly available, and resilient messaging solutions supporting mission-critical workloads.

• Establish governance frameworks for topic management, retention policies, naming conventions, and platform usage standards.

• Develop enterprise-wide event-driven architecture patterns and messaging guidelines.

AWS MSK & Hybrid Cloud Design

• Design and implement AWS MSK-based messaging platforms in multi-account AWS environments.

• Architect hybrid connectivity between on-premises infrastructure and AWS cloud environments.

• Design Kafka replication and disaster recovery solutions using MirrorMaker 2 or equivalent technologies.

• Develop strategies for consolidating Kafka deployments across multiple AWS accounts into a centralized shared platform.

• Collaborate with networking teams to design secure and optimized connectivity models.

Platform Engineering & Automation

• Implement infrastructure-as-code solutions using Terraform for Kafka platform provisioning and management.

• Drive GitOps practices using Argo CD and configuration-as-code methodologies.

• Define automated deployment, upgrade, and configuration management processes.

• Collaborate with OpenShift and Kubernetes platform teams for Kafka Operator deployment and management.

• Establish reusable platform components and self-service capabilities for development teams.

Security & Governance

• Design and implement Kafka security controls including TLS, mTLS, SASL, encryption, and authentication mechanisms.

• Establish role-based access controls (RBAC) and enterprise authorization standards.

• Define governance processes for platform onboarding, access management, and audit compliance.

• Ensure adherence to enterprise security, compliance, and regulatory requirements.

• Collaborate with security teams to implement secure messaging architectures.

Reliability, Monitoring & Operations

• Define monitoring, observability, and alerting standards for Kafka platform operations.

• Implement operational dashboards and health monitoring using tools such as Prometheus, Grafana, CloudWatch, and OpenSearch.

• Lead capacity planning, performance tuning, and scalability initiatives.

• Develop high-availability and disaster recovery strategies aligned with business continuity objectives.

• Create operational runbooks, troubleshooting guides, and platform support procedures.

Leadership & Stakeholder Management

• Lead technical decision-making and architecture reviews for Kafka-related initiatives.

• Mentor platform engineers and provide technical leadership across messaging and streaming technologies.

• Conduct design workshops, knowledge-sharing sessions, and architecture governance reviews.

• Collaborate with application development, cloud, infrastructure, networking, and security teams.

• Drive platform adoption and enable engineering teams through best practices and technical guidance.

Required Skills:

• 10+ years of experience in Platform Engineering, Infrastructure Engineering, Cloud Architecture, or DevOps.

• Deep expertise in Apache Kafka architecture, administration, and operations.

• Strong hands-on experience with AWS MSK in enterprise production environments.

• Experience designing and supporting large-scale multi-tenant messaging platforms.

• Strong knowledge of distributed systems, event-driven architectures, and streaming platforms.

• Experience with Kafka security, performance tuning, capacity planning, and operational management.

• Solid understanding of AWS networking concepts including VPCs, Transit Gateway, PrivateLink, security groups, routing, and IAM.

• Experience working in multi-account AWS environments.

• Hands-on experience with Terraform and Infrastructure as Code practices.

• Strong knowledge of Kubernetes and OpenShift platforms.

• Experience with GitOps methodologies and tools such as Argo CD.

• Excellent troubleshooting and problem-solving skills.

Good-to-Have:

• Experience with Confluent Platform and Confluent ecosystem components.

• Experience with Schema Registry, Kafka Connect, ksqlDB, and stream processing solutions.

• Exposure to Azure Event Hubs, Azure Kubernetes Service (AKS), or multi-cloud messaging architectures.

• Knowledge of FinOps practices and cloud cost optimization strategies.

• Experience with enterprise integration patterns and API-led architectures.

• Familiarity with OpenTelemetry and modern observability frameworks.

Certifications:

• Mandatory: Kafka or Confluent Certification -Confluent Certified Administrator for Apache Kafka (CCAAK)

• AWS Certified Solutions Architect – Professional (Preferred).

• AWS Certified Advanced Networking – Specialty (Preferred).

• Certified Kubernetes Administrator (CKA) or equivalent (Preferred).

What Success Looks Like:

• Enterprise-wide Kafka platform successfully supporting multiple business domains.

• Secure, scalable, and highly available AWS MSK and hybrid Kafka architecture.

• Standardized Kafka governance, security, and operational practices across teams.

• Automated platform provisioning and configuration management through IaC and GitOps.

• Improved platform reliability, observability, and disaster recovery readiness.

• Successful knowledge transfer and enablement of internal platform engineering teams.

Contact Information

www.mudalstech.com

INDIA

MUDALS TECHNOLOGIES PVT LTD

Pranava IT Business Park

Hyderabad - 500084, India