PhoenixTeam Logo

PhoenixTeam

Kafka Admin/Developer

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Design, deploy, and maintain Apache Kafka clusters and streaming solutions across cloud/hybrid environments. Build producers/consumers, Kafka Streams/ksqlDB, and Connect connectors. Implement security (SSL/SASL/ACLs), schema management, monitoring, HA/DR, and compliance (HIPAA/FedRAMP/NIST). Integrate with API gateways and observability tools, troubleshoot production incidents, support audits, and collaborate with DevSecOps, data engineers, and security teams in Agile processes.
The summary above was generated by AI

Key Responsibilities:
Kafka Administration
• Install, configure, and maintain Apache Kafka clusters in cloud and hybrid environments.
• Manage Kafka brokers, ZooKeeper / KRaft, topics, partitions, and replication.
• Monitor cluster health, throughput, latency, and availability.
• Perform capacity planning, upgrades, patching, and performance tuning.
• Implement high availability and disaster recovery strategies.
Kafka Development & Streaming
• Design and develop event-driven architectures using Kafka.
• Build and maintain Kafka producers and consumers.
• Implement Kafka Streams / ksqlDB for real-time data processing.
• Develop and manage Kafka Connect connectors for source and sink systems.
• Ensure schema management using Schema Registry (Avro, JSON, Protobuf).
Security & Compliance
• Implement Kafka security features including SSL/TLS, SASL, and ACLs.
• Enforce data encryption in transit and at rest.
• Integrate Kafka with IAM and enterprise authentication systems.
• Support compliance with HIPAA, CMS, FISMA, FedRAMP, and NIST standards.
• Assist with audits, security documentation, and ATO processes.
Integration & API Enablement
• Integrate Kafka streams with API Gateways (e.g., MuleSoft).
• Support near real-time data feeds for fraud detection and analytics platforms.
• Collaborate with API developers and data architects on integration patterns.
• Ensure reliable data delivery and message ordering.
Operations & Monitoring
• Integrate with existing monitoring and alerting tools like Splunk, New Relic, Grafana, ELK, or Confluent Control Center.
• Troubleshoot production issues and perform root cause analysis.
• Support incident response and on-call rotations.
• Document configurations, processes, and operational runbooks.
Agile Collaboration
• Work closely with DevSecOps, data engineering, QA, and security teams.
• Participate in Agile ceremonies and release planning.
• Provide technical guidance and best practices for streaming solutions.
Required Qualifications:
• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 4+ years of experience with Confluent Kafka administration and development.
• Hands-on experience with Kafka Connect, Kafka Streams, and Schema Registry.
• Experience with cloud platforms (AWS MSK, Confluent Cloud, Azure Event Hubs for Kafka).
• Strong Linux and scripting skills (Bash, Python).
Preferred Qualifications:
• Experience supporting federal or healthcare IT programs.
• Knowledge of FHIR/HL7 healthcare data standards.
• Experience with API Gateway platforms.
• Familiarity with containerized Kafka deployments (Docker, Kubernetes).
• Experience with event-driven microservices architectures.
Key Skills:
• Confluent Kafka Administration & Development
• Real-Time Data Streaming & Event Processing
• Kafka Security & Compliance
• Cloud & Hybrid Architectures
• Monitoring, Performance Tuning & Troubleshooting
• Healthcare & Federal IT Compliance
Residency Requirement: Candidate must be able to obtain Public Trust clearance and must have lived in the United States for at least three (3) out of the last five (5) years.

Similar Jobs

11 Hours Ago
Easy Apply
Remote
US
Easy Apply
Expert/Leader
Expert/Leader
Cloud • Security • Software • Cybersecurity • Automation
As Vice President, Legal Commercial, you will lead GitLab's global commercial legal function, advising on strategies, managing a legal team, and overseeing AI governance and contracting.
11 Hours Ago
Easy Apply
Remote
United States
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Manage a team of Professional Services Engineers, deliver GitLab platform services, ensure customer satisfaction, and improve operational effectiveness. Foster team growth and technical delivery consistency across projects while collaborating with cross-functional partners.
Top Skills: DevsecopsGitlabPlatform EngineeringSoftware Delivery
11 Hours Ago
Remote or Hybrid
New Jersey, USA
19-19 Hourly
Entry level
19-19 Hourly
Entry level
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
As a Customer Experience Associate, you'll support customers by resolving inquiries, managing communications, and advocating for player interests to enhance customer engagement.
Top Skills: MS OfficeServicenow

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account