Real-Time Data Engineer

About the role

The Real‑Time Data Engineer will design, deploy, and operate large‑scale Apache Kafka and Confluent Platform environments, owning the streaming platform end‑to‑end, ensuring security, automation, observability, and developer enablement while collaborating with cross‑functional teams and mentoring junior engineers.

About the company

Bright Vision Technologies is a privately held technology consulting and software development firm founded in 2009, with 11–50 employees, delivering cloud, AI, data, and enterprise solutions—including corporate training and IT consulting—to clients across the United States.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or related technical discipline.
• Minimum five (or six) years of experience operating Apache Kafka or Confluent Platform in production.
• Deep hands‑on knowledge of Kafka internals (partitions, replication, ISR, consumer groups).
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands‑on experience with Kafka Connect, Schema Registry, and Kafka Streams or ksqlDB.
• Experience designing and implementing HA/DR strategies for Kafka.
• Proficient scripting in Python, Bash, or Go.
• Experience with infrastructure‑as‑code tools such as Terraform or Ansible.
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.
• Confluent Certified Administrator or Developer credentials (preferred).
• Experience operating Kafka on Kubernetes (Strimzi, Confluent Operator) (preferred).
• Exposure to managed Kafka services like AWS MSK or Azure Event Hubs Kafka API (preferred).
• Familiarity with stream‑processing frameworks such as Flink or Spark Streaming (preferred).
• Experience with data governance and lineage for streaming data (preferred).