18 days old

Integration Engineer - Kafka

Best Buy
Richfield, MN 55423
  • Job Code
    741643BR
We are currently looking for a Messaging Engineer who is a Kafka/RabbitMQ subject matter expert, that can make a huge impact on an enterprise-scale as part of the Integration Messaging team. This role would have responsibility for architecture, design, setup, configuration, implementation, management, troubleshooting, performance tuning, governance, technical administration and maintenance of solutions and environments. These messaging systems could be operating either on-premises data centers or on the cloud.

The team performs a strategic analysis of messaging systems and makes recommendations on improvements and/or new systems required to meet business needs and future capacity. This team ensures messaging systems remain at operational excellence during infrastructure improvements and solutions are manageable, scalable and security compliant. The team is also responsible for automation to install, configure, operate and monitor these systems using a wide variety of open source technologies and tools. This team requires collaboration, open communication, and work across various geographies and time zones with an onshore/offshore model.

Key Responsibilities:

  • Perform engineering tasks related to design, install, configure and manage Kafka/RabbitMQ solutions in a large-scale environment
  • Standardize and automate the setup of environments using Infrastructure-as-Code
  • Implement automated methods for topic and partition management within these messaging systems as applicable
  • Provide expertise in Kafka/RabbitMQ and be able to diagnose, tune and resolve performance and high availability issues
  • Implement and maintain monitoring to ensure service availability and use metrics to track the performance of these key systems
  • Utilize industry-standard technologies & methods to ensure the integrity & recoverability of messaging-based systems
  • Accelerate adoption of the Kafka ecosystem in Best Buy by providing "customer-focused" administrative support of messaging systems
  • Establish best practices for implementing our project needs based on identified use cases and required integration patterns
  • Leverage Agile Development Methodologies
  • Mentor and guide other members within the team
  • Strong problem-solving and analytical skills, initiative, eagerness to learn new technologies and research new technologies, tools, analytics techniques to invest in your skills and grow, improve, and ability to work independently
Basic Requirements:
  • 3 years of technical experience with managing and maintaining messaging systems like Kafka/RabbitMQ etc
  • 3 years of experience in installing, configuring, performance tuning, security patching, monitoring setup, troubleshooting, recoverability of these messaging systems
  • 3 years of experience with setting up and managing clustering, brokers, topics, partitions, replication, producers, consumers, queues, channels, etc., for Kafka/RabbitMQ
  • 3 years of extensive experience with one or more data pipelines using Kafka streams /Kafka connect source /Kafka rest proxy or direct Kafka producers or consumers and RabbitMQ
  • 2 years of experience in installing, configuring, deploying, maintaining, and operating applications in cloud instances such as AWS or GCP or Azure
  • 2 years of experience with Infrastructure automation using tools like Chef and continuous integration and deployment tools like Jenkins
Preferred Requirements:
  • Worked on Big Data Integration & Analytics based on Hadoop, SOLR, Spark, Storm etc
  • Experience with Elasticsearch, Splunk, Graphite, Logstash, Filebeat, Metricbeat, monitoring tools like Splunk, Kibana, and Grafana
  • Java application container configuration, security, tuning (Tomcat, JBoss, etc.)
  • Experience with IBM MQ messaging system in its setup and management
  • Familiarity with multiple public cloud technologies, such as server-less computing, managed streaming for Kafka
  • Exposure to Real-Time Streaming Analytics like using K-SQL etc






Posted: 2019-11-23 Expires: 2019-12-22
Sponsored by:
Farm Credit Services of America Logo
Sponsored by:
Bank of America Logo

Featured Jobs[ View All ]

Featured Employers

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Integration Engineer - Kafka

Best Buy
Richfield, MN 55423

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast