Job Board

  • Stream Processing
  • Event Driven
  • Real Time

Global Virtual Conference 2020

October 19-20
Training
October 21-22
Conference

Description

Data stream processing is redefining what’s possible in the world of data-driven applications and services. Ververica with its Platform product and its major contributions to open-source Apache Flink is at the forefront of this development.

Our teams are pushing the boundaries of what can be achieved with data stream processing, allowing our users and customers to gain more insights into their data in real-time.

Apache Flink currently powers some of the largest data stream processing pipelines in the world, with users such as Alibaba, Uber, ING, Netflix, and more running Flink in production.

Ververica was founded in 2014 by the original creators of the Apache Flink project, and we’re building the next-generation platform for real-time data applications.

We are looking for passionate software developers that enjoy solving challenging problems and are excited about open source, helping us build world-class data streaming technology.

As a software engineer at Ververica, you will take a dual role: being involved in both the open source Apache Flink project, as well as Ververica products. You should be comfortable with taking responsibility for designs and features, and be able to work both self-supervised and in cross-functional teams. As a citizen of the Flink open source community, you will be in direct touch with Flink users and participate in the day-to-day open source work. We also encourage engineers to talk publicly about their work at conferences, meetups, and via blog posts.

Requirements

 

What you’ll do all day…

  • You will be part of a cross-functional team of backend and frontend engineers as well as a product manager to build our commercial Ververica Platform product offering. Our platform enables customers to run mission-critical Apache Flink applications with ease and confidence.
  • You will design and implement both the frontend and backend services that help users to manage Apache Flink applications. Your focus will be on high quality code that enables existing and future customers to solve real-world problems. We use Angular for our frontend and mostly work in Java for our backend systems, however we believe that languages and frameworks can be learned. Therefore, we care more about your overall engineering skills than about knowledge of a particular framework or language.
  • You will collaborate closely with development teams from China. Our development efforts are spread around the world with the main teams based in Europe and China. Our goal is to make this collaboration as smooth as possible. We strive for a healthy balance between async and direct communication.
  • You will troubleshoot issues and debug problems in a stack that includes containerized services running on Kubernetes as well as integrations with open source systems such as Apache Flink.
You will love this job if you …
  • ...have good knowledge of JavaScript and web frameworks.
    • Experience with Angular and TypeScript is a plus
  • ...have good knowledge of Java and the JVM or are motivated to learn it if your prior experience is in another major programming language (e.g. Go, Python, etc.).
    • Experience with Java web applications is a plus
  • ...enjoy software engineering best practices such as clean code and code reviews.
  • ...like to work with open source technologies such as Angular, Apache Flink or Kubernetes.
  • ...are a self-starter who can get things done and who enjoys working collaboratively in all phases of your work, from designing and implementing to reviewing.

You will have an edge if you …
  • … have worked with or contributed to relevant open-source projects (e.g. in the distributed data processing space or web frameworks) before
  • … have an aptitude for simple, robust, and elegant designs, including how to design appealing APIs and libraries
  • … have experience in working collaboratively on large code bases is a plus

Benefits

  • Competitive salary
  • Great career opportunities in a world-class team with peers from top-companies, universities and research institutes.
  • International team environment (10 nationalities so far)
  • Snacks, coffee and beverages in the office
  • Relocation assistance if needed
  • Chinese classes in the office

 

Please be informed that by applying for the job offer you hereby agree that Ververica would use your personal data in the recruitment process. The legal basis for processing your application data is Article 6 par. 1 lit. b) GDPR. Your rights in respect of data protection can be found in Chapter 3 of GDPR, and you have the right to contact a supervisory authority. Further, you may contact our data protection officer via dataprotection@ververica.com

Location: Berlin, Germany

Data stream processing is redefining what’s possible in the world of data-driven applications and services. Ververica with its Platform product and its major contributions to open-source Apache Flink is at the forefront of this development.

Our teams are pushing the boundaries of what can be achieved with data stream processing, allowing our users and customers to gain more insights into their data in real-time.

Apache Flink currently powers some of the largest data stream processing pipelines in the world, with users such as Alibaba, Uber, ING, Netflix, and more running Flink in production.

Ververica was founded in 2014 by the original creators of the Apache Flink project, and we’re building the next-generation platform for real-time data applications.

We are looking for passionate software developers that enjoy solving challenging problems and are excited about open source, helping us build world-class data streaming technology.

As a software engineer at Ververica, you will take a dual role: being involved in both the open source Apache Flink project, as well as Ververica products. You should be comfortable with taking responsibility for designs and features, and be able to work both self-supervised and in cross-functional teams. As a citizen of the Flink open source community, you will be in direct touch with Flink users and participate in the day-to-day open source work. We also encourage engineers to talk publicly about their work at conferences, meetups, and via blog posts.

 

 

What you’ll do all day:

  • Work together and discuss designs with your close team at Ververica.
  • Discuss designs with the Flink community and work together with outside contributors of Apache Flink.
  • Write code that will live for a long time in an open source project. This, to a large part, includes the SDK/APIs that users of Flink use. It is therefore critical to come up with designs that can be stable for a long time but are also extensible and maintainable.

You will love this job if you …

  • … have a good knowledge of Java.
  • … care about the users of the system and want to build a system that is intuitive to use.
  • … want to develop new ways to bring stream processing into new frontiers.
  • … like collaborating with the open source community or could see yourself liking that.
  • … want to write clean, testable code, that is also efficient.
  • … have an aptitude for simple, robust, and elegant designs, including how to design appealing APIs and libraries
  • … have experience in working collaboratively on large code bases is a plus

What we offer … 

  • Competitive salary
  • Great career opportunities in a world-class team with peers from top-companies, universities and research institutes.
  • International team environment (10 nationalities so far)
  • Snacks, coffee and beverages in the office
  • Relocation assistance if needed
  • Chinese classes in the office
Location: Berlin, GERMANY

Data stream processing is redefining what’s possible in the world of data-driven applications and services. Ververica with its Platform product and its major contributions to open-source Apache Flink is at the forefront of this development.

Our teams are pushing the boundaries of what can be achieved with data stream processing, allowing our users and customers to gain more insights into their data in real-time.

Apache Flink currently powers some of the largest data stream processing pipelines in the world, with users such as Alibaba, Uber, ING, Netflix, and more running Flink in production.

Ververica was founded in 2014 by the original creators of the Apache Flink project, and we’re building the next-generation platform for real-time data applications.

We are looking for passionate software developers that enjoy solving challenging problems and are excited about open source, helping us build world-class data streaming technology.

As a software engineer at Ververica, you will take a dual role: being involved in both the open source Apache Flink project, as well as Ververica products. You should be comfortable with taking responsibility for designs and features, and be able to work both self-supervised and in cross-functional teams. As a citizen of the Flink open source community, you will be in direct touch with Flink users and participate in the day-to-day open source work. We also encourage engineers to talk publicly about their work at conferences, meetups, and via blog posts.

 

What you’ll do all day:

  • Develop state of the art/next generation/kick ass distributed data processing framework
  • Being part of a team solving some of the most challenging problems in distributed computing
  • Taking part in the development of the open source system Flink
  • Driving discussions in the quickly growing Flink community
  • Finding solutions to Flink’s user problems
  • Having the chance to represent Flink community at conferences

You will love this job if you …

  • … have a good knowledge of Java
  • … have an aptitude for simple, robust, and elegant designs, including how to design maintainable and evolvable systems
  • … worked or developed distributed systems
    • handling faults/being highly available
    • running in different environments
    • scheduling complex topologies
  • … like processing big data sets with an emphasis on performance and reliability
  • … have experience in working collaboratively on large code bases is a plus

What we offer … 

  • Competitive salary
  • Great career opportunities in a world-class team with peers from top-companies, universities and research institutes.
  • International team environment (10 nationalities so far)
  • Snacks, coffee and beverages in the office
  • Relocation assistance if needed
  • Chinese classes in the office

Job ID: 1201171

DESCRIPTION

 

Come change the way world processes streaming data

 

The Amazon Web Services (AWS) Kinesis Data Analytics (KDA) team is looking for Engineers to work on Apache Flink framework who are looking to learn and build distributed stream processing engines. We are looking for builders who are enthusiastic about data streaming and excited about contributing to open source.

Real-time data processing from a stream needs substantial investments from customers in writing the application and maintaining the necessary infrastructure. KDA service provides customers with fully managed stream processing platform leveraging Apache Flink framework where customers can develop their applications using SQL or Java. With the service all that customers need to do is provide the application code that needs to be run containing the business logic to process the stream and service takes care of providing building blocks/abstractions such as processing windows, execution semantics, checkpoints and infrastructure capabilities such as elasticity, fail-over, etc. eliminating complexity of stream processing.

Work/Life Balance

Our team is family-oriented and values work-life balance. Most days, our entire team is co-located in the Seattle office, but we’re also flexible when people occasionally need to work from home. We generally keep core in-office hours from 10am to 4pm. About half of us come in earlier and the other half of us stay later.

On-Call Responsibility

This position involves on-call responsibilities, typically for one week every two months. We don’t like getting paged in the middle of the night or on the weekend, so we work to ensure that our systems are fault tolerant. When we do get paged, we work together to resolve the root cause so that don’t get paged for the same issue again.

 

As a member of KDA team you will be:

  • working on making improvements to the stream processing engine, Apache Flink to make KDA service the defacto service to run stream processing application
  • upstream compatibility is a core tenet of KDA service and your changes to improve the engine will be contributed back to open source
  • working on improving efficiency and availability of the engine, adding ease of use features and push the envelope of stream processing
  • writing quality, reusable code for highly scalable and reliable cloud-based services
  • being a champion for operational excellence by Insisting on the Highest Standards
  • writing code that continuously improves service reliability and availability

The ideal candidate has experience working on large-scale systems, enjoys solving complex software problems, and possesses analytical, design and problem-solving skills. While not necessary having experience with data processing technologies such as Apache Flink, Apache Spark, Apache Storm, Hadoop frameworks is a plus.

 

Come join us to make stream processing main stream for our customers.

 

BASIC QUALIFICATIONS

  • 2+ years of non-internship professional software development experience
  • Programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
  • 1+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems.
  • Bachelor's degree in Computer Science, Electrical Engineering, or similar; or equivalent experience
  • Several years experience in system software development and delivery
  • Advanced software engineering skills, including the ability to write expert-level, maintainable, and robust code in C++ (preferred), Java, C, or similar
  • Strong Computer Science fundamentals in algorithms and data structures
  • Working experience with high concurrency, multithreaded and distributed systems

PREFERRED QUALIFICATIONS

  • Experience working on distributed big-data processing engines such as Apache Flink, Apache Spark etc. is a big plus
  • Experience building extremely high volume and highly scalable web services
  • Experience with distributed systems, consistent hashing, distributed locking, replication, and load balancing
  • Good communication skills and ability to work effectively on shared projects with other developers
  • Ability to mentor junior engineers and influence technical roadmap


Amazon is closely following the 2019 Novel Coronavirus Disease (COVID-19), and implementing processes that promote the safety of our employees, candidates, customers and communities. Learn more about how we're addressing the evolving situation.

Job ID: 1271048 

DESCRIPTION

Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team!

 

We are seeking an engineering leader to lead the Cambridge team of the Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for an engineering manager who is enthusiastic about data streaming, and is as passionate about contributing to open source as they are about solving real customers' business needs, at AWS scale.



We are looking for an experienced team leader who is known for delivering results. We expect you to work with other engineering and product leaders in AWS to build a charter for your team, hire and grow your team, own feature planning, and help run operations for the overall service. You will drive priorities for the overall service roadmap, balancing between contributions to the underlying open source platform, changes to Amazon-Internal components and the operational health of the service.

 

The ideal candidate has experience designing large-scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses analytical, design and problem-solving skills. They have a strong background in streaming data technologies such as Apache Kafka or Amazon Kinesis. They have experience making or driving open source contributions.

 

BASIC QUALIFICATIONS

  • Bachelor’s degree in Computer Science, Mathematics, or a related field or comparable experience
  • Several years of experience as a software engineering manager overseeing teams with large scope and impact
  • Several years' experience managing rapidly growing teams, driving hiring and managing the employee careers
  • Experience building and managing distributed services
  • Excellent communication skills, both written and verbal
  • Experience with Agile engineering practices (continuous integration, TDD, etc.)

PREFERRED QUALIFICATIONS

  • Experience with systems engineering and operations of Internet services
  • Advanced degree in computer science, mathematics, or a related field
  • Working knowledge of Kafka, Flink, Spark, Storm, or other real-time processing platforms
  • Experience with open source contributions



Amazon is an equal opportunity employer – minority / women / disability / veteran / gender identity / sexual orientation / age.

Job ID: 1095281 

DESCRIPTION

Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team!


We are seeking an engineering leader to manage one of the engineering teams in the Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for an engineering manager who is enthusiastic about data streaming, and using open source technologies to solve real customers' business needs, at AWS scale.



Building a High-Performing & Inclusive Team Culture

You should be passionate about attracting & developing a world-class team that welcomes, celebrates, and leverages a diverse set of backgrounds and skill-sets to deliver results. Driving results through others is your primary responsibility, and doing so in a way that builds on our inclusive culture is key to our long term success.



Work/Life Balance

MSK values work-life balance. Most days, our entire team is co-located in the Seattle office, but we’re also flexible when people occasionally need to work from home. We generally keep core in-office hours from 10am to 4pm. About half of us come in earlier and the other half of us stay later. We are builder-operators of our services at AWS and have a modest on-call rotation where you’ll participate once every 2-3 months.



Energizing and Interesting Technical Problems

You will be working on enabling your team to build and operate an open source data streaming platform, Apache Kafka, to make MSK the de facto service to run data streaming applications. Up-stream changes are a key investment in this space, so this is a truly unique role where you’ll get to partner closely with a vibrant open source community to define the features and roadmap. It’s humbling and energizing to integrate the latest open-source technologies with AWS scale.


Mentorship & Career Growth

We’re committed to the growth and development of every member of MSK, and that includes our development managers. You will have the opportunity to contribute to the culture and direction of the entire Data Streaming organization and deliver site-wide initiatives that will improve the life of all of our teams.


MSK is a growth environment - we’re hiring and scaling rapidly to meet the needs of our customers. You’ll have the opportunity to grow your scope of influence naturally as we scale and will have get to hire & develop other leaders along the way.

BASIC QUALIFICATIONS

  • 3+ years of building, retaining, and managing high performing diverse and inclusive teams
  • 3+ years experience growing and mentoring software engineers
  • Familiarity with modern programming languages (i.e. Java, JavaScript, C/C++, Objective C) and open-source technologies (i.e. Apache, Hadoop, Spark)

PREFERRED QUALIFICATIONS

  • Working knowledge of Kinesis, Kafka, Flink, Spark, Storm, or other streaming data platforms
  • Experience with systems engineering and operations of Internet services
  • Experience with open source contributions
  • Excellent communication skills, both written and verbal
  • Experience with Agile engineering practices (continuous integration, TDD, etc.)
  • Experience managing rapidly growing teams, driving hiring, and managing employee careers

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Engineering  Boulder, Colorado  San Francisco, California  Washington, D.C.  Austin, Texas  Seattle, Washington  San Jose, California

 

Role:

Splunk has a rich history of unearthing and analyzing customer data to solve their business problems from any angle.  As customers scaled, they realized they needed a tool to analyze that data in real time, bring that data together from disparate sources, and transform the data before it becomes searchable.

Splunk’s Data Stream Processor (DSP) allows our customers to continuously collect high-velocity, high-volume data from diverse sources and distribute insights to multiple destinations in milliseconds, using a scaleable, performant, high throughput streaming engine built on top of Flink, both on-premise and in the cloud. 

Splunk’s DSP team is looking for Engineers who are excited about data streaming at scale, and contributing to open source projects. 

As a member of the DSP core platform team, you will be 

  • Creating customer facing functionality to manipulate data streams on top of Apache Flink. 
  • Writing quality, reusable backend code in Java 
  • Building robust, fault-tolerant distributed systems in a multi-threaded/multi-process environment.
  • Scaling data-intense problems horizontally rather than vertically.
  • Working closely with a vibrant open source community 

Basic Qualifications:

  • 5+ years of professional software engineering and development experience.
  • Programming experience with at least one modern language such as Java, C++, or C#. 
  • BS, MS or PhD in Computer Science, related engineering discipline, or similar relevant experience. 
  • Familiarity with Docker and Kubernetes
  • Proven foundation in data structures, algorithms, software design.
  • Experience and knowledge of modern distributed system design and implementation.
  • Ability to mentor engineers and influence technical roadmap. 
  • Experience with cloud computing services like AWS, Azure, etc.
  • Excellent written and oral communication skills and ability to work with large, geographically and culturally diverse teams

Preferred Qualifications:

  • Experience working with distributed big-data processing engines such as Flink, Spark, Storm, etc. 
  • Experience building high volume and scalable services
  • Experience with distributed systems, consistent hashing, distributed locking, replication, and load balancing
  • Experience in developing and debugging large scale Java applications.

What we offer:

  • A constant stream of new things for you to learn. We're always expanding into new areas, bringing in open source projects and contributing back, and exploring new technologies.
  • A set of exceptionally talented and dedicated peers, all the way from engineering and QA to product management and customer support.
  • A stable, collaborative and supportive work environment.
  • We don't expect people to work 12 hour days. We want you to have a successful life outside of work. We trust our colleagues to be responsible with their time and dedication, and believe that balance helps cultivate an extraordinary environment. We are also flexible with respect to working from home.
  • We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status

 

Thank you for your interest in Splunk!

http://splk.it/flinkjobs

Engineering  London, United Kingdom

 

Join us as we pursue our disruptive new vision to make machine data accessible, usable and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we’re committed to our work, customers, having fun and most importantly to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!

Role

As a System Test Engineer, you will be working on Splunk product system tests, especially on GDI area. GDI is Getting Data In and it’s the most important foundation layer of Splunk to do the data analysis work. The tests you will conduct include but not limited to Large-Scale end to end user scenarios test, kinds of non-functional *-ability test like stability test (aka. Fault injection/chaos test), upgrade/migration test, reliability test, scalability test and etc. You will also need to develop and maintain related tools and test framework.

You will work in a dynamic team of architects and System Engineers with the responsibility to ensure that we deliver high-quality solutions to meet the business needs of Splunk customers. Working experience in the native cloud software delivery environment is a huge plus.

Responsibilities: I can do that!

  • Define, execute and automate large scale and *-ability system level testing on GDI area of Splunk on-prem and cloud products
  • Read and understand PRD, ERD to make sure we have enough coverage
  • Demonstrate test experience in the following areas on a distributed system:
    • Upgrade and migration
    • Interoperability
    • Stability
    • Reliability
    • Scalability
  • Documents systems-level defects, using Jira tracking system, and reports defects to developers. Inspect and pinpoint the issue, and help to resolve the issue
  • Identifies, analyzes, troubleshoots, and documents problems with program function, output, or content.
  • Develops testing programs that assess effectiveness of a new system or modification of an existing system.
  • Demonstrates knowledge in automation frameworks in a test environment. Additionally, the job involves testing in a lab environment, designing and implementing test setups and automation.

Requirements

  • Experience in developing test plans/strategies and collaborate with cross teams to define measurement for quality, assess risk and mitigation plan.
  • Strong debugging and technical problem-solving skills, as well as a passion to seek hard, ambiguous problems.
  • Experience in any of or multiple programming languages: Python, JavaScript, Java, C++ or similar
  • Experience in working on distributed systems and micro-service applications
  • Skilled in test automation and CI/CD
  • Good at Linux system knowledge and multiple OS administration skills.
  • Comfortable with Linux, Kubernetes, Promethus, AWS, GCP, GIT, Artifactory in terms of both tools and systems administration
  • Knowledge on Kafka, Flink, Hadoop, MapReduce, Spark is a plus
  • Previous experience in design and implementation of solutions to evaluate and improve performance: availability, reliability, interoperability, scalability of SaaS / Cloud Native / Bigdata Platform and application with microservice architecture
  • Detail-oriented and well organized
  • Excellent communication and team collaboration across sites are a must

Minimum qualifications

  • BS or master’s degree in computer science or related Engineering field or equivalent practical experience.
  • 8 years of experience in engineering with at least 3 years in software development in test
  • Experience with Python/Java/C/C++ and Test Automation.

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.

For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

 

Thank you for your interest in Splunk!

http://splk.it/flinkjobs

Engineering  San Francisco, California  San Jose, California

 

Join us as we pursue our disruptive new vision to make machine data accessible, usable and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we’re committed to our work, customers, having fun and most importantly to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!

Role:

As the Senior Software Development Manager for our Applied Science team you will be responsible for ensuring our new ML algorithms, ML services, and experimentation infrastructure meets all technical and quality standards. Our mathematical models and ML infrastructure underpin Splunk’s core products and you will work with Product Management, and other technical teams within Splunk, to incorporate new requirements related to this advanced ML Platform.

You will lead a team of ML researchers and engineers, who are experts within their own specialty, as we tackle a spectrum of problems across optimization, inference, forecasting, time series modeling, and log mining. You will be working in a multi-office, multi-location development environment, and so prior experience working with local and remote teams or groups will be a big plus.

Requirements:

  • 8+ years data driven web application or server side software development
  • 4+ years software development management experience, including team performance management
  • 2+ years of Machine Learning algorithm or machine learning services development experience
  • Passionate about building and fostering good engineering practices and processes such as agile software development, continuous integration and deployment etc.
  • Minimum of 8 years of related experience with a Bachelors in Computer Science, Computer Engineering; or 6 years and a technical Master’s degree; or a PhD with 3 years’ experience; or equivalent practical experience.

Desirable, but not required:

  • Expertise in developing software on a public cloud platform (e.g. AWS, GCP, MS Azure etc.)
  • Expertise in developing software with stream processing technology (e.g. Flink, Kafka, AWS Kinesis etc.)
  • Experience developing and putting into production test automation and CI/CD systems

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.

For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

 

Thank you for your interest in Splunk!

http://splk.it/flinkjobs