Data - Michelin IT Engineering Blog

From Kafka to Delta Lake using Apache Spark Structured Streaming

Using Spark Structured Streaming to consume Avro events from Kafka and consolidate them with Delta Lake format on Azure Data Lake Storage

Architecture

“The metamorphose” of our Information System by Implementing a distributed event streaming platform

In this article, I want to share Michelin's experience on its first implementations of Kafka and distributed architectures, which is part of the early stages of implementing our EDA architectures. Our firsts experiences we had on a distributed platform.

Data

Open Sourcing Kafka Connect transforms for Qlik Replicate

We're very pleased to announce Kafka Connect transforms for Qlik Replicate in open source. This Single Message Transformation library aims to ease a Change Data Capture event integration into the Kafka ecosystem.

Architecture

Learn EDA & Streaming from practice

You hear more and more IT colleagues talk about event-driven architecture and stream programming, you understand this is the new paradigm shift of IT system design in company, but you might wonder how to grasp the key concepts quickly and most important how to

Data

Ordering guarantee when using Qlik Replicate and Apache Kafka

Streaming a database looks simple with Change Data Capture and Kafka. This post will explain the pitfalls and solutions when dealing with events ordering.

Monitoring

Measuring Kafka uptime

Discover how Michelin teams measure Kafka uptime.

Architecture

Legacy integration, a story of modernisation

Discover the challenges faced by Michelin teams to transform a 15 years old legacy system into domain-oriented streaming data source.

Data

Exponential Information Systems for a Data-Driven World

We live in times of accelerating changes fueled with “exponential technologies”. “Exponential Information Systems” is all about constant adaptation for the information system. This article details it and show how it can contribute to a data-driven backbone towards a data driven company.