DEV Community

Cover image for Deep insight into Shopee's data integration module refactor by Apache SeaTunnel
Apache SeaTunnel
Apache SeaTunnel

Posted on

1 1

Deep insight into Shopee's data integration module refactor by Apache SeaTunnel

SeaTunnel is collaborating with the leading e-commerce Shopee to have a deep tech talk with the technical experts from Shopee Singapore to share the optimization practice of SeaTunnel in Shopee.

The performance optimization of data integration facilitates enterprises to maximize the data value. It eliminates the problems such as the inconsistent caliber of various systems, complex data interaction, and lack of a unified data integration platform.

SeaTunnel is a rising star in the data integration space, It's a data integration platform that runs on Spark and Flink, supports a variety of data sources, and equips with a rich plug-in system.

Join us on 24 September 2022,14:00 PM GMT+8 to get a knowledgeable Tech Talk with Shopee engineers, SeaTunnel core developers, and contributors, as they will comprehensively discuss the data integration implementation techniques, and hands-on experiences using SeaTunnel in the e-commerce industry.

Image description

  • Schedule: Sat, 24 September 2022 | 14:00 PM GMT+8
  • Format of the event: live online
  • Sign up now (free): zoom link

Click the link to enter the SeaTunnel Meetup

https://bit.ly/3KAqGmJ

Scan to get the Slack channel link

Image description

Learn and gain new knowledge about SeaTunnel by registering yourself through: https://seatunnel.apache.org/

Agenda

14:00 ~ 14:05

Opening

14:05 ~ 14:45

Image description
Speaker: Yang Wang, Shopee Data Engineer
Topic: Practice of Apache SeaTunnel in Shopee

Summary:
Introduce the process and ideas of introducing SeaTunnel into Shopee, and show how to use SeaTunnel right out of the box, how to use SeaTunnel to refactor existing modules, and SeaTunnel servitization in the platform by instances.

14:50 ~ 15:30

Image description
Speaker: William GUO, Apache Foundation Member
Apache Projects in Modern Data Stack

Summary:
Help the audience to quickly understand the latest features of the new generation of Modern Data Stack: "de-specialization", "de-centralization", "extremely fast experience", "use as needed", sharing and explaining what is MDS( Modern Data Stack) and how to use the Apache open source project to implement MDS.

15:30 ~ 16:10

Image description
Speaker: Jiayi Jin, Shopee Data Expert
Integration Practice of SeaTunnel x Druid in Shopee

Summary:
Introducing how Shopee uses SeaTunnel to help Druid business build Pipelines more quickly, shorten business delivery cycles, and improve iteration efficiency

16:10 ~ 16:50

Image description
Speaker: Jia Fan, Apache SeaTunnel PPMC
Make data integration easy by SeaTunnel

Summary:
Introduce what SeaTunnel is and how to use it, as well as its advantages over traditional data synchronization. A quick guide by referring to use cases to help you know and experience SeaTunnel, and help new users quickly implement SeaTunnel in the production environment.

Apache SeaTunnel(Incubating) is a distributed, high-performance, easily scalable, data integration platform for massive data (offline & real-time) synchronization and transformation. On December 9, 2021, SeaTunnel was officially voted as an Apache incubator project with unanimous votes by the world's top open source organization, Apache Software Foundation!

The Meetup is monthly held by the SeaTunnel community, which is mainly for the developers in the data synchronization space. Through the practice sharing of front-line engineers, it aims to help the community developers to improve their professional skills and knowledge and creates greater value for the community around the globe.

The series meetups have been held successfully 6 times, attracting more than 7000+ technology-enthusiastic attendees.

Heroku

Built for developers, by developers.

Whether you're building a simple prototype or a business-critical product, Heroku's fully-managed platform gives you the simplest path to delivering apps quickly — using the tools and languages you already love!

Learn More

Top comments (0)

Image of Quadratic

Free AI chart generator

Upload data, describe your vision, and get Python-powered, AI-generated charts instantly.

Try Quadratic free

👋 Kindness is contagious

Explore a trove of insights in this engaging article, celebrated within our welcoming DEV Community. Developers from every background are invited to join and enhance our shared wisdom.

A genuine "thank you" can truly uplift someone’s day. Feel free to express your gratitude in the comments below!

On DEV, our collective exchange of knowledge lightens the road ahead and strengthens our community bonds. Found something valuable here? A small thank you to the author can make a big difference.

Okay