Forem: SelectDB

"Evolution of Apache Doris in Moka BI"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:47:33 +0000

https://www.youtube.com/watch?v=A5-y1Mv_NUk

Moka
As an industry-leading, data-driven intelligent HR SaaS service, Moka BI provides comprehensive data statistics and report support for enterprise human resources. In the research of BI report engine, real-time query, standard SQL and JOIN supports are what we are looking for. After comprehensive comparison of various databases, we finally chose Apache Doris. During more than two years of use, Moka has kept following the latest versions of Doris. The performance of the latest version has been greatly improved compared with the past, and the P95 query is within 3 seconds. In the future, Moka will always use the latest features.

Apache Doris is a real-time analytical database based on MPP architecture, known for its high performance and ease of use. It supports both high-concurrency point queries and high-throughput complex analysis. (https://github.com/apache/doris)

SelectDB is a cloud-native real-time data warehouse developed based on the Apache Doris open source project by the same key developers. The SelectDB company focuses on the enterprise-grade cloud-native distribution for Apache Doris. (Contact US: support@selectdb.com)

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Best Practice: The Application of Baidu Palo in ZHIHU.COM"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:46:23 +0000

https://www.youtube.com/watch?v=RRmZcCVQnm0

ZHIHU.COM
Refined operations can improve the operating efficiency of enterprises and bring more revenue to enterprises. Effective tools can bring more business value to enterprises. Therefore, the Zhihu data platform was created and became handy in data-driven decision-making for business personnel since it was born. With its outstanding query and data processing performance, Apache Doris meets our needs for fast data ingestion, second-level grouping and insight of hundreds of billions of feature data. At the same time, after the launch of the vectorized execution engine, the grouping performance of billion-level data has increased by 10 times, and the performance of single-table aggregation query and multi-table association query have also increased by 3-5 times. In the future, we also look forward to using Apache Doris to further support our data platform to achieve refined operations, cost reduction and efficiency increase.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in 360 Technology Group"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:44:56 +0000

https://www.youtube.com/watch?v=YNT4Ps7rchM

360 Security
360 Security began to use Apache Doris sinced Version 0.13. In terms of OLAP storage engine, 360 Security experienced various databases. Currently, Apache Doris is the most ideal OLAP storage engine. The excellent query performance and easy-to-use features of Apache Doris make our real-time data warehouse architecture more concise, and ensure the end-to-end consistency of real-time data. In the future, we hope to bring Apache Doris to more business scenarios and we can deeply participate in the Apache Doris community.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in Yiguanzhiku Network Technology"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:43:06 +0000

https://www.youtube.com/watch?v=UxyyT6bJdXE

Yiguanzhiku Network Technology
In the early days, Yiguanzhiku Network Technology introduced Greenplum as the OLAP database in query analysis scenarios. With business development and technology changes, Greenplum's performance cannot support real-time analysis of large amounts of data, and the introduction of other components such as Hive/ES has brought new pressure on operation and maintenance. So Yiguanzhiku Network Technology migrated to Apache Doris from Greenplum. With the advantages of Doris’ rich data ecology and ease of use, the daily query time is reduced by 30%, the efficiency of special scenarios is increased by 5 times, and the storage space is saved up to 40%. In the future, the company will look for more feasible solutions together with Apache Doris.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in YundaEX"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:41:46 +0000

https://www.youtube.com/watch?v=L7m3csCX0BU

Yunda EX
In recent years, with the vigorous development of the express logistics industry, the amount of data has increased by hundreds of times. In 2022, the number of deliveries has exceeded 100 billion. Faced with such a large amount of data, Yunda has established a data platform based on the business center and data center to provide unified and diversified data services for the business. After detailed research and selection, we decided to build a unified real-time data warehouse with Apache Doris. In this way, the new data warehouse is able to serve multi-department reporting and respond to multi-table related queries in seconds, covering more than 90% of the core indicators. In the future, we will also allow Apache Doris to serve more businesses and further promote the real-time indicators.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in LY Digital"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:40:21 +0000

https://www.youtube.com/watch?v=gx_ybzcUy3k

LY Digital
The growing demand for analysis of real-time data has further made real-time data warehouse an important part of enterprise production systems. In order to achieve a complete real-time analysis capability, we have carried out iterations of various architectures, from offline data warehouses, to real-time data warehouses, and finally to streaming compute & batch processing's integration. Finally, we built a unified data warehouse with Apache Doris, realizing the unification of storage layer, computing layer and data access layer. It not only simplifies the data links and reduces the maintenance cost of the entire data production, but also brings an easier way to use big data just like using databases. In this way, the business team has the ability to self-develop, be efficient in development, and quickly launch new requirements.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in JD.COM"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:39:09 +0000

https://www.youtube.com/watch?v=QPsoN6lRJ44

JD.COM
JD.COM's Search & Push Project started in 2019. Its goal is to bring better exposure and clicks to the high-quality goods resources of merchants on the platform through traffic control. Since joining the project, Apache Doris has been responsible for the traffic in JD.COM's Double 11 and 6.18 promotions during the past three years, with the traffic peaks reaching 450 million per minute. The 1.1.5 version released by Apache Doris has made a major breakthrough in performance and stability. The query performance is 2-3 times higher than before, and the overall cluster import throughput is increased by 100%, which greatly solves the problems and optimizes the unity of cost, efficiency and user experience.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in Douyu"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:37:51 +0000

https://www.youtube.com/watch?v=tgeYbF1chXc

Douyu
With the rapid development of Douyu's live-streaming business, the demand for business growth analysis and revenue analysis using user behavior data is becoming more and more urgent and sophisticated. To deal with the increasing demand, Douyu introduced Apache Doris to upgrade the real-time data warehouse, standardized and improved the real-time data warehouse, and established a unified HOLAP multi-dimensional analysis platform, which solved the difficulties caused by heavy architecture in the past. At the same time, Douyu rebuilt its tag platform using Apache Doris, realizing a grouping time from minutes to seconds, stable real-time tag tasks, and a 40% decrease in output time.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Realtime Data Warehouse in Mashang Consumer Finance Based on Apache Doris"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:36:23 +0000

https://www.youtube.com/watch?v=5q4nswAf3vg

Mashang Consumer Finance
With the rapid growth of business volume and the upgrading of business models, there is a higher demand for real-time data analysis, which means it is neccessary to upgrade from offline data warehouse to real-time data warehouse. After comparing the popular open source data warehouses in the industry, we finally decided to build our real-time data warehouse based on Apache Doris. At present, Apache Doris has served the data applications of more than ten business departments. The P99 query response is within 5 seconds. From data production to data application, the latency does not exceed 1 minute, which greatly improves the timeliness of data. Different types of users, including business analysts, data developers, platform managers, and operation and maintenance teams, have all benefited from Apache Doris.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Best Practice: Multidimensional Analysis with Apache Doris in Xiaomi"_Apache Doris Summit

SelectDB — Wed, 08 Feb 2023 03:34:46 +0000

https://www.youtube.com/watch?v=t_xLlUm5KjE

Xiaomi
Xiaomi Group adopted Apache Doris for the first time in 2019 due to the need for growing analysis business. After three years of development, Apache Doris has been widely used in dozens of businesses such as A/B tests, user behavior analysis, advertising BI, Xiaomi Youpin, and Xiaomi Auto, with dozens of clusters and hundreds of nodes. This year, we further carried out in-depth cooperation with Apache Doris, and used the vectorized execution engine in the A/B test. The query performance has been improved by more than 50% and the stability is higher as well. In the future, we will bring Apache Doris to more core business scenarios, and gradually upgrade to the newest version.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Application of Apache Doris in Manufacturing in Data Platform"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:20:45 +0000

https://www.youtube.com/watch?v=a10wkl2_NVY

Qigo-Tech
Manufacturing data is well-known for numerous sources, large data volume, strong real-time performance requirement, non-standard heterogeneity, significant noise, and frequent changes. Apache Doris’ advantages in core performance, data ecological adaptation, and scenario adaptation can help the manufacturing industry users build a variety of data analysis architectures. In a leading clothing industry data platform, Apache Doris was used as a real-time data warehouse, which shortened the project delivery due time by 40%, reduced the development workload by 30%, increased the query speed by more than 10 times, upgraded the report timeliness from T+1 to real-time , and also reduced the operation and maintenance workload by 80%.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb

"Risk Control Data Mart in Bank of Hangzhou Consumer Finance Company"_Apache Doris Summit 2022

SelectDB — Wed, 08 Feb 2023 03:19:26 +0000

https://www.youtube.com/watch?v=-YVAenInVl0

Bank of Hangzhou Consumer Finance Company
Financial risk control often has higher requirements for real-time data. The early risk control data mart based on Greenplum+CDH can no longer meet the high timeliness requirements of data. The T+1 data production mode seriously reduces the efficiency of daily analysis. Therefore, Bank of Hangzhou Consumer Finance Company introduced Apache Doris in 2022. Through the Multi-Catalog function of the latest version 1.2, it realizes federated analysis with data sources such as Hive/ES, which greatly improves query performance. At the same time, Apache Doris decouples daily batch processing and statistical analysis, reducing resource consumption and further enhancing system stability.

Apache Doris Website
https://doris.apache.org/

Apache Doris @ Twitter
https://twitter.com/doris_apache

Apache Doris @ Medium
https://medium.com/@ApacheDoris

Apache Doris @ Dev.to
https://dev.to/apachedoris

Apache Doris @ Reddit
https://www.reddit.com/user/ApacheDoris

SelectDB Website
https://en.selectdb.com/

SelectDB @ Twitter
https://twitter.com/Select_DB

SelectDB @ Reddit
https://www.reddit.com/user/SelectDB

SelectDB @ Dev.to
https://dev.to/selectdb