DEV Community

# bigdata

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Metadata for win — Apache Parquet
rahuldubey391 profile

Metadata for win — Apache Parquet

#python #bigdata #datascience #dataengineering
Comments
5 min read
Comprehensive Guide to Schema Inference with MongoDB Spark Connector in PySpark
chaets profile

Comprehensive Guide to Schema Inference with MongoDB Spark Connector in PySpark

#pyspark #bigdata #mongodb #spark
Comments
3 min read
Advanced Insights into Automated Data Processing Tools
data_expertise profile

Advanced Insights into Automated Data Processing Tools

#automateddataprocessing #machinelearning #bigdata #datascience
1
Comments
4 min read
How to Build an API with Strong Security Measures
ovaisnaseem profile

How to Build an API with Strong Security Measures

#api #bigdata #datascience #datamanagement
Comments
4 min read
Documenting Rate Limits and Throttling in REST APIs
ovaisnaseem profile

Documenting Rate Limits and Throttling in REST APIs

#api #bigdata #datamanagement #datascience
Comments
5 min read
GraphQL API Design Best Practices for Efficient Data Management
ovaisnaseem profile

GraphQL API Design Best Practices for Efficient Data Management

#api #datamanagement #bigdata #graphql
1
Comments
5 min read
The current Lakehouse is like a false proposition
esproc_spl profile

The current Lakehouse is like a false proposition

#lackhouse #bigdata #development #programming
6
Comments 1
10 min read
Is distributed technology the panacea for big data processing?
esproc_spl profile

Is distributed technology the panacea for big data processing?

#bigdata #processing #development #lauguage
7
Comments 1
10 min read
Big Data: a ferramenta que precisamos.
delmiro profile

Big Data: a ferramenta que precisamos.

#bigdata #database #datascience #backend
Comments
2 min read
PySpark： missing value
chelsealiu0822 profile

PySpark： missing value

#pyspark #python #dataengineering #bigdata
Comments
2 min read
Cross-cluster replication for read-write separation
apachedoris profile

Cross-cluster replication for read-write separation

#database #bigdata #dataengineering #tutorial
2
Comments
4 min read
Stream Data at scale from millions of sources with Amazon Kinesis (Serverless)
asankab profile

Stream Data at scale from millions of sources with Amazon Kinesis (Serverless)

#bigdata #kinesis #aws #strems
13
Comments
7 min read
Trino & Iceberg Made Easy: A Ready-to-Use Playground
lazypro profile

Trino & Iceberg Made Easy: A Ready-to-Use Playground

#bigdata #datascience #tutorial #dataengineering
22
Comments
3 min read
The Role of Data Integration in Healthcare Research and Precision Medicine
ovaisnaseem profile

The Role of Data Integration in Healthcare Research and Precision Medicine

#dataintegration #healthcare #datascience #bigdata
Comments 1
4 min read
Automating Data Processes for Efficiency and Accuracy
ovaisnaseem profile

Automating Data Processes for Efficiency and Accuracy

#dataextraction #bigdata #datamanagement #datascience
Comments
5 min read
Auto-increment columns in Apache Doris
apachedoris profile

Auto-increment columns in Apache Doris

#database #dataegnineering #tutorial #bigdata
Comments
11 min read
What to use parquet or CSV?
hiteshchawla profile

What to use parquet or CSV?

#datascience #database #python #bigdata
22
Comments
3 min read
Accelerating ETL Processes for Timely Business Intelligence
ovaisnaseem profile

Accelerating ETL Processes for Timely Business Intelligence

#changedatacapture #bigdata #datamanagement #datascience
Comments
4 min read
Are There “Queries over Trillion-Row Tables in Seconds”? Is “N-Times Faster Than ORACLE” an Exaggeration?
jbx1279 profile

Are There “Queries over Trillion-Row Tables in Seconds”? Is “N-Times Faster Than ORACLE” an Exaggeration?

#sql #performance #bigdata #database
Comments
4 min read
A glimpse into the future of data processing infrastructure.
cpard profile

A glimpse into the future of data processing infrastructure.

#database #bigdata #snowflake #spark
Comments
9 min read
Safeguarding Data Quality By Addressing Data Privacy and Security Concerns
ovaisnaseem profile

Safeguarding Data Quality By Addressing Data Privacy and Security Concerns

#datascience #bigdata #datamanagement #datamigration
1
Comments 1
4 min read
Best Practices for Designing an Efficient ETL Pipeline
ovaisnaseem profile

Best Practices for Designing an Efficient ETL Pipeline

#etl #datascience #bigdata #datamanagement
5
Comments
4 min read
The Role of Big Data Analytics in BFSI: Leveraging Data for Competitive Advantage
ajaytie profile

The Role of Big Data Analytics in BFSI: Leveraging Data for Competitive Advantage

#bigdata #bfsi #data #analytics
Comments
4 min read
LLMs, DevOps, and Big Data Musings
bcornils profile

LLMs, DevOps, and Big Data Musings

#devops #llm #ai #bigdata
Comments
3 min read
Understanding and Mitigating Message Loss in Apache Kafka
yukooshima profile

Understanding and Mitigating Message Loss in Apache Kafka

#bigdata #datareliability #streamprocessing #distributed
17
Comments
9 min read
loading...