Databricks » Engineering Blog
527 FOLLOWERS
Read the Databricks engineering blog for the latest on Apache Spark, Delta Lake, MLflow and much more. As the world's first and only lakehouse platform in the cloud, Databricks combines the best of data warehouses and data lakes to offer an open and unified platform for data and AI.
Databricks » Engineering Blog
7M ago
We are excited to announce the public preview of the next generation of Databricks SQL dashboards, dubbed Lakeview dashboards. Available today, this new ..read more
Databricks » Engineering Blog
7M ago
We are excited to announce public preview of GPU and LLM optimization support for Databricks Model Serving! With this launch, you can deploy ..read more
Databricks » Engineering Blog
7M ago
My summer internship on the PySpark team was a whirlwind of exciting events. The PySpark team develops the Python APIs of the open ..read more
Databricks » Engineering Blog
7M ago
Introduction In this blog post, we'll explore a set of advanced SQL functions available within Apache Spark that leverage the HyperLogLog algorithm, enabling ..read more
Databricks » Engineering Blog
7M ago
We are thrilled to introduce the support of a new SQL feature in Apache Spark and Databricks: Lateral Column Alias (LCA). This feature ..read more
Databricks » Engineering Blog
7M ago
Today, we are happy to announce the availability of Apache Spark™ 3.5 on Databricks as part of Databricks Runtime 14.0. We extend our s ..read more
Databricks » Engineering Blog
8M ago
As part of MLflow 2’s support for LLMOps, we are excited to introduce the latest updates to support prompt engineering in MLflow 2.7. A ..read more
Databricks » Engineering Blog
8M ago
We are thrilled to announce that you can run even more workloads on Databricks’ highly efficient multi-user clusters thanks to new security and g ..read more
Databricks » Engineering Blog
8M ago
We are thrilled to announce great enhancements to onboard more workloads to Unity Catalog clusters in shared access mode, Databricks' highly efficient, secure ..read more
Databricks » Engineering Blog
8M ago
With the rapid advancement of neural network-based techniques and Large Language Model (LLM) research, businesses are increasingly interested in AI applications for value ..read more