Atlassian builds OCSF security lakehouse on Databricks to handle 44 billion daily events
Overview
Atlassian standardized its security logs on the Open Cybersecurity Schema Framework (OCSF) and built a security lakehouse on Databricks to process 44 billion events per day, according to a Databricks blog post written from Databricks' side.
Atlassian says table partitioning and Z-ORDER cut a representative query from about 45 seconds to 2–3 seconds, a 95% improvement. Atlassian also says Graviton clusters with Photon reduced query cost and runtime by roughly two-thirds.
Written by AI from the articles below · updated Oct 15, 6:07 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- Databricks BlogOfficialAtlassian builds OCSF security lakehouse on Databricks to cut logging noise
AIAtlassian standardized its security logs on the Open Cybersecurity Schema Framework (OCSF) and built the lakehouse on Databricks to handle 44 billion events per day. Table partitioning and Z-ORDER cut a representative query from about 45 seconds to 2–3 seconds, a 95% improvement. Graviton clusters with Photon reduced query cost and runtime by roughly two-thirds.
Heat trend
Not enough continuous observations to show a trend yet.