Atlassian builds OCSF security lakehouse on Databricks to cut logging noise

Atlassian standardized its security logs on the Open Cybersecurity Schema Framework (OCSF) and built the lakehouse on Databricks to handle 44 billion events per day. Table partitioning and Z-ORDER cut a representative query from about 45 seconds to 2–3 seconds, a 95% improvement. Graviton clusters with Photon reduced query cost and runtime by roughly two-thirds.