Enable or disable the disk cache

PHOTO

Fri Dec 01 2023 21:01:53 GMT+0000 (Coordinated Universal Time)

Saved by @knguyencookie

spark.conf.set("spark.databricks.io.cache.enabled", "[true | false]")

https://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache

Save snippets that work from anywhere online with our extensions

Available in the Chrome Web Store

Get Firefox Add-on

Get VS Code extension

Comments

More like this

Browse more snippets >>