id: PYSEC-2019-114
details: Prior to Spark 2.3.3, in certain situations Spark would write user data to
  local disk unencrypted, even if spark.io.encryption.enabled=true. This includes
  cached blocks that are fetched to disk (controlled by spark.maxRemoteBlockSizeFetchToMem);
  in SparkR, using parallelize; in Pyspark, using broadcast and parallelize; and use
  of python udfs.
affected:
- package:
    name: pyspark
    ecosystem: PyPI
    purl: pkg:pypi/pyspark
  ranges:
  - type: ECOSYSTEM
    events:
    - introduced: "0"
    - fixed: 2.3.3
  versions:
  - 2.1.1
  - 2.1.2
  - 2.1.3
  - 2.2.0
  - 2.2.1
  - 2.2.2
  - 2.2.3
  - 2.3.0
  - 2.3.1
  - 2.3.2
references:
- type: WEB
  url: 
    https://lists.apache.org/thread.html/c2a39c207421797f82823a8aff488dcd332d9544038307bf69a2ba9e@%3Cuser.spark.apache.org%3E
- type: WEB
  url: 
    https://lists.apache.org/thread.html/rabe1d47e2bf8b8f6d9f3068c8d2679731d57fa73b3a7ed1fa82406d2@%3Cissues.spark.apache.org%3E
- type: WEB
  url: 
    https://lists.apache.org/thread.html/ra216b7b0dd82a2c12c2df9d6095e689eb3f3d28164e6b6587da69fae@%3Ccommits.spark.apache.org%3E
- type: ADVISORY
  url: https://github.com/advisories/GHSA-fp5j-3fpf-mhj5
aliases:
- CVE-2019-10099
- GHSA-fp5j-3fpf-mhj5
modified: "2020-06-23T00:15:00Z"
published: "2019-08-07T17:15:00Z"