PII Handling in Data Pipes

Data Pipes scans and identify the PII related data from any source. Before replicating or ingesting the data into the data lake, Data Pipes runs a PII scan on the source which specifies what all columns have been identified as PII. In the case that PII columns are found, Data Pipes presents the results, which the user can take an action on whether they want to mask or tokenize the data. Data Pipes currently supports 2 techniques on handling PII data:

1. Masking: In masking strategy, the column data is replaced by asterisks ***, and hence that information/data becomes masked for the end user.

2. Tokenization: In tokenization, Data Pipes uses SHA-256 encryption to encrypt the data before ingesting into the data lake.