Model Mechanism and Training Methods of DeepSeek

DeepSeek · Official agreement

Read the agreement

3 of 23 cards in Data Access & Collection

Data Access & Collection · Context

Personal-information rules are in a separate policy

DeepSeek directs users to its Privacy Policy for the specific rules on collecting, protecting, and using personal information. That linked policy is not part of this supplied document, so this disclosure alone does not establish all those rules.

Supporting quotations

For specific rules on how we collect, protect, and use personal information, please carefully read the DeepSeek Privacy Policy.

Not stated here

  • The linked Privacy Policy is not supplied in this assignment.

Data Access & Collection · Company practice

Pre-training primarily uses public internet data and licensed datasets

DeepSeek says pre-training primarily uses two categories: freely accessible internet information, acquired and filtered with technical methods to build broad world knowledge; and proprietary datasets obtained from third-party providers through agreements based on lawful authorization. “Primarily” does not state these are the only possible sources.

Supporting quotations

During the pre-training phase, corpus data is required for training. This phase primarily uses the following two categories of data:
Public Data: We use publicly
available information on the internet to build the model's broad understanding of world knowledge. We employ technical methods to acquire and filter these freely accessible data to enrich the model's knowledge base.
Licensed Data: We collaborate with
third-party data providers to obtain proprietary datasets through legally signed agreements. We ensure all collaborations are based on lawful authorization.

Data Access & Collection · Company practice

Pre-training may incidentally include personal information despite screening

DeepSeek says pre-training does not require personal information, that it does not intentionally collect it to associate with a specific account or individual, and that it does not proactively use it for model training. It excludes sensitive information, credit card numbers, and unique identification information from training sources. However, public or licensed data may incidentally contain personal information; DeepSeek says it screens and removes it as much as possible and tests the data before training. This is not an assurance that every item is removed.

Supporting quotations

The pre-training phase does not require personal information for training. Therefore, we do not intentionally collect personal information to associate with any specific account or individual, nor do we proactively use it to train our models. We exclude sensitive information, credit card numbers, or unique identification information from our training data sources to minimize the risk of collecting any personal information. However, due to the vast scale of pre-training data, some publicly available online content or licensed data from other providers may incidentally contain personal information. We employ technical measures to screen and remove such information from the training data as much as possible and conduct tests before using the data for training.

Cross-references