005·75

ingestion

/ɪn.ˈdʒɛs.tʃən/ - n.

1 [colloq.] Accepting whatever a source sends, on the working theory that the schema it sent last week is the schema it will send today.Keep. Punchy.This is the problem.

Working definition

2. The process of bringing data from external or upstream systems into a data platform for storage and processing.

Filed

See also

change data captureCapturing every change the source makes, including the ones it would prefer you had not noticed.
connectorA component marked 'maintained' until the source changes its API, after which it is marked 'a meeting'.
data pipelineA sequence of steps that worked when one person built it and has been load-bearing ever since.
schema driftThe source renamed a column and told no one, in the same spirit it once promised the contract was stable.