Explode#

class sycamore.transforms.explode.Explode(child: Node, **resource_args)[source]#

Bases: SingleThreadUser, NonGPUUser, FlatMap

The Explode transform converts the elements of each document into top-level documents. For example, if you explode a DocSet with a single document containing two elements, the resulting DocSet will have three documents - the original plus a new Document for each of the elements.

Parameters:
  • child -- The source node or component that provides the hierarchical documents to be exploded.

  • resource_args -- Additional resource-related arguments that can be passed to the explosion operation.

Example

source_node = ...  # Define a source node or component that provides hierarchical documents.
explode_transform = Explode(child=source_node)
exploded_dataset = explode_transform.execute()