Skip to main content

@okcashpro/okai v0.1.7-alpha.1 / splitChunks

Function: splitChunks()

splitChunks(content, chunkSize, bleed): Promise<string[]>

Splits content into chunks of specified size with optional overlapping bleed sections

Parameters

content: string

The text content to split into chunks

chunkSize: number = 512

The maximum size of each chunk in tokens

bleed: number = 20

Number of characters to overlap between chunks (default: 100)

Returns

Promise<string[]>

Promise resolving to array of text chunks with bleed sections

Defined in

packages/core/src/generation.ts:681