get_long_ids {rsyntax}

Get ids in various forms to extract token_ids

Description

Get ids in various forms to extract token_ids

Usage

get_long_ids(..., select = NULL, with_fill = FALSE)

Arguments

...

Either a data.table with the columns doc_id, sentence and token_id, or the output of apply_queries

select

If not null, a character vector for selecting column names

with_fill

If TRUE, include the ids of the fill nodes

Value

A data.table with the columns doc_id, sentence and token_id