Pinecone

This page was recently updated. What do you think about it? Let us know!.

Batch process all your records to store structured outputs in Pinecone.

The requirements are as follows.

• A Pinecone account. Get an account.

• A Pinecone API key. Get an API key.

• A Pinecone serverless index. Create a serverless index.

  Unstructured recommends that all records in the target index have a field named record_id with a string data type. Unstructured can use this field to do intelligent document overwrites. Without this field, duplicate documents might be written to the index or, in some cases, the operation could fail altogether.

The Pinecone connector dependencies.

pip install "unstructured-ingest[pinecone]"

You might also need to install additional dependencies, depending on your needs. Learn more.

The following environment variables:

• PINECONE_API_KEY - The Pinecone API, represented by --api-key (CLI) or api_key (Python, in the PineconeAccessConfig object).
• PINECONE_INDEX_NAME - The Pinecone serverless index name, represented by --index-name (CLI) or index_name (Python).

These environment variables:

• UNSTRUCTURED_API_KEY - Your Unstructured API key value.
• UNSTRUCTURED_API_URL - Your Unstructured API URL.

Now call the Unstructured CLI or Python SDK. The source connector can be any of the ones supported.

This example uses the local source connector: