fleet-memory/hindsight-docs/examples/api
Nicolò Boschi aefb3fcf4d
fix: improve async batch retain with large payloads (#366)
* fix: improve async batch retain with large payloads

* fix: improve async batch retain with large payloads

* api

* api

* api

* api

* api

* Clean up perf benchmark: keep only Python files

- Remove README.md and PERFORMANCE_FINDINGS.md
- Remove results/ JSON files (gitignored)
- Remove test_data/ directory
- Keep only __init__.py and retain_perf.py

* docs: explain automatic batch optimization for async retain

- Add section explaining Hindsight automatically handles batch sizing
- Users don't need to manually tune batch sizes with async mode
- Hindsight splits large batches (>10k tokens) into optimized sub-batches
- Include example showing best practices

* docs: remove emojis and code example from performance page

* fix: correct OperationDetails type to match API response

- Change optional fields to use | null instead of ?
- Fixes TypeScript compilation error in control plane build

* fix: use discriminated union for OperationDetails type

- Support both success and error states properly
- Fixes TypeScript error when setting error state

* fix: use unique document_ids in batch retain examples

- Each item in a batch must have unique document_id
- Update both Python and JavaScript examples
- Fixes test-doc-examples CI failure

* chore: trigger CI

* fix: test mocking and duplicate document_ids in examples

- Mock _get_pool() in test_async_retain_tags.py to avoid _initialized error
- Set _initialized = True on mocked MemoryEngine instances
- Fix duplicate document_ids in retain.py and retain.mjs examples

* fix: properly mock async pool/connection and fix more duplicate document_ids

- Use AsyncMock for pool.acquire() to fix 'can't be used in await' error
- Fix duplicate document_ids in retain-async examples (retain.py and retain.mjs)
- Remove batch-level document_id parameter that caused duplicates

* ci: collect all doc example failures and show summary

- Run all Python/Node.js/CLI examples regardless of individual failures
- Collect failure list and display summary at the end
- Show pass/fail count and list of failed files
- Exit with failure only after running all examples

* refactor: extract doc example testing to standalone script

- Create scripts/test-doc-examples.sh to run all examples
- Collects logs of failed examples separately
- Shows full error logs only for failures at the end
- Clean summary with pass/fail counts
- Proper exit codes
- Replaces inline bash in CI workflow

* fix: doc examples - duplicate document_ids and error handling

- retain.py: move document_id to item level to avoid duplicates
- documents.mjs: add error handling for getDocument to show clear error message

* fix: update tests for duplicate document_id validation

- test_async_retain_tags: verify operation structure instead of exact UUID
- test_delete_bank: use unique document_ids (team-doc-1, team-doc-2)
2026-02-16 12:51:42 +01:00
..
legacy doc: add blog (#201) 2026-01-28 15:42:14 +01:00
cli-reference.sh ci: finalize test for the documentation code (#57) 2025-12-19 12:17:59 -07:00
directives.mjs fix: misc fixes for observations and mental models (#209) 2026-01-27 15:37:57 +01:00
directives.py fix: misc fixes for observations and mental models (#209) 2026-01-27 15:37:57 +01:00
documents.mjs fix: improve async batch retain with large payloads (#366) 2026-02-16 12:51:42 +01:00
documents.py fix: improve async batch retain with large payloads (#366) 2026-02-16 12:51:42 +01:00
main-methods.mjs ci: finalize test for the documentation code (#57) 2025-12-19 12:17:59 -07:00
main-methods.py fix: misc fixes for observations and mental models (#209) 2026-01-27 15:37:57 +01:00
memory-banks.mjs doc: add blog (#201) 2026-01-28 15:42:14 +01:00
memory-banks.py doc: add blog (#201) 2026-01-28 15:42:14 +01:00
mental-models.py fix: misc fixes for observations and mental models (#209) 2026-01-27 15:37:57 +01:00
quickstart.mjs Add documentation code validation system (#43) 2025-12-18 10:21:38 +01:00
quickstart.py Add documentation code validation system (#43) 2025-12-18 10:21:38 +01:00
quickstart.sh Add documentation code validation system (#43) 2025-12-18 10:21:38 +01:00
README.md doc: mental models (#199) 2026-01-26 14:27:08 +01:00
recall.mjs Add documentation code validation system (#43) 2025-12-18 10:21:38 +01:00
recall.py doc: add blog (#201) 2026-01-28 15:42:14 +01:00
recall.sh chore: internal renames (#204) 2026-01-27 09:53:28 +01:00
reflect.mjs chore: internal renames (#204) 2026-01-27 09:53:28 +01:00
reflect.py doc: mental models (#199) 2026-01-26 14:27:08 +01:00
reflect.sh chore: internal renames (#204) 2026-01-27 09:53:28 +01:00
retain.mjs fix: improve async batch retain with large payloads (#366) 2026-02-16 12:51:42 +01:00
retain.py fix: improve async batch retain with large payloads (#366) 2026-02-16 12:51:42 +01:00
retain.sh Add documentation code validation system (#43) 2025-12-18 10:21:38 +01:00

API Documentation Examples

This directory contains runnable example scripts that serve as the source of truth for code samples in the documentation.

How It Works

  1. Scripts are runnable - Each file can be executed as a smoke test
  2. Markers define sections - Code between # [docs:section-name] and # [/docs:section-name] markers is extracted
  3. Docs import at build time - MDX files use raw-loader to import scripts, then CodeSnippet extracts marked sections

File Structure

File Documentation Description
quickstart.py/mjs/sh quickstart.md Getting started examples
retain.py/mjs/sh retain.md Memory ingestion examples
recall.py/mjs/sh recall.md Memory retrieval examples
reflect.py/mjs/sh reflect.md AI reflection examples
memory-banks.py/mjs memory-banks.md Bank management examples
documents.py/mjs documents.md Document CRUD examples
reflections.py reflections.md Reflections CRUD examples
main-methods.py main-methods.md Core method examples
cli-reference.sh cli.md CLI command examples

Running Examples

# Run all Python examples
for f in *.py; do python "$f"; done

# Run all Node.js examples
for f in *.mjs; do node "$f"; done

# Run all CLI examples
for f in *.sh; do bash "$f"; done

Requires a running Hindsight server at http://localhost:8888 (or set HINDSIGHT_API_URL).

Legacy Examples

The legacy/ folder contains deprecated example files kept only for backward compatibility with older documentation versions. These files are not runnable and are skipped by CI tests.

What's NOT Covered

1. OpenAPI Auto-Generated Docs (/api-reference/*)

These pages are generated directly from the OpenAPI specification. The spec itself is the source of truth, and the generated docs reflect it automatically. No manual code examples to validate.

2. Interactive CLI Commands

Command Reason
hindsight configure Requires interactive user input (prompts for API URL, credentials)
hindsight configure --show Displays sensitive configuration, not suitable for automated tests

3. Installation/Setup Instructions

Documentation sections covering pip install, npm install, or system setup are instructions, not executable code samples. These are validated by the CI environment setup itself.

4. Error Handling Examples

Some docs show error responses (e.g., "what happens when bank doesn't exist"). These require intentionally broken states that would fail smoke tests. Error behavior is covered by unit tests instead.

Adding New Examples

  1. Create or edit the appropriate script file
  2. Add markers around the new code section:
    # [docs:my-new-section]
    client.some_method(...)
    # [/docs:my-new-section]
    
  3. Reference in the MDX file:
    import myScript from '!!raw-loader!@site/examples/api/my-script.py';
    <CodeSnippet code={myScript} section="my-new-section" language="python" />
    
  4. Run the script locally to verify it works

Marker Format

  • Python/Bash: # [docs:section-name] / # [/docs:section-name]
  • JavaScript: // [docs:section-name] / // [/docs:section-name]

Section names should be kebab-case and descriptive (e.g., retain-with-context, recall-basic).