fix(core): Improve error handling and logging; enhance search query sanitization; update dependency versions and documentation

.serena/memories/code_style_conventions.md

@@ -0,0 +1,44 @@
+# Code Style & Conventions
+
+## TypeScript Standards
+- **Target**: ES2022
+- **Module System**: ESM with NodeNext resolution
+- **Decorators**: Experimental decorators enabled
+- **Strict Mode**: Implied through TypeScript configuration
+
+## Naming Conventions
+- **Interfaces**: Prefix with `I` (e.g., `IUserData`, `IConfig`)
+- **Types**: Prefix with `T` (e.g., `TResponseType`, `TQueryResult`)
+- **Classes**: PascalCase (e.g., `SmartdataDb`, `SmartDataDbDoc`)
+- **Files**: All lowercase (e.g., `classes.doc.ts`, `plugins.ts`)
+- **Methods**: camelCase (e.g., `findOne`, `saveToDb`)
+
+## Import Patterns
+- All external dependencies imported in `ts/plugins.ts`
+- Reference as `plugins.moduleName.method()`
+- Use full import paths for internal modules
+- Maintain ESM syntax throughout
+
+## Class Structure
+- Use decorators for MongoDB document definitions
+- Extend base classes (SmartDataDbDoc, SmartDataDbCollection)
+- Static methods for factory patterns
+- Instance methods for document operations
+
+## Async Patterns
+- Preserve Promise-based patterns
+- Use async/await for clarity
+- Handle errors appropriately
+- Return typed Promises
+
+## MongoDB Specifics
+- Use `@unify()` decorator for unique fields
+- Use `@svDb()` decorator for database fields
+- Implement proper serialization/deserialization
+- Type-safe query construction with DeepQuery<T>
+
+## Testing Patterns
+- Import from `@git.zone/tstest/tapbundle`
+- End test files with `export default tap.start()`
+- Use descriptive test names
+- Cover edge cases and error conditions

.serena/memories/project_overview.md

@@ -0,0 +1,37 @@
+# Project Overview: @push.rocks/smartdata
+
+## Purpose
+An advanced TypeScript-first MongoDB wrapper library providing enterprise-grade features for distributed systems, real-time data synchronization, and easy data management.
+
+## Tech Stack
+- **Language**: TypeScript (ES2022 target)
+- **Runtime**: Node.js >= 16.x
+- **Database**: MongoDB >= 4.4
+- **Build System**: tsbuild
+- **Test Framework**: tstest with tapbundle
+- **Package Manager**: pnpm (v10.7.0)
+- **Module System**: ESM (ES Modules)
+
+## Key Features
+- Type-safe MongoDB integration with decorators
+- Document management with automatic timestamps
+- EasyStore for key-value storage
+- Distributed coordination with leader election
+- Real-time data sync with RxJS watchers
+- Deep query type safety
+- Enhanced cursor API
+- Powerful search capabilities
+
+## Project Structure
+- **ts/**: Main TypeScript source code
+  - Core classes for DB, Collections, Documents, Cursors
+  - Distributed coordinator, EasyStore, Watchers
+  - Lucene adapter for search functionality
+- **test/**: Test files using tstest framework
+- **dist_ts/**: Compiled JavaScript output
+
+## Key Dependencies
+- MongoDB driver (v6.18.0)
+- @push.rocks ecosystem packages
+- @tsclass/tsclass for decorators
+- RxJS for reactive programming

.serena/memories/suggested_commands.md

@@ -0,0 +1,35 @@
+# Suggested Commands for @push.rocks/smartdata
+
+## Build & Development
+- `pnpm build` - Build the TypeScript project with web support
+- `pnpm buildDocs` - Generate documentation using tsdoc
+- `tsbuild --web --allowimplicitany` - Direct build command
+
+## Testing
+- `pnpm test` - Run all tests in test/ directory
+- `pnpm testSearch` - Run specific search test
+- `tstest test/test.specific.ts --verbose` - Run specific test with verbose output
+- `tsbuild check test/**/* --skiplibcheck` - Type check test files
+
+## Package Management
+- `pnpm install` - Install dependencies
+- `pnpm install --save-dev <package>` - Add dev dependency
+- `pnpm add <package>` - Add production dependency
+
+## Version Control
+- `git status` - Check current changes
+- `git diff` - View uncommitted changes
+- `git log --oneline -10` - View recent commits
+- `git mv <old> <new>` - Move/rename files preserving history
+
+## System Utilities (Linux)
+- `ls -la` - List all files with details
+- `grep -r "pattern" .` - Search for pattern in files
+- `find . -name "*.ts"` - Find TypeScript files
+- `ps aux | grep node` - Find Node.js processes
+- `lsof -i :80` - Check process on port 80
+
+## Debug & Development
+- `tsx <script.ts>` - Run TypeScript file directly
+- Store debug scripts in `.nogit/debug/`
+- Curl endpoints for API testing

.serena/memories/task_completion_checklist.md

@@ -0,0 +1,33 @@
+# Task Completion Checklist
+
+When completing any coding task in this project, always:
+
+## Before Committing
+1. **Build the project**: Run `pnpm build` to ensure TypeScript compiles
+2. **Run tests**: Execute `pnpm test` to verify nothing is broken
+3. **Type check**: Verify types compile correctly
+4. **Check for lint issues**: Look for any code style violations
+
+## Code Quality Checks
+- Verify all imports are in `ts/plugins.ts` for external dependencies
+- Check that interfaces are prefixed with `I`
+- Check that types are prefixed with `T`
+- Ensure filenames are lowercase
+- Verify async patterns are preserved where needed
+- Check that decorators are properly used for MongoDB documents
+
+## Documentation
+- Update relevant comments if functionality changed
+- Ensure new exports are properly documented
+- Update readme.md if new features added (only if explicitly requested)
+
+## Git Hygiene
+- Make small, focused commits
+- Write clear commit messages
+- Use `git mv` for file operations
+- Never commit sensitive data or keys
+
+## Final Verification
+- Test the specific functionality that was changed
+- Ensure no unintended side effects
+- Verify the change solves the original problem completely

.serena/project.yml

@@ -0,0 +1,68 @@
+# language of the project (csharp, python, rust, java, typescript, go, cpp, or ruby)
+#  * For C, use cpp
+#  * For JavaScript, use typescript
+# Special requirements:
+#  * csharp: Requires the presence of a .sln file in the project folder.
+language: typescript
+
+# whether to use the project's gitignore file to ignore files
+# Added on 2025-04-07
+ignore_all_files_in_gitignore: true
+# list of additional paths to ignore
+# same syntax as gitignore, so you can use * and **
+# Was previously called `ignored_dirs`, please update your config if you are using that.
+# Added (renamed)on 2025-04-07
+ignored_paths: []
+
+# whether the project is in read-only mode
+# If set to true, all editing tools will be disabled and attempts to use them will result in an error
+# Added on 2025-04-18
+read_only: false
+
+
+# list of tool names to exclude. We recommend not excluding any tools, see the readme for more details.
+# Below is the complete list of tools for convenience.
+# To make sure you have the latest list of tools, and to view their descriptions, 
+# execute `uv run scripts/print_tool_overview.py`.
+#
+#  * `activate_project`: Activates a project by name.
+#  * `check_onboarding_performed`: Checks whether project onboarding was already performed.
+#  * `create_text_file`: Creates/overwrites a file in the project directory.
+#  * `delete_lines`: Deletes a range of lines within a file.
+#  * `delete_memory`: Deletes a memory from Serena's project-specific memory store.
+#  * `execute_shell_command`: Executes a shell command.
+#  * `find_referencing_code_snippets`: Finds code snippets in which the symbol at the given location is referenced.
+#  * `find_referencing_symbols`: Finds symbols that reference the symbol at the given location (optionally filtered by type).
+#  * `find_symbol`: Performs a global (or local) search for symbols with/containing a given name/substring (optionally filtered by type).
+#  * `get_current_config`: Prints the current configuration of the agent, including the active and available projects, tools, contexts, and modes.
+#  * `get_symbols_overview`: Gets an overview of the top-level symbols defined in a given file.
+#  * `initial_instructions`: Gets the initial instructions for the current project.
+#     Should only be used in settings where the system prompt cannot be set,
+#     e.g. in clients you have no control over, like Claude Desktop.
+#  * `insert_after_symbol`: Inserts content after the end of the definition of a given symbol.
+#  * `insert_at_line`: Inserts content at a given line in a file.
+#  * `insert_before_symbol`: Inserts content before the beginning of the definition of a given symbol.
+#  * `list_dir`: Lists files and directories in the given directory (optionally with recursion).
+#  * `list_memories`: Lists memories in Serena's project-specific memory store.
+#  * `onboarding`: Performs onboarding (identifying the project structure and essential tasks, e.g. for testing or building).
+#  * `prepare_for_new_conversation`: Provides instructions for preparing for a new conversation (in order to continue with the necessary context).
+#  * `read_file`: Reads a file within the project directory.
+#  * `read_memory`: Reads the memory with the given name from Serena's project-specific memory store.
+#  * `remove_project`: Removes a project from the Serena configuration.
+#  * `replace_lines`: Replaces a range of lines within a file with new content.
+#  * `replace_symbol_body`: Replaces the full definition of a symbol.
+#  * `restart_language_server`: Restarts the language server, may be necessary when edits not through Serena happen.
+#  * `search_for_pattern`: Performs a search for a pattern in the project.
+#  * `summarize_changes`: Provides instructions for summarizing the changes made to the codebase.
+#  * `switch_modes`: Activates modes by providing a list of their names
+#  * `think_about_collected_information`: Thinking tool for pondering the completeness of collected information.
+#  * `think_about_task_adherence`: Thinking tool for determining whether the agent is still on track with the current task.
+#  * `think_about_whether_you_are_done`: Thinking tool for determining whether the task is truly completed.
+#  * `write_memory`: Writes a named memory (for future reference) to Serena's project-specific memory store.
+excluded_tools: []
+
+# initial prompt for the project. It will always be given to the LLM upon activating the project
+# (contrary to the memories, which are loaded on demand).
+initial_prompt: ""
+
+project_name: "smartdata"