fix(documentation): Improved documentation accuracy and consistency
This commit is contained in:
parent
9801e15c32
commit
e9426b9cc9
@ -1,5 +1,12 @@
|
|||||||
# Changelog
|
# Changelog
|
||||||
|
|
||||||
|
## 2024-11-24 - 3.3.3 - fix(documentation)
|
||||||
|
Improved documentation accuracy and consistency
|
||||||
|
|
||||||
|
- Updated the project description to reflect the cloud-agnostic nature and advanced capabilities
|
||||||
|
- Enhanced the README with detailed explanations and code examples for advanced features like trash management
|
||||||
|
- Clarified the handling and importance of metadata using the MetaData utility
|
||||||
|
|
||||||
## 2024-11-24 - 3.3.2 - fix(documentation)
|
## 2024-11-24 - 3.3.2 - fix(documentation)
|
||||||
Updated keywords and description for clarity and consistency.
|
Updated keywords and description for clarity and consistency.
|
||||||
|
|
||||||
|
@ -8,32 +8,30 @@
|
|||||||
"githost": "code.foss.global",
|
"githost": "code.foss.global",
|
||||||
"gitscope": "push.rocks",
|
"gitscope": "push.rocks",
|
||||||
"gitrepo": "smartbucket",
|
"gitrepo": "smartbucket",
|
||||||
"description": "A TypeScript library facilitating cloud-agnostic object storage with capabilities such as bucket management, file operations, directory management, and advanced data streaming functionalities.",
|
"description": "A TypeScript library providing a cloud-agnostic interface for managing object storage with functionalities like bucket management, file and directory operations, and advanced features such as metadata handling and file locking.",
|
||||||
"npmPackagename": "@push.rocks/smartbucket",
|
"npmPackagename": "@push.rocks/smartbucket",
|
||||||
"license": "MIT",
|
"license": "MIT",
|
||||||
"keywords": [
|
"keywords": [
|
||||||
"TypeScript",
|
"TypeScript",
|
||||||
"cloud storage",
|
"cloud agnostic",
|
||||||
"object storage",
|
"object storage",
|
||||||
"bucket management",
|
"bucket management",
|
||||||
"file operations",
|
"file operations",
|
||||||
"directory management",
|
"directory management",
|
||||||
"data streaming",
|
"data streaming",
|
||||||
"multi-cloud",
|
|
||||||
"S3",
|
"S3",
|
||||||
"minio",
|
"multi-cloud",
|
||||||
"API",
|
|
||||||
"unified storage",
|
|
||||||
"file locking",
|
"file locking",
|
||||||
"metadata management",
|
"metadata management",
|
||||||
"buffer handling",
|
"buffer handling",
|
||||||
"access control",
|
"access control",
|
||||||
"cloud agnostic",
|
"environment configuration",
|
||||||
"data streaming",
|
"unified storage",
|
||||||
|
"bucket policies",
|
||||||
|
"trash management",
|
||||||
"file transfer",
|
"file transfer",
|
||||||
"data management",
|
"data management",
|
||||||
"streaming",
|
"streaming"
|
||||||
"environment configuration"
|
|
||||||
]
|
]
|
||||||
}
|
}
|
||||||
},
|
},
|
||||||
|
20
package.json
20
package.json
@ -1,7 +1,7 @@
|
|||||||
{
|
{
|
||||||
"name": "@push.rocks/smartbucket",
|
"name": "@push.rocks/smartbucket",
|
||||||
"version": "3.3.2",
|
"version": "3.3.2",
|
||||||
"description": "A TypeScript library facilitating cloud-agnostic object storage with capabilities such as bucket management, file operations, directory management, and advanced data streaming functionalities.",
|
"description": "A TypeScript library providing a cloud-agnostic interface for managing object storage with functionalities like bucket management, file and directory operations, and advanced features such as metadata handling and file locking.",
|
||||||
"main": "dist_ts/index.js",
|
"main": "dist_ts/index.js",
|
||||||
"typings": "dist_ts/index.d.ts",
|
"typings": "dist_ts/index.d.ts",
|
||||||
"type": "module",
|
"type": "module",
|
||||||
@ -47,31 +47,29 @@
|
|||||||
],
|
],
|
||||||
"keywords": [
|
"keywords": [
|
||||||
"TypeScript",
|
"TypeScript",
|
||||||
"cloud storage",
|
"cloud agnostic",
|
||||||
"object storage",
|
"object storage",
|
||||||
"bucket management",
|
"bucket management",
|
||||||
"file operations",
|
"file operations",
|
||||||
"directory management",
|
"directory management",
|
||||||
"data streaming",
|
"data streaming",
|
||||||
"multi-cloud",
|
|
||||||
"S3",
|
"S3",
|
||||||
"minio",
|
"multi-cloud",
|
||||||
"API",
|
|
||||||
"unified storage",
|
|
||||||
"file locking",
|
"file locking",
|
||||||
"metadata management",
|
"metadata management",
|
||||||
"buffer handling",
|
"buffer handling",
|
||||||
"access control",
|
"access control",
|
||||||
"cloud agnostic",
|
"environment configuration",
|
||||||
"data streaming",
|
"unified storage",
|
||||||
|
"bucket policies",
|
||||||
|
"trash management",
|
||||||
"file transfer",
|
"file transfer",
|
||||||
"data management",
|
"data management",
|
||||||
"streaming",
|
"streaming"
|
||||||
"environment configuration"
|
|
||||||
],
|
],
|
||||||
"homepage": "https://code.foss.global/push.rocks/smartbucket",
|
"homepage": "https://code.foss.global/push.rocks/smartbucket",
|
||||||
"repository": {
|
"repository": {
|
||||||
"type": "git",
|
"type": "git",
|
||||||
"url": "https://code.foss.global/push.rocks/smartbucket.git"
|
"url": "https://code.foss.global/push.rocks/smartbucket.git"
|
||||||
}
|
}
|
||||||
}
|
}
|
@ -1 +1,3 @@
|
|||||||
|
* The project uses the official s3 client, not the minio client.
|
||||||
|
* notice the difference between *Strict methods and the normal methods.
|
||||||
|
* metadata is handled though the MetaData class. Important!
|
||||||
|
80
readme.md
80
readme.md
@ -1,7 +1,7 @@
|
|||||||
```markdown
|
```markdown
|
||||||
# @push.rocks/smartbucket
|
# @push.rocks/smartbucket
|
||||||
|
|
||||||
A TypeScript library offering simple and cloud-agnostic object storage with advanced features like bucket creation, file and directory management, and data streaming.
|
A comprehensive TypeScript library for cloud-agnostic object storage offering bucket management, file operations, and advanced data streaming.
|
||||||
|
|
||||||
## Install
|
## Install
|
||||||
|
|
||||||
@ -15,6 +15,10 @@ This command will add `@push.rocks/smartbucket` to your project's dependencies a
|
|||||||
|
|
||||||
## Usage
|
## Usage
|
||||||
|
|
||||||
|
### Introduction
|
||||||
|
|
||||||
|
`@push.rocks/smartbucket` provides a robust set of features to manage cloud storage operations in a cloud-agnostic manner. By leveraging this library, you can seamlessly interact with object storage services like AWS S3, without being tied to any vendor-specific implementations. This library not only abstracts basic file operations but also integrates advanced capabilities such as metadata management, data streaming, file locking, and bucket policies, all through a simplified API.
|
||||||
|
|
||||||
### Table of Contents
|
### Table of Contents
|
||||||
|
|
||||||
1. [Setting Up](#setting-up)
|
1. [Setting Up](#setting-up)
|
||||||
@ -34,11 +38,12 @@ This command will add `@push.rocks/smartbucket` to your project's dependencies a
|
|||||||
- [Bucket Policies](#bucket-policies)
|
- [Bucket Policies](#bucket-policies)
|
||||||
- [Metadata Management](#metadata-management)
|
- [Metadata Management](#metadata-management)
|
||||||
- [File Locking](#file-locking)
|
- [File Locking](#file-locking)
|
||||||
|
- [Trash Management](#trash-management)
|
||||||
6. [Cloud Agnosticism](#cloud-agnosticism)
|
6. [Cloud Agnosticism](#cloud-agnosticism)
|
||||||
|
|
||||||
### Setting Up
|
### Setting Up
|
||||||
|
|
||||||
Start by setting up `@push.rocks/smartbucket` in a TypeScript file, ensuring your project uses ECMAScript modules:
|
Begin by importing the necessary classes from the `@push.rocks/smartbucket` package into your TypeScript file. Create an instance of `SmartBucket` with your storage configuration:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
import {
|
import {
|
||||||
@ -57,13 +62,13 @@ const mySmartBucket = new SmartBucket({
|
|||||||
});
|
});
|
||||||
```
|
```
|
||||||
|
|
||||||
Replace `"yourAccessKey"`, `"yourSecretKey"`, and `"yourEndpointURL"` with appropriate values for your cloud storage service.
|
Replace `"yourAccessKey"`, `"yourSecretKey"`, and `"yourEndpointURL"` with actual data specific to your cloud provider.
|
||||||
|
|
||||||
### Working with Buckets
|
### Working with Buckets
|
||||||
|
|
||||||
#### Creating a New Bucket
|
#### Creating a New Bucket
|
||||||
|
|
||||||
To create a new bucket, use the `createBucket` method. Remember that bucket names must be unique across the storage service:
|
Creating a bucket involves invoking the `createBucket` method. Note that bucket names are unique and follow the rules of the cloud provider:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function createBucket(bucketName: string) {
|
async function createBucket(bucketName: string) {
|
||||||
@ -80,11 +85,11 @@ createBucket("myNewBucket");
|
|||||||
|
|
||||||
#### Listing Buckets
|
#### Listing Buckets
|
||||||
|
|
||||||
SmartBucket allows you to manage buckets but relies on the cloud provider's SDK for listing them.
|
While the library uses cloud-provider capabilities like AWS SDK to list existing buckets, `smartbucket` is aimed at simplifying content management within them.
|
||||||
|
|
||||||
#### Deleting Buckets
|
#### Deleting Buckets
|
||||||
|
|
||||||
You can delete a bucket using the `removeBucket` method:
|
To delete a bucket, simply call the `removeBucket` function:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function deleteBucket(bucketName: string) {
|
async function deleteBucket(bucketName: string) {
|
||||||
@ -96,20 +101,22 @@ async function deleteBucket(bucketName: string) {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
deleteBucket("myNewBucket");
|
deleteBucket("anotherBucketName");
|
||||||
```
|
```
|
||||||
|
|
||||||
### File Operations in Buckets
|
### File Operations in Buckets
|
||||||
|
|
||||||
|
SmartBucket offers a unified API to execute file-based operations efficiently.
|
||||||
|
|
||||||
#### Uploading Files
|
#### Uploading Files
|
||||||
|
|
||||||
To upload a file to a bucket, use the `fastPut` method:
|
Upload a file using the `fastPut` method, specifying the bucket name, file path, and content:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function uploadFile(bucketName: string, filePath: string, fileContent: Buffer | string) {
|
async function uploadFile(bucketName: string, filePath: string, fileContent: Buffer | string) {
|
||||||
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
||||||
await bucket.fastPut({ path: filePath, contents: fileContent });
|
await bucket.fastPut({ path: filePath, contents: fileContent });
|
||||||
console.log(`File uploaded to ${bucketName} at ${filePath}`);
|
console.log(`File uploaded to ${filePath}`);
|
||||||
}
|
}
|
||||||
|
|
||||||
uploadFile("myBucket", "example.txt", "This is a sample file content.");
|
uploadFile("myBucket", "example.txt", "This is a sample file content.");
|
||||||
@ -117,7 +124,7 @@ uploadFile("myBucket", "example.txt", "This is a sample file content.");
|
|||||||
|
|
||||||
#### Downloading Files
|
#### Downloading Files
|
||||||
|
|
||||||
Retrieve files using the `fastGet` method:
|
Download files using `fastGet`. It retrieves the file content as a buffer:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function downloadFile(bucketName: string, filePath: string) {
|
async function downloadFile(bucketName: string, filePath: string) {
|
||||||
@ -131,7 +138,7 @@ downloadFile("myBucket", "example.txt");
|
|||||||
|
|
||||||
#### Streaming Files
|
#### Streaming Files
|
||||||
|
|
||||||
For large files, use streams:
|
For large-scale applications, stream files without loading them fully into memory:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function streamFile(bucketName: string, filePath: string) {
|
async function streamFile(bucketName: string, filePath: string) {
|
||||||
@ -146,13 +153,13 @@ streamFile("myBucket", "largefile.txt");
|
|||||||
|
|
||||||
#### Deleting Files
|
#### Deleting Files
|
||||||
|
|
||||||
Remove files with the `fastRemove` method:
|
Delete files with precision using `fastRemove`:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function deleteFile(bucketName: string, filePath: string) {
|
async function deleteFile(bucketName: string, filePath: string) {
|
||||||
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
||||||
await bucket.fastRemove({ path: filePath });
|
await bucket.fastRemove({ path: filePath });
|
||||||
console.log(`File ${filePath} deleted from ${bucketName}.`);
|
console.log(`File ${filePath} deleted.`);
|
||||||
}
|
}
|
||||||
|
|
||||||
deleteFile("myBucket", "example.txt");
|
deleteFile("myBucket", "example.txt");
|
||||||
@ -160,9 +167,11 @@ deleteFile("myBucket", "example.txt");
|
|||||||
|
|
||||||
### Directory Operations
|
### Directory Operations
|
||||||
|
|
||||||
|
Leverage directory functionalities to better organize and manage files within buckets.
|
||||||
|
|
||||||
#### Listing Directories and Files
|
#### Listing Directories and Files
|
||||||
|
|
||||||
You can navigate and list files in directories within a bucket:
|
Listing contents showcases a directory’s structure and file contents:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function listDirectory(bucketName: string, directoryPath: string) {
|
async function listDirectory(bucketName: string, directoryPath: string) {
|
||||||
@ -182,7 +191,7 @@ listDirectory("myBucket", "path/to/directory");
|
|||||||
|
|
||||||
#### Managing Files in Directories
|
#### Managing Files in Directories
|
||||||
|
|
||||||
Upload, download, and manage files using directory abstractions:
|
Additional functionalities allow file management, inclusive of handling sub-directories:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function manageFilesInDirectory(bucketName: string, directoryPath: string, fileName: string, content: string) {
|
async function manageFilesInDirectory(bucketName: string, directoryPath: string, fileName: string, content: string) {
|
||||||
@ -202,21 +211,20 @@ manageFilesInDirectory("myBucket", "myDir", "example.txt", "File content here");
|
|||||||
|
|
||||||
### Advanced Features
|
### Advanced Features
|
||||||
|
|
||||||
|
The library’s advanced features streamline intricate cloud storage workflows.
|
||||||
|
|
||||||
#### Bucket Policies
|
#### Bucket Policies
|
||||||
|
|
||||||
SmartBucket facilitates bucket policy management, depending on the cloud SDK's capabilities.
|
The library offers tools for maintaining consistent bucket policies across storage providers, assisting in defining access roles and permissions.
|
||||||
|
|
||||||
#### Metadata Management
|
#### Metadata Management
|
||||||
|
|
||||||
You can retrieve and manipulate object metadata, employing it for additional data storage:
|
Easily manage and store metadata by using the `MetaData` utility:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function handleMetadata(bucketName: string, filePath: string) {
|
async function handleMetadata(bucketName: string, filePath: string) {
|
||||||
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
||||||
const meta = await bucket.smartbucketRef.s3Client.send(new plugins.s3.HeadObjectCommand({
|
const meta = await bucket.fastStat({ path: filePath });
|
||||||
Bucket: bucket.name,
|
|
||||||
Key: filePath,
|
|
||||||
}));
|
|
||||||
console.log("Metadata:", meta.Metadata);
|
console.log("Metadata:", meta.Metadata);
|
||||||
}
|
}
|
||||||
|
|
||||||
@ -225,7 +233,7 @@ handleMetadata("myBucket", "example.txt");
|
|||||||
|
|
||||||
#### File Locking
|
#### File Locking
|
||||||
|
|
||||||
Lock files to prevent changes:
|
Prevent accidental writes by locking files:
|
||||||
|
|
||||||
```typescript
|
```typescript
|
||||||
async function lockFile(bucketName: string, filePath: string) {
|
async function lockFile(bucketName: string, filePath: string) {
|
||||||
@ -238,14 +246,34 @@ async function lockFile(bucketName: string, filePath: string) {
|
|||||||
lockFile("myBucket", "example.txt");
|
lockFile("myBucket", "example.txt");
|
||||||
```
|
```
|
||||||
|
|
||||||
### Cloud Agnosticism
|
#### Trash Management
|
||||||
|
|
||||||
`@push.rocks/smartbucket` supports multiple cloud providers, enhancing flexibility in cloud strategies without significant code changes. Adjust configurations as necessary for different providers, as services like AWS S3 or Google Cloud Storage might offer unique features beyond SmartBucket's unified interface.
|
SmartBucket enables a safe deletion mode where files can be moved to a recycling bin, allowing for restoration:
|
||||||
|
|
||||||
This guide demonstrates various operations with `@push.rocks/smartbucket`. Always refer to the comprehensive documentation and cloud provider details to fully leverage the library's capabilities.
|
```typescript
|
||||||
|
async function trashAndRestoreFile(bucketName: string, filePath: string) {
|
||||||
|
const bucket: Bucket = await mySmartBucket.getBucketByName(bucketName);
|
||||||
|
const file: File = await bucket.getBaseDirectory().getFileStrict({ path: filePath });
|
||||||
|
|
||||||
|
// Move the file to trash
|
||||||
|
await file.delete({ mode: 'trash' });
|
||||||
|
console.log(`File ${filePath} moved to trash.`);
|
||||||
|
|
||||||
|
// Retrieve the file from the trash
|
||||||
|
const trashFile = await bucket.getTrash().getTrashedFileByOriginalName({ path: filePath });
|
||||||
|
await trashFile.restore();
|
||||||
|
console.log(`File ${filePath} restored from trash.`);
|
||||||
|
}
|
||||||
|
|
||||||
|
trashAndRestoreFile("myBucket", "example.txt");
|
||||||
```
|
```
|
||||||
|
|
||||||
This readme provides detailed documentation on using the `@push.rocks/smartbucket` module, demonstrating its capabilities through comprehensive examples and use cases. Each section is designed to guide a user through basic to more complex operations, ensuring a complete presentation of the library's features.
|
### Cloud Agnosticism
|
||||||
|
|
||||||
|
`@push.rocks/smartbucket` supports a multitude of cloud providers, enhancing flexibility in adopting different cloud strategies without the need for extensive code rewrite. It offers a uniform interface allowing to perform operations seamlessly between different storage solutions such as AWS S3, Google Cloud Storage, and more. This aspect empowers organizations to align their storage decisions with business needs rather than technical constraints.
|
||||||
|
|
||||||
|
By following this guide, you should be well-equipped to handle cloud storage operations using the `@push.rocks/smartbucket` library. Diligently constructed code examples elucidate the extensive functionalities offered by the library, aligned with best practices in cloud storage. For a deeper dive into any specific feature, refer to the comprehensive documentation provided with the library and the official documentation of the cloud providers you are integrating with.
|
||||||
|
```
|
||||||
|
|
||||||
## License and Legal Information
|
## License and Legal Information
|
||||||
|
|
||||||
|
@ -3,6 +3,6 @@
|
|||||||
*/
|
*/
|
||||||
export const commitinfo = {
|
export const commitinfo = {
|
||||||
name: '@push.rocks/smartbucket',
|
name: '@push.rocks/smartbucket',
|
||||||
version: '3.3.2',
|
version: '3.3.3',
|
||||||
description: 'A TypeScript library facilitating cloud-agnostic object storage with capabilities such as bucket management, file operations, directory management, and advanced data streaming functionalities.'
|
description: 'A TypeScript library providing a cloud-agnostic interface for managing object storage with functionalities like bucket management, file and directory operations, and advanced features such as metadata handling and file locking.'
|
||||||
}
|
}
|
||||||
|
Loading…
Reference in New Issue
Block a user